On a logarithmic scale I can easily get halfway to the top of Mount Everest by walking onto some hill. Doesn't mean I should claim I went there.
It seems the highest a balloon ever went was 53km. SpaceShipOne went to the 100km and it took them a lot more effort. The altitude record for jet aircraft is 37,650m, this is about the same as the height he jumped from and seems be a better comparison to me.