"Real" ball bearings are not all that expensive, perhaps even the same price, guys, and most likely a hell of a lot more durable than roller skate bearings.
Roller skate bearings are something that McGyver would use in a pinch
You do pay a premium for tiny, but there is a good price break in certain common bearings:
6202 2RS = C$2.66 (35mm Od x 15mm Id)
6203 2RS = C$2.34 (40mm Od x 17mm Id)
These bearings can also be purchased with imperial sized bores, 5/8" or 3/4". The "real world" uses metric ball bearings. Inch sizes are all specials, particularly Imperial outside diameter.
First you get good, then you get fast. Then grouchiness sets in.
(Note: The opinions expressed in this post are my own and are not necessarily those of CNCzone and its management)