I think it may seem like Torx has more sizes than say Phillips or flat-headed screws due to the fact that with those you can generally get away with a screw driver that is "close enough" in size, whereas with Torx you really need the exact size the screw is using.
If you want to strip your screws, you can do that. And then there's the Pozi vs Philips thing that people tend to get wrong. Torx is kind of a pain in the ass because you always try the wrong screwdriver first, but it's still way better than philips/pozidriv
It's because philips drivers are wedge-shaped. They properly fit a range of screw heads. This means that there's only two or three commonly used driver sizes. With torx the sides are parallel so the driver size is directly related to the screw head size.
