I agree with most of the above comments.
Times change and supply and demand economics reign supreme. Years ago, it definitely wasn't a rich man's game to collect a full mint loose run, a string of mint MOCs and all the boxed ships, vehicles and playsets your heart desired. Don't believe me? Look at the sticker prices on the vintage toys, especially at the end of the run in 1985 when shops couldn't even give them away. For the next few years prices remained pretty low, but then started slowly creeping upwards, and by the early 1990's vintage stuff had certainly started to acquire a value. The prices were still minuscule compared to today's eye-waterers, but it's fair to say that the genuinely rarer items had started to set you back enough that you'd notice it. The common and less common (by today's standards) stuff was still very easy to find, and the truly rare items (by today's standards) could usually still be attained with a little patience. And you didn't need to be a rich man to do it. But that was then...
A generalisation follows that's true for a great many current collectors:
The generation that owned the toys as children have grown up, got jobs, want to recapture their childhoods again through the toys they used to own (your dad's generation had Hornby, Dinky and Corgi, we have Star Wars) and now have some disposable income to spend on buying it. Star Wars being Star Wars, plenty of other collectors who weren't even born when the vintage toys came out join in the fun and also start collecting. Together, they combine to make for an awful lot of people chasing an ever diminishing supply of toys, driving up prices. Year on year more people join the hobby, and most of them want the same things, pushing prices up even further.
Is Star Wars only for the rich today? It depends on what and how you collect. If you still want to collect a full mint loose run, a string of mint MOCs and all the boxed ships, vehicles and playsets your heart desires, but haven't started buying any of them yet, then yes, I would certainly say it's a rich man's hobby. If however, you are happy to set your sights a little lower, play the patient long game, and refuse to pay more than you can afford, there's still a huge amount of enjoyment to be had in this hobby, and you don't have to be a rich man to do it.
Despite what some people apparently think, you don't have to have it all to enjoy it, and there's still plenty of things to collect that don't require you to be a rich man