Nathan, that's a conclusion some owners here have reached, but the usual wisdom is for folks interested in these cars to thoroughly research what they think they want before diving in.
In order to help with that process, a number of SOC members have posted their specific comments about what they like and don't like about their rides, and the site has a section on it you can use to see what the companies which make them say about themselves.
That section, Michael, is here:
https://www.speedsterowners.com/makers/
It's a tab on the folio line at the top of the page. I'd strongly encourage you to have a look at it and then focus specifically on what you might like in a Speedster, Coupe or Roadster version of these neat little cars.
There's generally something available for every budget. Some are more expensive than others, some are less refined and most leak when it rains. You being in Southern California have the advantage of being close (right up and right down the 5) to a couple manufacturers.
We also generally encourage prospective owners to go and have a look at the facilities where the cars are made and to talk to the people who produce them -- and we almost universally let those folks hop in and ride our cars for a bit to see what the "SEG" factor is.
Most of the makers' websites are linked from the page above. Some of them have gone out of business for one reason or another, but the majority are there.
For example, Classic Motor Carriages is the company which supplied the kit my car was originally built from; they're long defunct and the company is back now as Street Beasts. I don't know that I'll ever speak highly of my car in its original form, but there are many here whose CMC or SB cars have done them right as rain. Others like their cars with water-cooled engines instead of VW or Porsche. Still others go completely their own way, using just the shape as a constant.
They're all cool. Whatever you do, don't just nab the first one that comes your way! Ask lots of questions, and be sure to look critically at your wants and needs first.
Even the search is fun! Let us know if you have specific questions. That's what we're all here for.