Have you folks who are not from CA actually talked with many folks who are leaving CA or are you just projecting your points of view onto them? Sounds to me like the latter.
I actually do live in CA and have talked to quite a few folks who are moving out of the Bay area, First, many aren't even moving out of state, just to lower cost of living areas like Sacramento. So the notion that people are fleeing the politics is generally off base.
Second, most of the people I know who are moving out of the area doing so primarily to cash in on high real estate values. In my zip code, the average home value is $1.5MM (1,500 sf 3/2 on a 6K sf lot) and folks are able to take those dollars to lower cost of living areas, buy ~2x the house for 1/3-1/2 the price, and have money left over to fund retirement. Conversely, I know a number of people who are leaving the area because they are simply priced out of the real estate market and want to own a home. I am sure there are things they will not miss about CA (they talk about taxes and traffic), but on the flip side there are many things they say they will miss (great weather, cultural and outdoor opportunities).
Third, there are lots of people in CA who are not originally from CA but who located here for for work. When they retire it is somewhat natural for them to leave as their connection to the local area was largely professional. A few of the folks I know are just going back to the places they came here from or where their extended family is located. A subset off those people are doing so due to COVID and employer WFH policies, as they have been given the latitude to keep their job (and in some cases the Bay Area salary) while living elsewhere. This again is more cost of living-related, not so much tied to the political climate.
I do have one friend who left the state due to politics, taxes, etc. but he moved to Reno, NV, which ironically is about as close to CA as you can be without still living here.
If you aren't the type of person who wakes up in the morning and the first thing you feel is liberal oppression, there is still a lot to like about CA.