My wife and I lived in Florida for 18 years and have relocated to RVA. We moved to a relatively small town in Florida which exploded in population to the point that traffic, especially January though April was insanity inducing. People who moved to FL do have an annoying habit of telling you/themselves that is paradise. (Far more than the people who are from there)

On the flipside, after a couple of years your blood will thin (metaphorically) and the heat from May-October will become more bearable.

So far, my wife and I love RVA. If you miss it, and it is feasible to move back, do so. Life is too short to stay someplace where you are miserable. When we lived in Florida, we had many neighbors in your situation move back because they hated it.