Well, I think you're well off. Of course, it's all relative. I imagine there are a number of folks who read my journal and consider me well off so no worries. You are what you are, I always say.
Regardless, $84k in one year? I think that's a damn fine number and you should be proud of it. I know I'll never hit anything close to that.
So your home is paid off? I assume so because you mentioned having to pay property taxes while previously mentioning not having a house payment / mortgage.
If that's the case (you own your home outright, you just bought a new car, your husband supports your decision - whatever it might be) and you want to stop working, I'm guessing it's entirely feasible, financially.
Whether it's something you want to do or not is, of course, entirely up to you. My wife occasionally brings up the idea of her not working and I wonder if the kids might indeed, "drive her crazy."
At a get together recently, one of her good friends who quit working right after her first was born around ten years ago is now itching to get back to work, but I imagine she'll find it very tough to do so after 10 years of being a mom. Her kids appear no more well-adjusted than ours, either.
Please don't take the above comment as a criticism (AT ALL) of those heroic mothers who wish to be full time parents (I salute their bravery, believe me) - just the reality of our economic times.
Yours does not seem to be any sort of a "broken home" and I imagine neither of you are "absentee parents" so if you can find caregivers you're happy with, and you enjoy working and suchlike, there's nothing wrong with playing the (miniscule) odds.
We cannot live our lives around what-ifs and studies of pop psychologists who want to sell books (ala Oliver James).
Besides, it's all in the genes.