My dear you owe nobody any obligation by trying to explain yourself. If I were you just keep doing what you like doing best. Whatever you say tongues will always wag, and the populace are always looking for juicy stories to yap about.
Please do concentrate on bringing up your son . Shield him from all those mediocres who will stop at nothing to bring others down to there own level of degradation
God bless you for that brave write up