Not at all silly, very true. We are a looks-conscious society.
I had always been thin - I've gained some, but not a lot of weight. (I'm probably at the upper "normal" range.) I would be more comfortable with myself being a little lighter, but it's not a big deal. I try to stay healthy, eating mostly right (not giving up my Haagen Dazs), exercising, etc.
Perhaps many people would find this hard to believe, but I always hated the comments I got when I was thin - it seemed okay for people - even complete strangers! - to tell me that I needed to gain weight, or eat more, etc., and I never noticed people being that direct to people who are overweight. (Back then, I really wanted to gain weight, and just couldn't - don't hate me!) Actually, even though I am no longer thin, with something like 2/3 of Americans being overweight, by comparison I'm thin, and sometimes people will refer to me as "skinny" - even though my doctors have told me to watch my weight! Kinda funny.....
None of us wants to be "inspected". I'm sorry you are getting so many comments - it's never pleasant, even when people don't think they are being rude.
Anyway, I'm just happy to be here, doing my best. As I get older I'm better able to put things in perspective, keep my priorities straight. I lost my sister (my best friend) and other friends/relatives too early to cancer, diabetes, heart disease, kidney failure, and I'm sure all of them would be happy to have had more time - overweight or not.
You sound pretty confident yourself!