Terms of Endearment (Not the Movie!)

I randomly found myself in a conversation on Facebook today about how to speak respectfully to women. The thread started with a man asking for advice on how to advise his sons, but naturally it digressed from there. The part I became interested in was how to refer to a woman in different situations. Of course, people's feelings on this differ, and depend on how, where and probably even when someone was raised. So first, my personal opinion:

1. I don't like to be called "ma'am" by my peers. To me, "ma'am" should be used in professional situations, with people you don't know well, or when deferring to an authority.

Once, a friend of mine (who is my age) called me "ma'am," and I laughed because I assumed he was making a joke about my being bossy (which I am) and was saying "ma'am" to make fun of me. But then he pointed out that he had been taught to refer to all women and girls as "ma'am," which to me sounds ridiculous. Others in the Facebook conversation said that they teach their children to call people "ma'am" by calling them "ma'am." Thoughts?

2. I don't like to be referred to as "sweetie," "pumpkin," "baby," or any other traditionally feminine term of endearment by anyone I don't know well. Anyone. I. Don't. Know. Well. Men or women, old or young. I realize that many women don't mind being called these things by other women, but I do. It feels diminutive and it just gives me a little shudder.

When I started talking to and then dating my boyfriend, I was really bothered by the amount of times he called me "cutie," "sweetie," etc. I told him so and, while he didn't understand it at all, he tried to respect my feelings and stop using those terms. Eventually, after dating for a while, I began to get more comfortable with him using terms like that, and came to actually enjoy one or two of them. But that's someone that I have an intimate relationship with. There's just about no one else who can call me these things and get away with it. My dad can, sometimes, depending on my mood. My Uncle John, who may be the coolest man I know, has always referred to me, my sisters, my cousin (his daughter) as "my baby" (Like, "Hey, my baby, good to see you!"). Somehow he pulls this off, and he just sounds cool and super sweet, and it's never bothered me. I don't know anyone else that I would feel the same way about.

3. I don't think it's appropriate for a customer, male or female, to refer to a waitress with a term like "sweetie". To me, it comes across as either diminutive, or like you're behaving as if you know this stranger really well. It also just makes me cringe because the server is working. I don't want to be called "sweetie" at work; why should she? I think it's totally appropriate to refer to the server as "ma'am" (though I admit I don't usually do this, I've been trying to think how I usually refer to female servers and I think I tend to avoid it and just say "yes" and "please" without any terms attached).

Anyway, I'm not stating my opinion because I think it's the best one; I'm just trying to start a conversation. I've been told that I'm way too strict on this. I just don't see "cutie" or "sweetie" as terms that mean anything except "little girl" unless they are coming from someone with whom I have a long-term relationship (whether familial or other). But some people, like my boyfriend, say "sweetie" to truly mean "You are a sweet person." So I just want to get your opinions: how do you feel about terms of endearment for women? When are they ok and when are they not? Which ones personally bother you?