Selfishness?

Is it selfish to complain about not being able to do what I want? Here's the thing (or at least how I see it); I often do what others want, even enjoy it at times, and sometimes at the expense of what I want to do. It's only fair to have to make concessions from time to time. However, when my time, my desires, my interests are consistently snuffed out in favor of someone else's... surely there is something wrong with this picture? I keep asking myself, "how often is it that what I want is chosen in favor of what someone else wants?" and maybe it's my skewed perspective of things, but I consistently come up with... nothing. Is it selfish of me to expect others to spend a little bit of their time doing what I want? I just like doing things with other people and it really hurts when it seems like the only way to do that is to give up of my time and efforts. It hurts because the way it appears to me, the subtle message that I interpret from these experiences is that other people's time is always too important for me but my time is never important enough to where I can't participate in whatever activity is proposed. I don't mean to hurt anyone's feelings with my complaining. I just have to get this out there and get it off my chest.