Why is there so much pressure...?

...to wait to have a baby? I'm 24 and married and we have a good income and stable home. So why does everyone I know tell me that I should wait to have kids? We want to start ttc, but everyone insists that I wait and "enjoy my life right now and have fun". Well, I've had all the partying type fun when I was 18-20 and I'm tired of that. I feel completely ready to settle down in life (part of the reason why I got married). Also, people say "Don't you want to travel?" Well, honestly, at this young age we don't have the income to be abel to travel and vacation the way we want. I know many women are having children in their 30s and 40s these days, but there are also a lot more women requiring IVF and AI, so what's the big deal if I don't want to wait until I'm 30!?! The way I see it is if I have my kids now, I'll hae more energy and then by the time I'm 50 they'll all be independently living their own lives and my husband and I will finally have the money saved to travel and do the fun things we want. Am I as crazy as people say I am or do you also think its no big deal whether I wait or not??