If you're worried how it may have affected your fertility, I'd go back in and talk to your doctor. I also don't have any experience in trying to conceive, but I do know that sometimes it can take varying amounts of time to get pregnant even if you got pregnant fairly easily before. If you think it's a side effect of your birth control, I would go to the doctor like mentioned before. But for the most part, fertility issues aren't really looked into until you've been actively trying for about a year, if I remember correctly.

You're still young, and "able to conceive immediately after removal" is not the same as "will conceive immediately after removal." If you're having normal periods, I'd just keep trying.