As others have said, nostril piercings can take a LONG time to heal. You should not be changing the jewelry before 5 months. I did change my jewelry too soon and got an oozy bump because of it that set my healing back even further. I'm not sure exactly when you changed it or how many times, but I can definitely see that irritating it.
Baby it, try not to touch it or get it caught on your clothes. If you have high quality, appropriate for your anatomy, jewelry in there right now I would NOT attempt to change it for several months. If you need some better jewelry have a piercer put it in and and then don't change it for months.
They do take long to heal but once my nostril piercing was healed I had no further trouble with it, so there is light at the end of the tunnel.