Ask your self this:
Are you happy studying Chemistry?
Is it something you want to and more importantly enjoy doing?
Can you see yourself doing it for your working life?
If you do, everthing else is incedental.
As someone who is definitely not a brainiac I barely scraped through my biochem degree and got int analytical chemistry almost by accident. However I am in a field I enjoy and have entheusiasm for. This has served me much better in my chosen career than anything else.
This "bigger school" thing is largely irrelevant once you start a working career (in academia it may be different). If you get a job and prove your worth, in 6 months nobody will care where you went to school.