"There are two lone pairs on the oxygen, but wouldn't moving those change the overall charge of the resonance structure?"
If you create a - charge on one atom, you MUST have a + charge on another. If you ever find yourself creating a charge without an opposite one to balance it, go back and work out the formal charges on everything you pushed an atom too or from.