Maybe I'm misunderstanding, but buffers are meant to keep pH from moving around easily. Phosphates are great buffers because they have three spots per phosphate molecule to utilize in controlling the pH. If you want a phosphate buffer at 2 pH, I would make up the phosphate buffer and use phosphoric acid to lower the pH to what is needed. Phosphoric acid won't add anything new to the buffer, since the phosphoric acid will dissociate into phosphate ions. Likewise, you can use potassium hydroxide to basify if needed, since that won't add anything new into the buffer.
EDIT: My apologies, I misread above. I didn't really add anything to the discussion.