That is what I meant. If adjusted the pH with phosphoric acid, then the molarity will change, of course the volume will also increase. pH can only adjusted with an different acid like HCl . To increase pH NaOH can be used, what has no effect of the phosphate beside also volume effect.
Example
Lets have a 0,1 M buffer half dihydrogenphosphate and half phosphoric acid. Means both chemicals are 0,05 M
According HH equation is pH = pKa = 2,1 ( first pka)
Volumen should be 100 ml
If add now again 100 ml 0,05 m H3PO4 again the volume increase to 200 ml, the concentration of salt is half because dilution. The concentration of acid is the same, because same concentration is added.
In HH equation pH = pka + log( c salt/c acid)
pH = 2,1 + log (0,5 * csalt/ c acid)
pH drops to 1,79
Molarity changed to 0,075 M