I do not actually know, but can offer my opinion:
Phosphates are actually fairly difficult to reduce. One relevant parallel exists with sulfuric and selenic acids. Selenous acid H2SeO3 is a much stronger reducing agent than sulfurous acid H2SO3, while contrastingly concentrated selenic acid H2SeO4 is a much stronger oxidizer than concentrated sulfuric acid H2SO4. Thus the selenium oxyacids can be seen to be more reactive (both as oxidizing
and reducing agents) than the oxyacids of sulfur. This is due to the larger atomic radius.
In the same way, arsenites are stronger reducing agents than phosphites, while arsenates can act as mildly reactive oxidizers, whereas phosphate is usually inert in most reactions. I highly doubt that any phospite is formed by reaction of zinc in excess phosphoric acid, and neither would sulfur dioxide be formed by dilute sulfuric acid on zinc.
As a side note:
I also know that even dilute perchloric acid is
not reduced by zinc metal, the reaction only generates hydrogen gas, but if a nitrate salt is present, the nitrate ion will get reduced, somewhat unexpectedly showing that perchlorate ions are often not reactive.
Perhaps my posted topic about "Preparation of Hydroxylamine" has inspired this topic?