Purity of the product will be quite good. You first, however, have to remove water from the phosphoric acid. Usually, it can be purchased at 85% concentration. It first has to be heated and boiled, until boiling stops and then the salt can be added. This gives good purity HCl. I have done this reaction myself, just to see how it works. I, however, do not need it for real production of HCl, because I can simply buy concentrated hydrochloric acid.
For making pure KBr, phosphoric acid is the ONLY acceptable alternative. With H2SO4 you get too much impurities (Br2 + SO2).