I guess I hadn't thought of it that much, but I looked it up. Phosphoric acid has a pKa of 2.12 (first proton) which makes it stronger than acetic acid (pKa = 4.76), formic acid (pKa = 3.77), and carbonic acid (pKa = 3.6, first proton). It's acidity is about the same as o-nitrobenzoic acid (pKa =2.17). I suppose that would put it in the range of "weak" acids, but it's a pretty strong weak acid.
It's all relative though, right? Certainly phosphoric acid is much less acidic than triflic acid, but it's apparantly strong enough to be useful in elimination reactions. I think it is especially useful for this purpose because it is high boiling and the conjugate base in not very nucleophilic, thereby minimizing S
N1 type products you would expect from acids like HCl.