Most organic molecules are polar by definition - they have a dipole moment (ethers included).
In the context of solvents, polar refers to solvents with higher polarity, and non-polar to solvents with lower polarity. It's relative. Diethyl ether is at the lower end of the polarity scale and so is generally considered a "non-polar" solvent - though what we really mean is a low polarity solvent.
This sliding scale situation comes up a lot in chemistry. Another example is when someone asks, "is methanol acidic?". To which the answer can only be, "compared to what?". It's all relative.