You can replace any of the atoms surrounding the phosphorus with others, especially carbon or sulphur.
Any changes you make will affect the geometry of DNA.
You can even replace the phosphorus atom with aesenci according to a recent publication, but the exact effects on DNA I do not know.