Because of the positive charge on one P atom and the negative on the other one, a ionic bond will be formed. As the ionic bond is shorter than the covalent bond, the tetrahedron and the octahedron should overlap, but then the electron pairs would repel each other much, so I am not sure about the structure.