Yeah, only formally charged ligands, like hydride, halides, alkyls, hydroxide, alkoxy etc will increase the ox state of the metal.
Uncharged ligands, like phospenes, carbonyl, alkenes etc. do not increase the ox state of the metal.
eg.
Cr(CO)6 is a Cr(0) species.
Pt(NH3)2(Cl)2 is a Pt(II) species