Pure water has a very high specific resistance (the really pure one is 18 MΩ/cm). So the question is not about whether it is possible (because technically it is obvious it is) but whether it is feasible - if you want to be efficient you want as low ohmic drops as possible, as all they do is they increase amount of energy required for electrolysis.