Electric fields and magnetic fields are somewhat similar. If you take two magnets and try and push opposite poles together, they repel each other, a force strong enough for you to feel even with regular fridge magnets. Now take those magnets and try to stick them on wood...nothing will happen. Just as magnets only interact with other magnetic materials, so too do electric fields only "interact" with other charged particles.
So no, your rock would not bounce back off like there were an invisible force field. If you were to throw charged particles at the field, then their trajectory would be changed.