In addition, the very low melting point of cesium really prevents it from forming a powder. The cesium itself actually liquifies before it even gets down to the bottom. If your container is shallow enough, it will cause an explosion towards the top half of the reaction vessel as the cesium spreads out its surface area and reacts with the water at the surface. If your vessel is too deep, however, you'll just wind up making a VERY caustic solution and wasting a lot of cesium.
This is true for virtually all of the alkali metals. If you take some sodium and put it in a testtube, then immerse this testtube completely underwater, trapping the Na at the bottom of a large column of water, it will sit there and fizz giving off H2 gas but it won't explode. I've taken over an ounce of sodium, trapped it under paper towels and taped it to a rock then threw it in a lake. You saw a few bubbles of H2 gas coming to the surface, but no explosion.