Remember, diamonds have a distinct, crystalline structure of carbon atoms. Carbon is a non-metal. Non-metals bind to each other via a crystal structure, or haphazardly. As a result, a strong force applied to it will cause the structure to breakdown, and as a result the item will shatter. (Glass is a good example of an amorphous substance. It doesn't really have any type of crystal structure to it, but will easily shatter if force is applied).
For metals, they are composed of the metal nuclei surrounded in a sea of electrons. Therefore, when you hit the metal hard, you just move the nuclei around but they are still in that 'sea of electrons'. As a result, the metal doesn't break.