And how do you define concentration of the solid, so that you know it changes? Concentrations is a property of the homogeneous mixture, mixture of solid and liquid is not homogeneous.
Reaction takes place only on the solid surface, it is enough that the surface exist for the solid to be part of the equilibrium. Sure, the higher the surface the faster the reaction is, but for equilibrium both forward and reverse reactions are important - and both speeds are dependent on the surface in exactly the same way, so it cancels out.