Solubility typically increases as temperature increases. However water is a bizarre substance and its properties change in complex fashion as a function of temperature. Some substances get less soluble in high temperature water because the polarity of water actually changes as temperature changes.
Strange solubility patterns are often manifested in ionic salts in aqueous solution. Sodium chloride, for example, shows only a very small temperature dependence of its solubility, and as you've pointed out, sulfates usually display complex patterns - solubility of sodium sulfate raises steeply over low temperatures, reaches a maximum at around 32 or so degrees, and then displays weak retrograde dependence thereafter. From what I understand, it seems to have something to do with the associated hydrate portion of the crystals, which turn into a biphasic mixture at a specific temperature due to melting. (Sodium sulfate is a decahydrate complex, with 10 water molecules cocrystalized with each single sodium sulfate unit - I'm assuming your magnesium sulfate is something similar.)
Anyway, that's the best answer I could come up with after 10 minutes of research. The simple explanation is I guess that sulfates are complex hydrated salts, so complex relationships between temperature and solubility might be expected.