CaO will not dissolve in any organic solvent that does not react with it. Calcium oxide, does, however, dissolve in pure ethanol (or methanol) to form calcium ethoxide, Ca(OC2H5)2 in solution. Acetone also reacts with CaO, undergoing an aldol condensation to form
CH3-CO-CH2-C(CH3)2(OH).
These types of solutions are extremely corrosive and hazardous. Be sure to wear splash proof goggles, long rubber gloves, a rubber apron, and have some vinegar ready in the event of an accident.
There are not any convenient solvents that can be used to dissolve CaO.
The short answer is that neither benzene, toluene, or any other plain hydrocarbon will dissolve CaO.