If you need to exactly 25.00000 (however accurate your pipette is), then yes, recalibrate it.
There are, however other issues with pipettes and organic solvents not properly taught, and if you were using it properly it would be more accurate.
Pipettes work off of vacuums and vapor pressures. You pull a vacuum with the bulb. The problem is, with many organic solvents, once you have the liquid in the pipette it starts to evaporate relatively fast (as compared to water). Increasing the pressure in the pipette and "pushing" more out. So you should pipette up and down 5-10x (depending on solvent vapor pressure) and try and saturate the pipette with gas form of the solvent, and then fill the pipette up to mark.