You could replace the soil, and probably take the opportunity to select a soil mixture more appropriate for the tree in question. Like Burner: said, there's likely nothing too bad for plant life, but possibly a trace of some environmental toxins. The pot's probably OK, when you dump the soil, you'll be dealing with a trace of a trace of a trace of an unknown contaminant.