Unfortunately, the n-butyl anion is also a good nucleophile. If there are available leaving groups, you will get substitution reactions.
Deprotonated amines are not particularly good nucleophiles and don't typically have this problem.
If you really need a base stronger than metal amides, you can use phenyllithium or in the worst case, t-butyllithium, but t-butyllithium is almost too reactive to handle.