Homocoupling is a possibility. The catalytic cycle for Suzuki-Miyaura coupling is usually via Pd(0) - Pd (II) cycle and you start out with a Pd(II) complex, so it has to form the Pd(0) complex somehow. But you usually use a small amount of catalyst, so it shouldn't effect the yield that much.
The reaction that you're describing is a Buchwald-Hartwig amination. I don't know much about it practically, and about their rates, just knows that it works. Perhaps you need to protect the amine somehow? Also, how come you're running the reaction in ethanol? Won't you just re-esterify your ester?
Have you tried separating the two dots and running a 1H NMR to see which is the byproduct?