This could be explained by presence of protic material in you reaction solution, such as water, also oxygen or carbon dioxide would consume BuLi.
n-BuLi does not react with n-BuBr, att least not att any significant speed.
Its nice that you got it working!