Yes, the atom formed does take on the positive charge initially, but the beta particle it gives off doesn't remain free indefinitely. As it hits things, the beta particle knocks off valence electrons hence why it is considered "ionizing" radiation. After some time, it will slow down enough that a positively charged atom will pick up the electron and after a short while all the charges balance out and the newly formed isotope will wind up as a neutral atom.