Bleach smell is that of chlorine.
Lye won't be neutralized with soap - soap is usually basic on its own.
You would need something acidic for lye neutralization, but in this case it doesn't make sense to look for acid. Hydroxide is relatively easy to wash, just rinsing hands should be enough, although I will do it for a little bit longer, and under running water. However, chlorine smell is much more difficult to get rid off - but it you have rinsed your hands thoroughly there is not much more you can do about it. Don't worry, the smell should disappear in an hour or two.
That's as long as you have used just a household bleach, not some concetrated industrial stuff, and you are not allergic to chlorine.