Shinji never knew before Kaworu what it felt like to have someone see through the veil of what he was on the surface and say, "in spite of everything, you are a beautiful person."
I believe anybody in that headspace would fall for anyone, regardless of gender, in that moment.