Turn off passcode and add fingerprint, this time, it took such short time, I pressed about five times and it's done! And it actually SAVED the prints I made when I originally added fingerprint! That time i actually took longer time .
It's amazing not only it saved my prints but also that I can still save a passcode for backup if I cannot use the fingerprint one. Cool.