That is quite literally not how attraction works.
As someone already mentioned, the more you get to know a person, the more attractive (or less attractive) they objectively become to you. I firmly believed that my wife was beautiful, and as our relationship soured and she started cheating on me, she quite literally became physically uglier in my eyes.
It's just how the brain works. If you love someone, they're beautiful. End of story.