The first Harry that Louis met was at his third school in as many years, and had shoved Louis’ head into the toilet when he walked into the mens restroom. Some slurs had been used, but the whole incident was kind of blurry thanks to the concussion he got when his head hit the tile floor.
The second Harry was a TSA agent when Louis was sixteen, returning from a trip abroad. The agent had smirked at Louis passport. “Layla, huh? Should think about dressing a little more feminine, no guy is gonna want you looking like that.”
Louis doesn’t want to see if “third time’s the charm” applies here. He’s finally secure in his life and happy, and he doesn’t want the heartbreak if his soulmate is just another bigot that wanted Layla and not Louis. Sue him for avoiding the pain.