During the Braddock Expedition, Haytham mentions how Charles "has a way with words – especially when it comes to flattery", so I'm guessing he must have fallen for Charles' charm before at some point.

Please give me Charles talking his way into Haytham's pants – or maybe they're already mid-hookup and Charles realizes how talking during sex is pushing all of Haytham's buttons