It's like Connor had been his whole world ;_;

Charles has never been the most stable of individuals, imo. He takes momentary leave of his senses from time to time. Also, he had no way of knowing that Kanen wouldn't have come after him as well. The guy killed his former best friend after all, so would have had cause to worry about the rest of his family...