I figured as much with James' involvement, not sure about the Colonial laws, but if Charles claims the child does he actually have full rights even though he and Connor aren't married?

The social attack will probably quell any arguments that Connor's good reputation and prevent George from claiming the child as his. Wow, evil.