The problem isn't the Doctor's romantic entanglements, the problem is Rose Tyler.

Explaining more threatens spoilers, so I shall avoid discussing. Except to say that you can't discount the same sort of disquiet about both McGann and Eccleston, in some ways more than that of Tennant.