was very well known that no affection was ever supposed to exist between the children of any man by different marriages