Point.

I was speaking legally, though. Legally they're not. So different rules apply. In fact it's completely illegal for you to cast Imperius on Hermione because she belongs to someone else and it would be incredibly dangerous if they just said she was fair game for whomever because someone could Imperius her to harm Harry. Or the Lord Protector, for that matter, since Hermione goes to Buckingham sometimes.