Um. There was a whole thing about the Fidelius Charm in one of the Phineas Phelps books, and they couldn't do it at all because it takes a really powerful master of Charms to cast it.

It's just a book, though, so I guess they could have made that up to make the story more suspenseful.