Voldemort dared to say such a thing precisely because he firmly believed that Elwin could never guess where he was hiding.
If you followed that line of reasoning, only two possibilities remained.
First, the place where Voldemort was hiding was somewhere Elwin had already searched.
Chapter 521