I think the implication is that Van Bork is so knowledgeable that he can guess just which minister's country house is meant, and he has also been a guest at that house.