The Internet Explorer Team Blog includes a post covering this very subject. Due to many people asking the very question "can I trust IE's Phishing Filter not to infringe my privacy" they commissioned a third party privacy auditing specialist to assess the design and operation of the filter. Click here to read more.