I recently came across a very nice troubleshooting methodology when I was trying to debug some authentication issues that were occurring during a SharePoint 2010 crawl. I was getting some errors and also having difficulty getting the information I needed out of the crawl log to some other issues that were occurring. Strangely enough, enter Fiddler to the rescue (www.fiddler2.com).
I’m sure most everyone is familiar with Fiddler so I won’t bother explaining it here. The trick though was to get it to capture what was happening during the crawl. I found a very slick way to do this is to configure Fiddler as a reverse proxy for the crawl account. The instructions for configuring Fiddler as a reverse proxy can be found here: http://www.fiddler2.com/Fiddler/help/reverseproxy.asp. The way I used it was as follows:
I had isolated my trouble sites into a separate content source. So once I followed these steps I was able to see each request from the crawler to that content source, how it was authenticating, and what was happening. Overall it proved very useful in understanding much more clearly what was going on during the crawl of those sites.
Very few people realize how useful a proxy server can be. For example, you can also ask it to get involved in SOAP conversations too if necessary. WAY easier to read than a network trace.
I found your tip really useful and I'm trying to use it but I can't understand how you manage to make it working if you don't change the port of the website you want to crawl in the content source?
This article might help to troubleshoot your issue..
if it helps, Please dont forget to mark it as an answer. Thank you.
MU has welcomed the news could not be happier M88:
captain Wayne Rooney injury has recovered and will attend the match against Manchester City on Sunday. Etihad pitch certainly be concerned by the arrival of England striker here always brings a nightmare for the home side.
FOOTBALL QUICK UPDATE BEST 24H, 15 MINUTES AFTER THE GAME HAS ENDED MAY M88 VIDEO CLIP FOOTBALL AND SPORTS
Rooney: The King of derby
Rooney has scored 11 goals in 22 games for Manchester derby and that's why coach Louis van Gaal are anxiously awaiting return of Reds skipper.
If the fulcrum of England's champions, the fulcrum Etihad mecca of Manchester in Manchester City's encounter was "Shrek guy". Three Lions striker has 7 goals in the game, the team and the city M88.
http://www.asicsforsale.co.uk/asics-gel-kayano-17-c-14.html">asics gel kayano 17 mens online you can
http://www.asicsforsale.co.uk/asics-onitsuka-tiger-mexico-66-black-leather-trainers-p-187.html">onitsuka tiger mexico 66 black leather trainersand from uk
http://www.asicsforsale.co.uk/asics-onitsuka-tiger-mexico-66-yellow-black-leather-trainers-p-181.html">onitsuka tiger mexico 66 kill billand you
http://www.asicsforsale.co.uk/asics-onitsuka-tiger-mexico-66-white-leather-trainers-p-186.html">onitsuka tiger white shoes from authentic retail
http://www.asicsforsale.co.uk/asics-onitsuka-tiger-mexico-66-yellow-black-leather-trainers-p-181.html">kill bill yellow shoesand
http://www.asicsforsale.co.uk/asics-onitsuka-tiger-mexico-66-yellow-black-leather-trainers-p-181.html">kill bill tiger shoesand online
http://www.asicsforsale.co.uk/ronnie-fieg-x-asics-gel-lyte-v-volcano-p-152.html">ronnie fieg asics for salewe would like to tell you a good news!http://www.asicsforsale.co.uk">onitsuka tiger online