Search Guys

Everything search, including product commentary and guidance, search strategies and general technical guidance

How to throttle a BCS crawl

How to throttle a BCS crawl

  • Comments 1
  • Likes

Throttling a BCS crawl is done the same way as other SharePoint crawls, using crawler impact rules.

The main trick is figure out what site name to use.  The most precise way is to use a combination of the LobSystem name and the LobSystemInstance name.  In my case it was "recipeslob_recipesinst" :

image

 

An alternative is to use the LobSystem name with a wildcard (e.g. recipeslob_*).

Now we can set our rule (click on “Crawler Impact Rules” in the Crawling group of the Search Service Application management in Central Admin:

image

From there click “Add Rule” and fill it in:

image

 

To see that it is working, watch the Search Gatherer - SharePointServerSearch / Threads Accessing Network prefmon counter.  In this screen shot you can see during the crawl only one thread accessing the network.  Also observer that the requests in my console output are going in a nice neat linear order:

image

Now I’ll change the rule to 4 and run again:

image

 

Notice that now there are four threads accessing the network and that the requests are coming in bunches.

Comments
  • Yes, great tip !

Your comment has been posted.   Close
Thank you, your comment requires moderation so it may take a while to appear.   Close
Leave a Comment