I have received a few comments on the 'hows' behind the Microsoft Office SharePoint Server 2007 magic on crawling and indexing of content. Now contrary to popular belief the technology is not entirely based on voodoo but some rather clever technology - want to know what exactly then check out this rather handy little Christmas guide on how MOSS 07 carries out crawling, indexing and more:
http://technet2.microsoft.com/Office/en-us/library/87065c9d-d39d-479d-909b-02160ec6d7791033.mspx
Enjoy!