The MTLookupBot

MTLookup does not fetch the content of Movable Type related resource websites with the help of a bot that is spidering the entire internet day and night. Only a handfull of websites are spidered once in a while.

Nevertheless, MTLookup will regard the usual robots.txt. If you want to give a specific rule, use "mtlookupbot" as the bot's name.

The MTLookupBot will not put high load on your server. There will be a reasonable amount of time between two successive hits. Furthermore, an article will not be spidered on a daily basis.

mgs | September 11th 2005