About OOZBOT

OOZBOT obeys Robots Exclusion Protocol (robots.txt). If you do not want OOZBOT to crawl your website please add the appropriate Disallow entries in robots.txt file with User-Agent name as "OOZBOT". For more help on adding entries to robots.txt, please look here.

We try our best to conduct polite crawls. However, should you have a problem with our crawler, please send an e-mail to [our-user-agent-name] at setooz.com.

FAQ

What is OOZBOT? Why is it crawling my website?
OOZBOT is a web crawler looking to index non-English web pages on the internet for it's soon-coming search engine http://www.setooz.com . In the process OOZBOT may also crawl English web-pages during the discovery process or web-pages which are linked through non-English web-pages.

How do I stop OOZBOT from crawling my website or a portion of my website?
For example to disallow crawling on portions of website, add the following lines to your robots.txt. Use a '*' for User-agent to block all crawlers including OOZBOT. In order to block all folders of your website except 'robots.txt' add '/' for Disallow .

User-agent: OOZBOT
Disallow: [folder-names]

I added the lines in my robots.txt but OOZBOT seems to be still crawling my website.
Once the changes are made to the file, the crawler would not crawl the website for all further crawls. If a crawl is currently on-going, the crawler has only seen the older version of your robots.txt. Please allow some time for the crawler to re-load your changes.

I am unhappy with your crawler. What do I do?
Immediately contact us at [our-user-agent-name] (at) setooz.com and let us know. Your feedback is very valuable to us.