User-agent: *
Disallow: *?*
Disallow: *:*
Disallow: /add$
Disallow: /rt$
Disallow: /user/*
User-agent: dotbot
Disallow: /
User-agent: Yandex
Crawl-delay: 1