User-agent: Googlebot Disallow: /*go.php* Disallow: /*download?* Disallow: /*.html*?* Disallow: /?s=* Allow: *.html User-agent: Yandex Disallow: /*go.php* Disallow: /*download?* Disallow: /*.html*?* Disallow: /?s=* Allow: *.html User-agent: * Disallow: /*go.php* Disallow: /*download?* Disallow: /*.html*?* Disallow: /?s=* Allow: *.html