User-agent: NerdyBot Disallow: / User-agent: * Disallow: /assets/* Disallow: /data/* Disallow: /tours/*