User-agent: Googlebot Disallow: /*.pdf$ #pdf file User-Agent: * Disallow: /credit/ #credit directory User-agent: ia_archiver Disallow: / #USA Alexa : alexa.com/ User-agent: Baiduspider Disallow: / #China Baidu : www.baidu.com, www.baidu.jp User-agent: BaiduImagespider Disallow: / #China Baidu : www.baidu.com, www.baidu.jp User-agent: yodaobot Disallow: / #China Yodao : www.yodao.com User-agent: Yeti Disallow: / #Korea Naver : www.naver.com 29/Mar/2007~ User-agent: NaverBot Disallow: / #Korea Naver : www.naver.com ~26/Mar/2007? User-agent: ICC-Crawler Disallow: / #ICC-Crawler User-agent: DotBot Disallow: / #DotBot User-agent: SemrushBot Disallow: / #SemrushBot User-agent: BLEXBot Disallow: / #BLEXBot User-agent: AhrefsBot Disallow: / #AhrefsBot User-agent: GPTBot Disallow: / #ChatGPT