User-agent: * Disallow: /admin Disallow: /admin/* Disallow: /terkep Disallow: /api User-agent: GPTBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: CriteoBot/0.1 Disallow: / User-agent: DotBot Disallow: / User-agent: Gigabot Disallow: / User-agent: MJ12bot Disallow: / User-agent: Copyscape Disallow: / User-agent: Nuclei Disallow: / User-agent: Nmap Scripting Engine Disallow: / User-agent: ZmEu Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: trovitBot Disallow: / User-agent: Google-Extended Disallow: /