User-agent: * Disallow: # Gemini AI training User-agent: Google-Extended Disallow: / # AI Data Provider # https://knownagents.com/agents/youbot User-agent: YouBot Disallow: / # AI Assistant # https://knownagents.com/agents/tongyibot User-agent: TongyiBot Disallow: / # AI Data Provider # https://knownagents.com/agents/apifybot User-agent: ApifyBot Disallow: / # AI Data Provider # https://knownagents.com/agents/terra-cotta User-agent: Terra Cotta Disallow: / # AI Assistant # https://knownagents.com/agents/yiyanbot User-agent: YiyanBot Disallow: / # AI Coding Agent # https://knownagents.com/agents/trae User-agent: Trae Disallow: / # AI Assistant # https://knownagents.com/agents/shap-user User-agent: Shap-User Disallow: / # AI Data Scraper # https://knownagents.com/agents/lcc User-agent: LCC Disallow: / # AI Assistant # https://knownagents.com/agents/amzn-user User-agent: Amzn-User Disallow: / # Uncategorized # https://knownagents.com/agents/vecteurplus User-agent: vecteurplus Disallow: / # Block common AI bots and malicious bots User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: ByteSpider Disallow: / User-agent: CommonCrawl Disallow: / User-agent: Mb2345Browser Disallow: / User-agent: LieBaoFast Disallow: / User-agent: MicroMessenger Disallow: /