# robots.txt - 橙子新闻 / Orange News # AI crawlers and search engines are explicitly welcome; content is attribution-first and links back to sources. # LLMs: https://new.nat6.net/llms.txt # LLMs full: https://new.nat6.net/llms-full.txt # Agent manifest: https://new.nat6.net/.well-known/agents.json # OpenAPI: https://new.nat6.net/api/v1/openapi.json # Markdown negotiation: send 'Accept: text/markdown' on article URLs to get text/markdown # RSS: https://new.nat6.net/feed.xml (categories https://new.nat6.net/feed/category/{slug}.xml; JSON Feed https://new.nat6.net/feed.json) # Feed index: https://new.nat6.net/feed/ # Baidu flat sitemap (zh only, no sitemapindex/xhtml:link; submit to Baidu, not Google): https://new.nat6.net/sitemap-baidu.xml # --- AI crawlers: fully allowed (no training restriction) --- User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: CCBot User-agent: Applebot-Extended User-agent: Bytespider User-agent: Amazonbot User-agent: meta-externalagent User-agent: Bingbot User-agent: Googlebot Allow: / # --- Search engines: Baidu / Google News & Image / Bing / Yandex / DuckDuckGo / Sogou / 360 / Yisou --- User-agent: Baiduspider User-agent: Baiduspider-render User-agent: Baiduspider-image User-agent: Baiduspider-video User-agent: Baiduspider-mobile User-agent: Googlebot-News User-agent: Googlebot-Image User-agent: YandexBot User-agent: DuckDuckBot User-agent: Sogou web spider User-agent: 360Spider User-agent: YisouSpider Allow: / # --- everyone else: fully allowed (no cloaking, same HTML for bots and humans) --- User-agent: * Allow: / Sitemap: https://new.nat6.net/sitemap.xml Sitemap: https://new.nat6.net/sitemap-news.xml