OpenAI and Google back a shared robots.txt signal for AI training preferences
The proposal uses the __usage_ai-training token to reduce provider-specific rules, but it remains a voluntary draft and does not block crawling on its own.
The proposal uses the __usage_ai-training token to reduce provider-specific rules, but it remains a voluntary draft and does not block crawling on its own.
We use necessary storage for operation and security. With your permission, we enable audience measurement, personalization and optional advertising features.