The state of firewalls turning AI agents away
6 of 113 audited stores refused every AI agent we sent at the firewall.
A store can allow every AI agent in robots.txt and still be invisible, because bot protection decides separately. This is the gap merchants find hardest to believe and the one that costs the most: the rules say yes and the network says no.
113 stores audited, last refreshed October 2026.
Check your own store on this and 15 other checks. Free, about 30 seconds.
What we found
6 of 113 audited stores refused every AI agent we sent at the firewall.
7 more answered some AI agents and refused others.
Indian home and kitchen stores fail this most often: 3 of 21, or 14%.
Indian food and beverage stores are the exception: none of the 19 we audited fail it.
16% of Custom or headless stores fail this against 0% of Shopify stores.
By platform
Stores grouped by the platform we detected.
| Group | Audited | Fail | Partly | Fail rate |
|---|---|---|---|---|
| Shopify | 73 | 0 | 0 | 0% |
| Custom or headless | 37 | 6 | 7 | 16% |
| Adobe Commerce (Magento) | 3 | 0 | 0 | 0% |
By benchmark
Each list links to its full ranking.
| Group | Audited | Fail | Partly | Fail rate |
|---|---|---|---|---|
| Indian beauty and personal care | 27 | 2 | 0 | 7% |
| Indian fashion | 25 | 0 | 4 | 0% |
| Indian electronics and gadgets | 21 | 1 | 2 | 5% |
| Indian home and kitchen | 21 | 3 | 1 | 14% |
| Indian food and beverage | 19 | 0 | 0 | 0% |
Worst on this check: Indian home and kitchen (3 of 21). Best: Indian food and beverage (0 of 19).
Which stores fail it
All 6 are on a published benchmark list. Each links to its full report and the exact fix.
forestessentialsindia.comCustom or headless · Indian beauty and personal care
gizmore.co.inCustom or headless · Indian electronics and gadgets
homecentre.inCustom or headless · Indian home and kitchen
nestasia.inCustom or headless · Indian home and kitchen
nykaa.comCustom or headless · Indian beauty and personal care
wakefit.coCustom or headless · Indian home and kitchen
Why it matters, and how to fix it
Why AI agents care
Bot protection (Cloudflare, Akamai, DataDome and others) often turns AI agents away even when robots.txt allows them. Then no AI can read your prices or stock. Real agents come from their companies' own IP addresses, so treat this as a strong signal, not proof.
The fix
- Any platform: In your CDN or firewall, allow verified AI agents: OAI-SearchBot, ChatGPT-User, PerplexityBot, Perplexity-User and Claude-User. On Cloudflare, check Security > Bots and AI Crawl Control.
- Shopify: Shopify's own storefront allows these agents. If Cloudflare or another proxy sits in front of your Shopify store, allow verified AI bots there.
Questions
- How many online stores block AI agents at the firewall?
- 6 of 113 audited stores refused every AI agent we sent at the firewall. A further 7 answered some AI agents and refused others.
- Why does this matter for AI shopping agents?
- Bot protection (Cloudflare, Akamai, DataDome and others) often turns AI agents away even when robots.txt allows them. Then no AI can read your prices or stock. Real agents come from their companies' own IP addresses, so treat this as a strong signal, not proof.
- How do I fix firewalls blocking AI agents on my store?
- In your CDN or firewall, allow verified AI agents: OAI-SearchBot, ChatGPT-User, PerplexityBot, Perplexity-User and Claude-User. On Cloudflare, check Security > Bots and AI Crawl Control.
- How do I fix it on Shopify?
- Shopify's own storefront allows these agents. If Cloudflare or another proxy sits in front of your Shopify store, allow verified AI bots there.
- How was this measured?
- 113 well-known stores were audited from our servers with the same check every AgentReady audit runs, most recently on October 11, 2026. 113 of them returned a result for this check.
The monthly AI shopping benchmark
New rankings and what changed, once a month. No other emails.
How we measured
- Every store on our public benchmark lists got the same audit as AgentReady's free check. This page counts one of its 16 checks across all of them.
- 113 of 113 stores returned a result for this check.
- Audits ran from our servers in Singapore. Real AI agents visit from their companies' own networks, so firewall results are a strong signal, not proof.
- Lists are chosen by hand and refreshed monthly. Last run October 11, 2026.
- Run one of these stores and want it removed or re-checked? Email dev.prathapk@gmail.com.
Free, 30 seconds, no signup
See your store the way AI does
Find out what ChatGPT, Perplexity and Claude see, and exactly what to fix.
- Reads only public pages
- Live answers from 3 AI assistants
- A report you can share