The state of firewalls turning AI agents away

6 of 113 audited stores refused every AI agent we sent at the firewall.

A store can allow every AI agent in robots.txt and still be invisible, because bot protection decides separately. This is the gap merchants find hardest to believe and the one that costs the most: the rules say yes and the network says no.

113 stores audited, last refreshed October 2026.

Check your own store on this and 15 other checks. Free, about 30 seconds.

What we found

  • 6 of 113 audited stores refused every AI agent we sent at the firewall.

  • 7 more answered some AI agents and refused others.

  • Indian home and kitchen stores fail this most often: 3 of 21, or 14%.

  • Indian food and beverage stores are the exception: none of the 19 we audited fail it.

  • 16% of Custom or headless stores fail this against 0% of Shopify stores.

By platform

Stores grouped by the platform we detected.

GroupAuditedFailPartlyFail rate
Shopify73000%
Custom or headless376716%
Adobe Commerce (Magento)3000%

By benchmark

Each list links to its full ranking.

GroupAuditedFailPartlyFail rate
Indian beauty and personal care27207%
Indian fashion25040%
Indian electronics and gadgets21125%
Indian home and kitchen213114%
Indian food and beverage19000%

Worst on this check: Indian home and kitchen (3 of 21). Best: Indian food and beverage (0 of 19).

Which stores fail it

All 6 are on a published benchmark list. Each links to its full report and the exact fix.

Why it matters, and how to fix it

Why AI agents care

Bot protection (Cloudflare, Akamai, DataDome and others) often turns AI agents away even when robots.txt allows them. Then no AI can read your prices or stock. Real agents come from their companies' own IP addresses, so treat this as a strong signal, not proof.

The fix

  • Any platform: In your CDN or firewall, allow verified AI agents: OAI-SearchBot, ChatGPT-User, PerplexityBot, Perplexity-User and Claude-User. On Cloudflare, check Security > Bots and AI Crawl Control.
  • Shopify: Shopify's own storefront allows these agents. If Cloudflare or another proxy sits in front of your Shopify store, allow verified AI bots there.

Questions

How many online stores block AI agents at the firewall?
6 of 113 audited stores refused every AI agent we sent at the firewall. A further 7 answered some AI agents and refused others.
Why does this matter for AI shopping agents?
Bot protection (Cloudflare, Akamai, DataDome and others) often turns AI agents away even when robots.txt allows them. Then no AI can read your prices or stock. Real agents come from their companies' own IP addresses, so treat this as a strong signal, not proof.
How do I fix firewalls blocking AI agents on my store?
In your CDN or firewall, allow verified AI agents: OAI-SearchBot, ChatGPT-User, PerplexityBot, Perplexity-User and Claude-User. On Cloudflare, check Security > Bots and AI Crawl Control.
How do I fix it on Shopify?
Shopify's own storefront allows these agents. If Cloudflare or another proxy sits in front of your Shopify store, allow verified AI bots there.
How was this measured?
113 well-known stores were audited from our servers with the same check every AgentReady audit runs, most recently on October 11, 2026. 113 of them returned a result for this check.

The monthly AI shopping benchmark

New rankings and what changed, once a month. No other emails.

One email a month at most. Unsubscribe in one click. We never share it.

How we measured

  • Every store on our public benchmark lists got the same audit as AgentReady's free check. This page counts one of its 16 checks across all of them.
  • 113 of 113 stores returned a result for this check.
  • Audits ran from our servers in Singapore. Real AI agents visit from their companies' own networks, so firewall results are a strong signal, not proof.
  • Lists are chosen by hand and refreshed monthly. Last run October 11, 2026.
  • Run one of these stores and want it removed or re-checked? Email dev.prathapk@gmail.com.

Free, 30 seconds, no signup

See your store the way AI does

Find out what ChatGPT, Perplexity and Claude see, and exactly what to fix.

  • Reads only public pages
  • Live answers from 3 AI assistants
  • A report you can share