The publishers you can't scrapeare on xpay.
A growing share of quality publishers — most of the mid-tier sites your agents actually want — now block AI bots at the WAF or robots.txt layer. xpay✦ is how you get in: pay-per-query access to 1,000+ publishers, one API key, receipts by default. No scraping. No licensing deals. No lawsuits.
The publishers you want are blocking you.
A growing share of quality publishers now block AI bots at the gateway. Scraping harder doesn't fix it. Bilateral licensing doesn't scale. Common Crawl is months stale.
The publishers you want are dark to your scraper.
The mid-tier, ad-monetized, professionally-edited sites — exactly the ones worth retrieving from — now block AI bots at the gateway. 403s, robots.txt disallow, Cloudflare AI Audit, paywalls. You're locked out of the content your agents most need.
Common Crawl misses what you actually need.
It's months stale and skips everything blocked since 2024 — which is most of what's worth having. Your retrieval is a snapshot of the past, not the web your users live in.
Scraping harder is a dead end.
Better proxies, stealth fingerprints, browser farms — even when they work, your customer's lawyer asks where the content came from. You don't have a great answer.
xpay✦ is the legitimate way in.
Publishers in our network actively chose to be paid via xpay — including ones that block every other AI agent at the gateway. You pay what content's worth. You get the content. Everybody wins.
Reach the unreachable.
Pay-per-query access to 1,000+ publishers — including a long tail of mid-tier sites that block every other AI bot at the gateway. The only legitimate way in.
Pay what it's worth.
Sub-cent on most queries. Per-domain caps, project budgets, no minimums. Publishers in our network actively chose to be paid via xpay — they want your traffic.
Receipts + attribution by default.
Each query produces a settlement receipt — useful for citations today, useful for compliance when your customer's lawyer asks tomorrow.
Three lines. Ship Tuesday.
Native SDKs across the agent stack. Drop in xpay where you already retrieve.
import { withPaymentInterceptor } from 'x402-axios';
import axios from 'axios';
const client = withPaymentInterceptor(
axios.create({ baseURL: 'https://api.xpay.sh' }),
wallet
);
const { data } = await client.get('/search', {
params: { q: 'today\'s AI policy news' },
});Live in five minutes.
01
Get an API key
Sign up at app.xpay.sh, fund a wallet (USDC on Base), get your API key. New accounts ship with $50 in free credits.
02
Drop in the retriever
Three lines of code. Native SDKs for LangChain, LlamaIndex, CrewAI, Stagehand, Playwright. Or hit the REST API directly with x402 headers.
03
Get licensed content + receipts
Each query returns the document, publisher attribution, and a settlement receipt. Pay only for what you actually retrieve. Cap spend per project, per user, per domain.
Built for agents like these
AI search engines
Perplexity, You.com, Phind-styleRAG builders
LangChain, LlamaIndex, CrewAI usersBrowser agents
Browserbase, Stagehand, Browser UseEnterprise AI
Internal F500 AI initiativesWhat kind of agent are you building?
Each use-case has tailored messaging, integration, and pricing. Find yours.
Stop scraping.Start accessing.
Pay-per-query access to 1,000+ publishers — including the mid-tier sites blocking every other AI agent. One API key. Receipts by default.
Self-serve · $50 free credits · No BD calls · No MSA requiredOr browse the publisher catalogAI Agents — FAQ
Common questions from agent builders evaluating xpay
A growing share — most of the mid-tier, ad-monetized, professionally-edited publishers in our network actively block GPTBot, ClaudeBot, PerplexityBot, and similar agents at the WAF or via robots.txt. xpay is the legitimate path in: publishers whitelist xpay traffic at the gateway because they chose to be paid for AI access.
xpay is the payment-and-access layer for AI agents reaching publisher content. Your agent queries an xpay endpoint; we route to the right publisher, settle the micropayment via the x402 protocol, and return the content with attribution and a receipt. You access publishers you literally couldn't reach with a scraper.
Those tools fetch what's accessible — they don't help when the publisher blocks AI bots. xpay specifically reaches the publishers blocking scrapers, because we have explicit licensing relationships and the publisher whitelists our traffic. Different problem, different solution. Often complementary: scrape the open web with Firecrawl, reach the blocked mid-tier with xpay.
Bilateral deals take 12-18 months, seven-figure minimums, one publisher per contract. xpay is one API contract that gives per-query access to 1,000+ publishers — including the long tail you could never reasonably negotiate with directly. You pay only for what you actually retrieve.
Request the domain. Our publisher onboarding team prioritizes additions based on agent demand. Most publishers we approach (especially mid-tier ad-monetized ones losing AI traffic to deflection) join within weeks once they see the per-query revenue path.
Per-query, $0.001-$0.50 depending on publisher and content type. Enterprise committed-spend plans start at $10K/month. New accounts get $50 in free credits.
Browse the publisher catalog
Browse 4,930+ publishers by vertical, language, country, or AI-bot blocking status.