Key takeaways
- ChatGPT search finds pages with OAI-SearchBot. OpenAI says sites that block it "will not be shown in ChatGPT search answers." GPTBot is a separate crawler for training.
- Perplexity search uses PerplexityBot, which Perplexity says "is not used to crawl content for AI foundation models."
- A firewall or "block AI bots" setting can shut these crawlers out even when robots.txt allows them, so test with the real user agents.
- No AI company publishes a list of ranking factors. The best public evidence, a 2023 research paper, found that adding sources, quotations and statistics made pages more visible in AI answers.
- OpenAI says robots.txt changes can take about 24 hours to take effect for search.
Pricing an app? Try the free app cost calculator or get a range for your project in the instant quote.
To get your SaaS cited by ChatGPT and Perplexity, first make sure their search crawlers can reach your pages, then give them pages worth quoting: clear answers, specific facts and named sources. Neither company publishes ranking factors, so this guide sticks to what OpenAI, Perplexity, Anthropic, Google and Bing document, plus one research paper. I re-read each source on October 20, 2026. The step-by-step checks are my own advice.
Step 1: Let the right crawlers in
Each AI company runs separate crawlers for search and for training, and they are controlled separately in robots.txt.
ChatGPT. OpenAI says "OAI-SearchBot is used to surface websites in search results in ChatGPT's search features," and "Sites that are opted out of OAI-SearchBot will not be shown in ChatGPT search answers, though can still appear as navigational links." GPTBot is the training crawler, and OpenAI says each setting is independent, so you can allow OAI-SearchBot and block GPTBot.
Perplexity. "PerplexityBot is designed to surface and link websites in search results on Perplexity. It is not used to crawl content for AI foundation models." Perplexity recommends allowing it in robots.txt.
Claude. Anthropic runs ClaudeBot for training and Claude-SearchBot for search. It says blocking Claude-SearchBot "prevents our system from indexing your content for search optimization, which may reduce your site's visibility".
User-triggered fetchers work differently. When someone pastes your URL or asks about your page, ChatGPT-User, Perplexity-User or Claude-User may fetch it. Perplexity says its fetcher "generally ignores robots.txt rules" because a user requested it, and OpenAI says "robots.txt rules may not apply" to ChatGPT-User.
A robots.txt that lets search in and keeps training out looks like this:
User-agent: OAI-SearchBot
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: Claude-SearchBot
Allow: /
User-agent: GPTBot
Disallow: /
User-agent: ClaudeBot
Disallow: /
Whether to block the training crawlers is a business choice. Blocking them doesn't remove you from AI search.
Step 2: Test that they can actually get through
robots.txt is only one gate. Hosting firewalls and "block AI bots" toggles often sit in front of it, and they can block a crawler your robots.txt allows. OpenAI and Perplexity both publish IP ranges so you can allow their crawlers in a firewall.
How to check:
- Open
yourdomain.com/robots.txtand read it. Look for a blanketDisallow: /underUser-agent: *. - Check your host or CDN's bot settings for an AI crawler block.
- Request your homepage with each crawler's user agent, for example
curl -I -A "OAI-SearchBot" https://yourdomain.com/, and look for a 200 rather than a 403. A firewall that checks IP addresses can still treat the real crawler differently, so also look for these user agents in your server logs.
After a change, give it time. OpenAI says "it can take ~24 hours from a site's robots.txt update for our systems to adjust."
Step 3: Make your key pages readable without JavaScript or a login
The pages buyers ask about are your pricing, features, integrations, comparisons and docs. If those only appear after JavaScript runs, or sit behind a sign-in, a crawler may see an empty page. Google's guidance for its own AI features is the same: content must be indexable, and important information should be in text.
How to check: view the page source (not the inspector) or fetch it with curl, and confirm the prices and feature names are in the HTML.
Step 4: Write pages worth quoting
There's no official list of what makes ChatGPT or Perplexity cite one page over another. The best public evidence is the 2023 GEO research paper. It found that adding sources, quotations and statistics "achieved a relative improvement of 30-40%" on one of its visibility measures, and that adding keywords, the classic SEO move, did not perform well. In a test on Perplexity itself, the authors report "visibility improvements up to 37%." Those results come from the authors' test setup with 2023 models, so treat them as direction, not a guarantee.
In practice, for a SaaS site:
- Answer the buyer's question in the first two sentences of each section: who it's for, what it costs, what it connects to.
- Be specific. A line like "Starts at $29 a month for 3 users" is quotable. "Affordable plans for every team" is not.
- Cite your sources for any claim about the market, a law or a standard, and link to them.
- Publish comparison and alternative pages that are fair, including where a competitor is the better fit. Buyers often search "X vs Y", and a fair page gives an AI tool something honest to quote.
- Keep facts current. Bing says "Accurate and up to date content is important for inclusion and citation in AI-generated answers."
Google adds a warning that applies everywhere: "seeking inauthentic 'mentions' across the web isn't as helpful as it might seem." Real reviews, real customers and real coverage beat planted ones.
Step 5: Measure citations
- Bing Webmaster Tools has an AI Performance report that shows how often your content is cited in AI answers across Microsoft Copilot and AI summaries in Bing.
- Google Search Console has a generative AI performance report, which Google says covers generative AI features on Google Search and Discover.
- ChatGPT and Perplexity don't offer site-owner reports. Make a list of 20 to 30 questions your buyers really ask, run each one a few times in both tools, and record who gets cited. Repeat monthly.
A one-hour checklist
- Read your robots.txt and allow OAI-SearchBot, PerplexityBot and Claude-SearchBot.
- Turn off any blanket AI bot block at your host, or allow-list the search crawlers.
- Test with each user agent and check your logs.
- Confirm pricing and features are in the page HTML.
- Rewrite the top of your pricing and main feature pages to answer the question first, with specifics.
- Verify your site in Bing Webmaster Tools and Google Search Console.
- Write down your 20 buyer questions and run them in ChatGPT and Perplexity.
For how these terms fit together, see AEO vs GEO vs SEO. If you're wondering whether an llms.txt file helps, see what llms.txt does and doesn't do.
Need a hand?
If you'd rather have it done for you, see SEO, GEO and AEO services. The AI Search Visibility Audit is a $750 fixed price: I run your buyers' questions through ChatGPT, Perplexity, Google AI Overviews and Gemini, record who gets cited, and rank the fixes. Or send me a short description.
Frequently asked questions
- How does ChatGPT decide which websites to cite?
- OpenAI doesn't publish ranking factors. What it does document is that ChatGPT search surfaces sites through OAI-SearchBot, so the first step is making sure that crawler can reach your pages. After that, clear answers with specific, sourced facts give it something worth quoting.
- If I block GPTBot, will my SaaS disappear from ChatGPT?
- No. OpenAI says each crawler setting is independent: you can allow OAI-SearchBot to appear in search results while disallowing GPTBot for training.
- Does Perplexity respect robots.txt?
- Perplexity says site owners manage PerplexityBot, its search crawler, with robots.txt, and recommends allowing it. Its Perplexity-User fetcher, which runs when a person asks about a specific page, "generally ignores robots.txt rules" because a user requested the fetch.
- How long until ChatGPT sees my changes?
- For crawler permissions, OpenAI says it can take about 24 hours from a robots.txt update. For new content, there is no published timeline.
- Can I pay to be cited by ChatGPT or Perplexity?
- Neither company documents a paid way into organic answers. Be wary of anyone who promises citations. What you can do is make your pages reachable, quotable and measurable.
Sources
- OpenAI, Overview of OpenAI crawlers
- Perplexity, Perplexity crawlers
- Anthropic, Does Anthropic crawl data from the web?
- Google Search Central, Optimizing for generative AI search
- Bing Webmaster blog, Introducing AI Performance in Bing Webmaster Tools
- Aggarwal et al., GEO: Generative Engine Optimization (arXiv 2311.09735)
Fixed-price services
Want this done at a fixed price?
Fixed scope, fixed price, paid upfront. The work happens in writing; no call needed.
Related Resources
Related guides
AEO vs GEO vs SEO: What Each One Changes (2026)
AEO, GEO and SEO explained in plain English: where the terms come from, what Google, OpenAI, Perplexity and Bing actually say, and what each one changes on your site.
Read morellms.txt: What It Does and Doesn't Do (2026)
What llms.txt is, who actually reads it, and what it won't do for your rankings or AI citations, from the proposal itself and from what Google, OpenAI, Anthropic and Perplexity document. Plus how to write one in under an hour.
Read moreGEO: The Complete Guide to Generative Engine Optimization (2026)
Generative engine optimization (GEO) gets your content cited by AI search engines. Learn which methods the Princeton-led GEO paper tested in this 2026 guide.
Read more