Occupation manual 007 / Search & answer visibility

Make useful answers easy to find—and easy to verify.

A proof-first route from one real query to a direct answer, source coverage, crawl/index controls, structured-data parity, internal links, submission receipts, observed citations, and evidence-based refreshes.

Short answer: answer one real customer question better than a thin summary. Put the direct answer and useful artifact in crawlable HTML, tie material claims to visible sources, keep canonical/sitemap/robots/schema signals consistent, link the page into a clear site hierarchy, notify approved discovery systems, then measure observed indexing, referrals, and citations without promising any of them.

No ranking or citation guaranteeCrawling, indexing, ranking, grounding, citation, recommendation, traffic, and business outcomes are separate states controlled by external systems. Sitemaps, robots policies, structured data, IndexNow, and search-console actions can improve clarity or notify systems; they do not buy or guarantee inclusion.

What current first-party sources make clear

Search foundations also support AI discovery

Bing's current webmaster guidance says the same crawl, indexing, URL consolidation, content clarity, and trust foundations used for search also support eligibility for Copilot grounding and citations. Google likewise emphasizes helpful, reliable, people-first content and clear technical access.

Different AI crawlers have different purposes

OpenAI documents OAI-SearchBot for ChatGPT search and GPTBot for potential model training as separate controls. Anthropic similarly documents Claude-SearchBot, ClaudeBot, and Claude-User roles. The site owner—not a generic SEO tool—chooses the intended access policy.

No special Google AI file or schema is requiredGoogle says pages appearing in AI Overviews or AI Mode follow its existing search requirements. No special AI markup, Schema.org type, or new machine-readable AI text file is required, and meeting the requirements still does not guarantee inclusion.
Recheck before changing robotsCrawler names, purposes, IP ranges, and control behavior can change. Read the current first-party documentation, verify CDN/firewall behavior, and record the owner decision. Do not copy a stale “allow every AI bot” file.

Build the eight-part Search & Answer Visibility Evidence Desk

01

Start with one real query and job

Name the question in the audience's language, the task or decision behind it, evidence that it is real, the existing page that may already answer it, and the unique artifact or analysis worth adding.

Output: real-query and useful-job card
02

Write the answer before the optimization

Draft a direct answer, audience, outcome, numbered route, artifact, evidence desk, limitation, related guides, and visible author/reviewer/update date.

Output: answer-first content brief
03

Cover every material claim

Link each exact visible claim to evidence, class, scope, date, contradiction or limitation, and reviewer status. Search visibility never substitutes for claim truth.

Output: claim and source coverage table
04

Separate crawler purpose and access

Record intended access and actual robots, meta/header, firewall/CDN, and verification results for Google, Bing, OpenAI search/training, Anthropic search/training, and user-triggered agents where applicable.

Output: crawl and index control matrix
05

Make every technical signal agree

Check server status, HTTPS canonical, redirects, sitemap entry and honest lastmod, index controls, title, description, H1, visible answer, structured data, assets, and rendering.

Output: canonical/sitemap/schema parity card
06

Connect entities through useful links

Use crawlable, descriptive internal links inside a clear hierarchy. Consolidate duplicate intent instead of creating doorway, location, job, or query variants with little added value.

Output: entity and internal-link map
07

Separate deployment from submission

Bind the exact page version to local QA, deployment approval/result, sitemap and inspection actions, IndexNow receipt, crawler access checks, errors, and limits. Each action needs its own authority.

Output: change and submission receipt
08

Measure observed visibility and refresh

Log surface, query, observed result/citation/referral, exact page version, evidence, interpretation limits, and next action. Update, consolidate, redirect, noindex, or remove based on evidence.

Output: visibility and refresh log

Give AI bounded search jobs, never imaginary authority

JobApproved inputAI outputHuman gate
Query-intent clerkReal customer language and observed search dataQuestion/job map and duplicate-intent flagsContent owner chooses whether a page is needed
Answer-brief clerkApproved sources and artifactDirect answer, route, limitations, internal linksQualified reviewer approves claims and usefulness
Technical audit clerkPage HTML, headers, sitemap, robots, current docsParity and conflict reportSite owner chooses and implements controls
Structured-data clerkVisible reviewed page contentSchema proposal and validation reportHuman confirms exact visible-content parity
Measurement clerkSearch-console, webmaster, analytics, and citation observationsVisibility log and refresh suggestionsOwner interprets limits and approves changes

Do not delegate these decisions or claims

AI may prepare

  • query/job and content briefs
  • claim/source coverage tables
  • robots/canonical/sitemap/schema audits
  • structured-data drafts from visible content
  • internal-link maps and duplicate flags
  • submission receipt templates
  • citation/referral observation logs

Authorized humans control

  • site purpose, public claims, authorship, and review
  • crawler search/training access policy
  • robots, firewall/CDN, canonical, and index changes
  • public deployment and URL/sitemap submission
  • search-console/webmaster account writes
  • merge, redirect, noindex, or removal decisions
  • ranking, citation, recommendation, and business interpretations

Search crawling and model training are not one switch

OpenAI's current crawler page says OAI-SearchBot is used for ChatGPT search, while GPTBot covers content that may be used to improve foundation models. Anthropic documents Claude-SearchBot, ClaudeBot, and Claude-User separately. Treat each published crawler purpose as its own owner decision. Training access is not a prerequisite you should assume for search access.

Operational distinction`Allowed by robots` → `successfully fetched` → `indexed` → `eligible` → `surfaced` → `cited` are different evidence states. Never collapse them into “optimized for AI.”

Structured data must tell the same story as the page

Use a supported vocabulary and the search engine's current feature rules. Mark up only content that exists visibly and truthfully. Never generate fake authors, ratings, reviews, FAQs, prices, products, organizations, dates, or claims to create a richer machine-facing version than readers receive.

Sitemaps and IndexNow are notification channels

A sitemap helps discovery and should list canonical URLs with accurate freshness signals. Bing recommends IndexNow for notifying participating engines when URLs are added, changed, or deleted, but its own documentation says submission does not guarantee crawl or index. Record `submitted`, `received`, `crawled`, and `indexed` separately.

StackPilot applicationFor every approved new manual: update the canonical page, sitemap, RSS, Guide Universe, internal research hub, and machine-readable discovery file; deploy the exact approved version; then separately record Google, Bing, and IndexNow actions and later observed status.

People-first content is the AI-search strategy

Google's helpful-content guidance asks whether a page adds original information, reporting, research, or analysis. Bing says content that is discoverable, accurate, well-structured, and created for users performs best across search experiences. For StackPilot, that means one direct answer, one practical route, one real artifact, named sources, visible limitations, and related guides—not thousands of generated occupation shells.

Use this prompt with current first-party docs

Act as a search and answer visibility preparation clerk, not a search engine, crawler owner, publisher, deployer, ranking authority, or citation guarantor.

Using the supplied page, sources, and current first-party documentation, create: (1) a real-query/job card, (2) an answer-first content brief, (3) a claim/source coverage table, (4) a crawl/index control matrix separated by crawler purpose, (5) canonical/sitemap/structured-data parity checks, (6) an internal-link/entity map, and (7) a measurement and refresh plan.

Do not invent search volume, rank, traffic, citations, reviews, authorship, dates, schema fields, or crawler behavior. Do not publish, deploy, submit URLs, change robots, or modify search accounts. Mark every assumption and recheck requirement.

Final review before deployment or submission

First-party source desk

Make one StackPilot answer worth citing before creating ten more pages.

Download the desk, audit a real guide, and require evidence at every state: useful, published, crawlable, indexed, surfaced, cited, referred, and completed.