The Drummerduck glossary

Plain-English definitions for the terms behind these tools.

AI crawler

A bot run by an AI company that fetches web pages to train models or answer questions with live citations.

The link tag that tells search engines which URL is the real one, so duplicate or parameterized pages don't split ranking.

Anthropic's web crawler. Allow it in robots.txt so Claude can read and reference your content.

Optimizing your site to be read, understood and cited by AI answer engines — the AI-era counterpart to SEO.

OpenAI's web crawler. Allowing it in robots.txt lets ChatGPT and OpenAI models read and cite your site.

The recommended format for structured data — a script of Schema.org JSON that describes what a page is, kept separate from the visible markup.

The preview card a chat app or social platform builds when you paste a URL — driven by your Open Graph and Twitter tags.

A companion to llms.txt that inlines the full text of your key pages, so a model can read your content in one fetch instead of crawling.

A plain-text file at your site root that tells AI models what your site is and where the important content lives — the AI-era robots.txt + sitemap.

The short summary tag search engines often show under your title in results — it doesn't rank, but it wins or loses the click.

The Open Graph tag that sets the preview image for your link — the picture in the Slack, iMessage or X card.

A meta-tag protocol that controls how your link looks when shared — the title, description and image in the preview card.

Perplexity's answer-engine crawler. Allow it in robots.txt so Perplexity can index and cite your pages.

A file at your site root that tells crawlers which paths they may fetch — including the named AI bots like GPTBot, ClaudeBot and PerplexityBot.

Structured data written with the Schema.org vocabulary — the shared type system (Article, Product, FAQPage) search engines understand.

An XML file listing your site's URLs so crawlers discover every page, even ones nothing links to.

Machine-readable markup that describes what a page is — a product, article, FAQ — unlocking rich results and helping AI understand it.

The Twitter Card type that shows a full-width preview image above the title — the format most links want.

The page's HTML title — the single strongest on-page SEO signal and the headline shown in search results and browser tabs.

X/Twitter's own preview format, controlled by twitter: meta tags, layered on top of Open Graph.