
Which AI Crawlers Reach Marketing Sites and What Do They Request? A CDM Log Study
Use CDM's preregistered log-study protocol to verify AI crawler identity, requests, response outcomes and robots behavior without equating access with citation.
Founded in New York City and now based in Shoreditch, London, CDM follows the marketing signals shaped by current realities and the economy.
Enter the journalLead story
27 October 2026 / 9 min
Use CDM's preregistered log-study protocol to verify AI crawler identity, requests, response outcomes and robots behavior without equating access with citation.
Read the article
Use CDM's preregistered log-study protocol to verify AI crawler identity, requests, response outcomes and robots behavior without equating access with citation.

Read CDM's preregistered protocol for measuring creator production delays by stage, cause, waiting time and rework without claiming results early.

A field-level product-truth reconciliation workflow for ChatGPT feeds, Google Merchant Center, Product structured data and the visible product page.

Use an expertise escalation grid to route creator claims, audience risks, personal data and usage rights to qualified reviewers before release.

Correct one shared fact by freezing reuse, mapping every direct and derivative use, publishing visible notes, updating discovery signals and verifying closure.

Set evidence refresh dates from observed source changes, release schedules, consequence and detection coverage instead of one universal content cadence.

A code-led guide to using data-nosnippet for element-level preview boundaries around volatile claims while keeping pages indexable and useful.

Verify a marketing statistic's source, population, period, measure, denominator, method, uncertainty, comparison and wording before publication.

Trace five apparent sources to their evidence origin, expose circular citation and distinguish independent corroboration from repetition or transformation.

Build a claim evidence register that controls approved meaning, source fit, scope, owner, review date, active uses, changes and retirement evidence.

A property-scope runbook for changing Google Search generative AI inclusion, documenting inheritance, preserving classic Search eligibility and validating rollback.

Use a launch-day continuity ladder to protect customer promises, data integrity and decision records before switching channels or restoring convenience.

Audit agency and contractor access by matching every user, manager link, token and shared asset to a current task, contract owner and expiry decision.

Plan an AI marketing vendor exit by testing export completeness, deletion evidence, replacement portability and launch continuity before dependency deepens.

Use Bing Webmaster Tools grounding queries, intents, topics, cited pages and Citation Share to decide what to protect, improve, consolidate or investigate.

Control automated ad budget changes with data-quality gates, exposure and velocity caps, anomaly stops, logged overrides and a finance-approved recovery path.

Prevent wrong automated sends with a separate release gate for final audience, offer, timing and suppressions, plus test evidence and a kill switch.

Build a marketing AI data-risk register that maps each task to data class, vendor processing, retention, controls, reviewer and verified deletion evidence.

Interpret Google Search Console’s generative AI performance report as first-party visibility evidence without turning impressions, pages or trends into a fictional AI rank.

Revalidate an AI marketing workflow after a model change with versioned regression cases, hard safety gates, side-by-side review and staged authority.

Build a marketing AI incident runbook covering detection, containment, correction, notification, evidence and process repair with named decision owners.

Test whether AI marketing review is meaningful by checking evidence access, reviewer competence, available time and real authority to reject an output.

A filing-led analysis of Airbnb’s disclosed marketing mix and a framework for testing paid reliance without confusing brand strength, product distribution and cost ratios.

Score marketing automation by plausible harm and ease of reversal, then assign a bounded authority level with evidence, review and stop conditions.

Decide what a small marketing team must document using consequence, repetition, dispute and reversibility tests, with templates and cost scenarios.

Reset an overloaded marketing operation in 30 days by stopping work, simplifying flow and rebuilding controls, with a costed daily schedule.

A source-led analysis of Clubcard Prices as a value, membership and data system, with a scorecard for judging the customer exchange beyond enrolment.

Calculate a small team’s campaign limit from usable hours, bottleneck review, handoffs and risk reserve, with formulas and worked scenarios.

Choose an analyst, marketing operator or contractor by the binding constraint, with output tests, cost scenarios and a 30-day hiring router.

Run one partner approval rail with shared evidence, version, rights and decision fields, plus access tiers, costed handoffs and a worked campaign.

A filing-led analysis of Nike’s marketplace reset and what marketers can learn about direct channels, wholesale reach, inventory, full-price presentation and demand creation.

Remove founder approval delays with a delegation ladder, reversible decision limits, evidence rules, stop conditions and a costed four-week test.

Choose a five-person marketing stack by indispensable jobs, failure cost and total ownership, with a current dated pricing grid and removal tests.

Turn a 45-minute marketing review into a decision forum with an admission filter, costed agenda, written records and a worked weekly example.

A practical US–UK operating-differences register covering claims, disclosures, pricing, privacy, language, evidence and governance without reducing adaptation to spelling.

Divide a five-person marketing team into clear seats, single decision owners and capped work, with capacity assumptions and a costed weekly example.

Run a 90-minute solo marketing control window with a triage board, costed agenda, capacity rules, four-week simulation and exception decisions.

Close a creator partnership by reconciling payments, rights, live assets, platform access, customer data, models, credentials and retained evidence.

A 60-minute demand-review system that reconciles marketing, sales, product and finance evidence and ends with recorded decisions, owners and learning needs.

Map who may collect, access, use, share, retain and delete creator-campaign customer data across platforms, forms, agencies and CRMs, with clear controls.

Build an asset-lineage graph that links every crop, edit, translation and synthetic derivative to its source, transformation, permissions and live uses.

Obtain specific, informed, recorded consent for the synthetic model, inputs, uses, channels, territories, duration, disclosure and revocation process.

Diagnose why buying decisions are taking longer and match content, proof, nurture and measurement to the specific delay without manufacturing pressure.

Control international creator use with a territory-language-edit matrix, separate derivative permissions, local review, expiry rules and evidence.

Give creators an approved claim-evidence pack that defines the exact meaning, source, scope, qualifications, prohibited extrapolations and expiry.

Test sponsorship disclosure in the actual post for wording, placement, crop, duration, sound, language and platform labels before publishing.

A practical 13-week planning system with committed, conditional and learning work, leading indicators, decision thresholds and weekly reallocation rules.

Grant creator ad access with least privilege, verified account IDs, fixed expiry, rights checks, activity evidence and independently tested revocation.

Build creator-rights renewal alerts with reliable dates, named owners, asset inventories, escalating signals, confirmed actions and expiry proof.

Convert creator contract clauses into owned workflow fields for permissions, deliverables, deadlines, approvals, payments, evidence and stop rules.

Turn market observations into a testable thesis with a mechanism, disconfirming evidence, alternatives and an expiry date before choosing channels or campaigns.

Audit every material answer claim against exact cited passages, scoring support, citation coverage, qualifier survival, contradictions and reviewer agreement.

Use a multilingual fact grid to preserve approved meaning while governing local scope, terminology, currency, dates, URLs and retrieval tests.

Use a timed correction ledger to update canonical evidence, preserve history, request discovery and monitor dated answers without false recrawl promises.

A margin-aware framework for helping price-sensitive customers recognise value without training demand to wait for the next discount.

Build a versioned brand-fact benchmark that scores retrieval, source faithfulness, scope, recency, permissions, refusal and answer completeness.

Write retrievable evidence blocks that keep each claim beside its entity, scope, date, source and limitation, then test chunking and answer fidelity.

Test PDFs and images with a gold evidence manifest covering OCR, reading order, tables, charts, qualifiers, provenance and retrieval accuracy.

Use CDM’s five-constraint diagnostic to identify whether weak demand comes from awareness, affordability, availability, trust or product fit before spending more on promotion.

Use a purpose-based permission matrix to govern search crawling, user-requested fetches and model use separately, then test every robots rule.

Build a verified bot ledger that separates spoofed user-agents, successful requests and content delivery from indexing, retrieval and citation claims.

Run an outside-in crawler probe across robots.txt, DNS, TLS, CDN, firewall, origin and rendering, with expected results and a diagnostic tree.

Use a dual-environment test to measure public crawl and citation separately from private RAG retrieval, grounding, refusal and scope preservation.

Reconcile ad platforms, GA4, CRM and finance by aligning definitions, time, identity and adjustments, then classify residuals without forcing equality.

Add self-reported attribution to CRM records with separate raw and coded fields, versioned rules, QA, privacy controls and signal reconciliation.

Build a Segment tracking taxonomy around customer questions, answer paths and outcomes, with event schemas, SQL, validation and destination QA.

Calculate affiliate revenue from settled payments, refunds and reversals with a transaction ledger, worked formula, QA tests and payout controls.

Measure creator cohorts across Shopify and Klaviyo with stable identity, refund-aware value curves, repeat-purchase formulas, QA and decisions.

Configure Salesforce campaign influence with traceable eligibility, association, weighting, versioning, QA tests and finance reconciliation.

Govern creator-sourced leads in HubSpot with explicit stage rules, source fields, reset controls, QA tests, sales reconciliation and audit records.

Design a Looker Studio dashboard around one decision, with governed metrics, diagnostic views, QA tests, caveats, accountable actions and release controls.

Join Search Console demand with GA4 landing behavior using safe grains, query families, URL rules, QA checks and a decision-ready dashboard.

Build a GA4 and BigQuery warehouse with an event contract, tested transformations, identity limits, cost controls and decision-ready marts for teams.

Build a WordPress evidence-to-refresh workflow with source fields, review roles, revision gates, schema checks, failure tests and a worked article record.

Configure a monday.com campaign risk board with dependency fields, decision deadlines, permissions, automation limits, failure tests and a worked item.

Build a Microsoft Lists and Power Automate approval trail with exact fields, append-only evidence, role boundaries, exception tests and a worked item.

Build a Google Sheets creator-rights tracker with channel, territory, term and derivative controls, expiry logic, permissions and a worked record.

Convert Slack decisions into durable records with a precise schema, workflow trigger, permissions, retention controls, retrieval test and worked example.

Add a recoverable human gate before Zapier or Make publishes content, with record fields, role controls, timeout tests and a worked release example.

Build an Asana intake-to-approval workflow with required fields, routing rules, permission boundaries, rejection tests and a complete sample request.

Join Salesforce campaign decisions to opportunities with explicit attribution rules, finance definitions, permissions, reconciliation and a worked record.

Configure a HubSpot campaign decision log with exact object fields, associations, permissions, workflow gates, failure tests and a worked record.

Build a Notion claims register with exact fields, relations, permissions, review gates, failure tests and an implementation-ready example record.

A multi-channel recall method for locating every derivative of a false claim, correcting affected audiences and proving that reuse has stopped.

A fault-tree and reconciliation process for restoring lead capture, recovering valid submissions and preventing duplicates after an integration outage.

A post-publication repair process for correcting creator disclosures in the rendered content, paid distribution and records of affected audiences.

A response ladder for stopping an AI-generated marketing claim, verifying evidence, correcting derivatives and restarting automation safely.

A system-by-system workflow for receiving, propagating, testing and proving consent withdrawal across CRM, audiences, analytics and activation tools.

A reconstruction method for restoring campaign measurement, separating incompatible data periods and making decisions with explicit uncertainty.

An asset-level containment process for stopping expired creator use, tracing every placement, resolving rights and documenting defensible closure.

A documented response protocol for correcting brand facts, repairing source evidence and measuring whether inaccurate AI answers continue to appear.

A cross-channel runbook for stopping a pricing error, finding affected buyers, choosing remediation and proving that every offer was corrected.

A minute-by-minute response protocol for stopping campaign exposure, preserving evidence, assigning authority and preparing an accurate correction.

A documented Coinbase campaign analysis and load-test checklist for aligning media reach, landing-page capacity, throttling and conversion recovery.

A documented Wells Fargo case analysis and diagnostic for finding when targets, incentives, gaming and weak challenge corrupt a growth metric.

A documented Dieselgate analysis and traceable test for ensuring environmental claims match product operation, real-world evidence and accountable controls.

A documented Pepsi ad analysis and cultural red-team process for testing historical references, power, product roles and stakeholder interpretations.

A documented Gemini case analysis with a representation stress test for historical accuracy, refusal parity, harmful outputs and pause readiness.

A documented Sonos app case study and launch meter for testing whether product promises, customer tasks, support and rollback are ready for promotion.

A detailed, fact-checked Fashion Nova case analysis with controls for review intake, moderation, publication, ratings, exceptions and audit records.
CDM is an independent marketing media journal reporting on visibility, content creation, AI visibility, and relevance in the context of today’s economy.
The publication is handled by leading marketing experts who turn fast-moving signals into clear, useful guidance.
About CDMExpert-led analysis, clear frameworks, and grounded guidance for marketing decisions being made now.
100 articles

Use CDM's preregistered log-study protocol to verify AI crawler identity, requests, response outcomes and robots behavior without equating access with citation.

Read CDM's preregistered protocol for measuring creator production delays by stage, cause, waiting time and rework without claiming results early.

A field-level product-truth reconciliation workflow for ChatGPT feeds, Google Merchant Center, Product structured data and the visible product page.

Use an expertise escalation grid to route creator claims, audience risks, personal data and usage rights to qualified reviewers before release.

Correct one shared fact by freezing reuse, mapping every direct and derivative use, publishing visible notes, updating discovery signals and verifying closure.

Set evidence refresh dates from observed source changes, release schedules, consequence and detection coverage instead of one universal content cadence.

A code-led guide to using data-nosnippet for element-level preview boundaries around volatile claims while keeping pages indexable and useful.

Verify a marketing statistic's source, population, period, measure, denominator, method, uncertainty, comparison and wording before publication.

Trace five apparent sources to their evidence origin, expose circular citation and distinguish independent corroboration from repetition or transformation.

Build a claim evidence register that controls approved meaning, source fit, scope, owner, review date, active uses, changes and retirement evidence.

A property-scope runbook for changing Google Search generative AI inclusion, documenting inheritance, preserving classic Search eligibility and validating rollback.

Use a launch-day continuity ladder to protect customer promises, data integrity and decision records before switching channels or restoring convenience.

Audit agency and contractor access by matching every user, manager link, token and shared asset to a current task, contract owner and expiry decision.

Plan an AI marketing vendor exit by testing export completeness, deletion evidence, replacement portability and launch continuity before dependency deepens.

Use Bing Webmaster Tools grounding queries, intents, topics, cited pages and Citation Share to decide what to protect, improve, consolidate or investigate.

Control automated ad budget changes with data-quality gates, exposure and velocity caps, anomaly stops, logged overrides and a finance-approved recovery path.

Prevent wrong automated sends with a separate release gate for final audience, offer, timing and suppressions, plus test evidence and a kill switch.

Build a marketing AI data-risk register that maps each task to data class, vendor processing, retention, controls, reviewer and verified deletion evidence.

Interpret Google Search Console’s generative AI performance report as first-party visibility evidence without turning impressions, pages or trends into a fictional AI rank.

Revalidate an AI marketing workflow after a model change with versioned regression cases, hard safety gates, side-by-side review and staged authority.

Build a marketing AI incident runbook covering detection, containment, correction, notification, evidence and process repair with named decision owners.

Test whether AI marketing review is meaningful by checking evidence access, reviewer competence, available time and real authority to reject an output.

A filing-led analysis of Airbnb’s disclosed marketing mix and a framework for testing paid reliance without confusing brand strength, product distribution and cost ratios.

Score marketing automation by plausible harm and ease of reversal, then assign a bounded authority level with evidence, review and stop conditions.

Decide what a small marketing team must document using consequence, repetition, dispute and reversibility tests, with templates and cost scenarios.

Reset an overloaded marketing operation in 30 days by stopping work, simplifying flow and rebuilding controls, with a costed daily schedule.

A source-led analysis of Clubcard Prices as a value, membership and data system, with a scorecard for judging the customer exchange beyond enrolment.

Calculate a small team’s campaign limit from usable hours, bottleneck review, handoffs and risk reserve, with formulas and worked scenarios.

Choose an analyst, marketing operator or contractor by the binding constraint, with output tests, cost scenarios and a 30-day hiring router.

Run one partner approval rail with shared evidence, version, rights and decision fields, plus access tiers, costed handoffs and a worked campaign.

A filing-led analysis of Nike’s marketplace reset and what marketers can learn about direct channels, wholesale reach, inventory, full-price presentation and demand creation.

Remove founder approval delays with a delegation ladder, reversible decision limits, evidence rules, stop conditions and a costed four-week test.

Choose a five-person marketing stack by indispensable jobs, failure cost and total ownership, with a current dated pricing grid and removal tests.

Turn a 45-minute marketing review into a decision forum with an admission filter, costed agenda, written records and a worked weekly example.

A practical US–UK operating-differences register covering claims, disclosures, pricing, privacy, language, evidence and governance without reducing adaptation to spelling.

Divide a five-person marketing team into clear seats, single decision owners and capped work, with capacity assumptions and a costed weekly example.

Run a 90-minute solo marketing control window with a triage board, costed agenda, capacity rules, four-week simulation and exception decisions.

Close a creator partnership by reconciling payments, rights, live assets, platform access, customer data, models, credentials and retained evidence.

A 60-minute demand-review system that reconciles marketing, sales, product and finance evidence and ends with recorded decisions, owners and learning needs.

Map who may collect, access, use, share, retain and delete creator-campaign customer data across platforms, forms, agencies and CRMs, with clear controls.

Build an asset-lineage graph that links every crop, edit, translation and synthetic derivative to its source, transformation, permissions and live uses.

Obtain specific, informed, recorded consent for the synthetic model, inputs, uses, channels, territories, duration, disclosure and revocation process.

Diagnose why buying decisions are taking longer and match content, proof, nurture and measurement to the specific delay without manufacturing pressure.

Control international creator use with a territory-language-edit matrix, separate derivative permissions, local review, expiry rules and evidence.

Give creators an approved claim-evidence pack that defines the exact meaning, source, scope, qualifications, prohibited extrapolations and expiry.

Test sponsorship disclosure in the actual post for wording, placement, crop, duration, sound, language and platform labels before publishing.

A practical 13-week planning system with committed, conditional and learning work, leading indicators, decision thresholds and weekly reallocation rules.

Grant creator ad access with least privilege, verified account IDs, fixed expiry, rights checks, activity evidence and independently tested revocation.

Build creator-rights renewal alerts with reliable dates, named owners, asset inventories, escalating signals, confirmed actions and expiry proof.

Convert creator contract clauses into owned workflow fields for permissions, deliverables, deadlines, approvals, payments, evidence and stop rules.

Turn market observations into a testable thesis with a mechanism, disconfirming evidence, alternatives and an expiry date before choosing channels or campaigns.

Audit every material answer claim against exact cited passages, scoring support, citation coverage, qualifier survival, contradictions and reviewer agreement.

Use a multilingual fact grid to preserve approved meaning while governing local scope, terminology, currency, dates, URLs and retrieval tests.

Use a timed correction ledger to update canonical evidence, preserve history, request discovery and monitor dated answers without false recrawl promises.

A margin-aware framework for helping price-sensitive customers recognise value without training demand to wait for the next discount.

Build a versioned brand-fact benchmark that scores retrieval, source faithfulness, scope, recency, permissions, refusal and answer completeness.

Write retrievable evidence blocks that keep each claim beside its entity, scope, date, source and limitation, then test chunking and answer fidelity.

Test PDFs and images with a gold evidence manifest covering OCR, reading order, tables, charts, qualifiers, provenance and retrieval accuracy.

Use CDM’s five-constraint diagnostic to identify whether weak demand comes from awareness, affordability, availability, trust or product fit before spending more on promotion.

Use a purpose-based permission matrix to govern search crawling, user-requested fetches and model use separately, then test every robots rule.

Build a verified bot ledger that separates spoofed user-agents, successful requests and content delivery from indexing, retrieval and citation claims.

Run an outside-in crawler probe across robots.txt, DNS, TLS, CDN, firewall, origin and rendering, with expected results and a diagnostic tree.

Use a dual-environment test to measure public crawl and citation separately from private RAG retrieval, grounding, refusal and scope preservation.

Reconcile ad platforms, GA4, CRM and finance by aligning definitions, time, identity and adjustments, then classify residuals without forcing equality.

Add self-reported attribution to CRM records with separate raw and coded fields, versioned rules, QA, privacy controls and signal reconciliation.

Build a Segment tracking taxonomy around customer questions, answer paths and outcomes, with event schemas, SQL, validation and destination QA.

Calculate affiliate revenue from settled payments, refunds and reversals with a transaction ledger, worked formula, QA tests and payout controls.

Measure creator cohorts across Shopify and Klaviyo with stable identity, refund-aware value curves, repeat-purchase formulas, QA and decisions.

Configure Salesforce campaign influence with traceable eligibility, association, weighting, versioning, QA tests and finance reconciliation.

Govern creator-sourced leads in HubSpot with explicit stage rules, source fields, reset controls, QA tests, sales reconciliation and audit records.

Design a Looker Studio dashboard around one decision, with governed metrics, diagnostic views, QA tests, caveats, accountable actions and release controls.

Join Search Console demand with GA4 landing behavior using safe grains, query families, URL rules, QA checks and a decision-ready dashboard.

Build a GA4 and BigQuery warehouse with an event contract, tested transformations, identity limits, cost controls and decision-ready marts for teams.

Build a WordPress evidence-to-refresh workflow with source fields, review roles, revision gates, schema checks, failure tests and a worked article record.

Configure a monday.com campaign risk board with dependency fields, decision deadlines, permissions, automation limits, failure tests and a worked item.

Build a Microsoft Lists and Power Automate approval trail with exact fields, append-only evidence, role boundaries, exception tests and a worked item.

Build a Google Sheets creator-rights tracker with channel, territory, term and derivative controls, expiry logic, permissions and a worked record.

Convert Slack decisions into durable records with a precise schema, workflow trigger, permissions, retention controls, retrieval test and worked example.

Add a recoverable human gate before Zapier or Make publishes content, with record fields, role controls, timeout tests and a worked release example.

Build an Asana intake-to-approval workflow with required fields, routing rules, permission boundaries, rejection tests and a complete sample request.

Join Salesforce campaign decisions to opportunities with explicit attribution rules, finance definitions, permissions, reconciliation and a worked record.

Configure a HubSpot campaign decision log with exact object fields, associations, permissions, workflow gates, failure tests and a worked record.

Build a Notion claims register with exact fields, relations, permissions, review gates, failure tests and an implementation-ready example record.

A multi-channel recall method for locating every derivative of a false claim, correcting affected audiences and proving that reuse has stopped.

A fault-tree and reconciliation process for restoring lead capture, recovering valid submissions and preventing duplicates after an integration outage.

A post-publication repair process for correcting creator disclosures in the rendered content, paid distribution and records of affected audiences.

A response ladder for stopping an AI-generated marketing claim, verifying evidence, correcting derivatives and restarting automation safely.

A system-by-system workflow for receiving, propagating, testing and proving consent withdrawal across CRM, audiences, analytics and activation tools.

A reconstruction method for restoring campaign measurement, separating incompatible data periods and making decisions with explicit uncertainty.

An asset-level containment process for stopping expired creator use, tracing every placement, resolving rights and documenting defensible closure.

A documented response protocol for correcting brand facts, repairing source evidence and measuring whether inaccurate AI answers continue to appear.

A cross-channel runbook for stopping a pricing error, finding affected buyers, choosing remediation and proving that every offer was corrected.

A minute-by-minute response protocol for stopping campaign exposure, preserving evidence, assigning authority and preparing an accurate correction.

A documented Coinbase campaign analysis and load-test checklist for aligning media reach, landing-page capacity, throttling and conversion recovery.

A documented Wells Fargo case analysis and diagnostic for finding when targets, incentives, gaming and weak challenge corrupt a growth metric.

A documented Dieselgate analysis and traceable test for ensuring environmental claims match product operation, real-world evidence and accountable controls.

A documented Pepsi ad analysis and cultural red-team process for testing historical references, power, product roles and stakeholder interpretations.

A documented Gemini case analysis with a representation stress test for historical accuracy, refusal parity, harmful outputs and pause readiness.

A documented Sonos app case study and launch meter for testing whether product promises, customer tasks, support and rollback are ready for promotion.

A detailed, fact-checked Fashion Nova case analysis with controls for review intake, moderation, publication, ratings, exceptions and audit records.