The Bias Audit: Tearing Down a Rigged Comparison Page
Objective: Given three synthetic-realistic excerpts from an agency-drafted 'Snowflake vs Databricks' comparison page draft, identify the trust-destroying defects (fabricated wins, stale competitor data, missing structured data) before publish, without flagging harmless stylistic choices as problems.
You're the content strategist at Snowflake reviewing an agency's first draft of a 'Snowflake vs Databricks' comparison page before it goes live to a technical, skeptical B2B buyer audience.
Read each excerpt, decide what's a real defect versus a harmless stylistic choice, and rate severity for anything real.
Before you start
What you'll need
Free path (everything below is enough to finish)
Free, sufficient for a 3-item defect log
Shows exactly what Google's parser sees, not just what's in the HTML
The process
Specimens to review
What's wrong with this table, and how severe is it?
Feature comparison table (12 rows shown): Ease of Setup: Snowflake ✅ Databricks ❌ Query Performance: Snowflake ✅ Databricks ❌ Open-Source Flexibility: Snowflake ✅ Databricks ❌ ML/AI Native Tooling: Snowflake ✅ Databricks ❌ ...8 more rows, all Snowflake ✅ / Databricks ❌, no exceptions.
Specimen: synthetic, realistic
What's wrong with this pricing comparison, and how severe is it?
Pricing section: Snowflake: Starting at $2/credit (2026 pricing, linked to current pricing page) Databricks: Starting at $0.07/DBU (cited from a 2023 third-party blog post, no link to Databricks' own pricing page, no year noted in the text)
Specimen: synthetic, realistic
What's wrong with this page's technical setup, and how severe is it?
Page has a fully built comparison table (12 rows) and a 6-question FAQ section written in prose paragraphs. View-source check: no JSON-LD script tags anywhere on the page, no Product schema, no FAQPage schema.
Specimen: synthetic, realistic
Final deliverable
A defect log for all three excerpts with severity ratings and a publish/hold decision for the draft page.
See a reference example
Klaviyo comparison-page pre-publish audit (excerpt) EXCERPT: Feature table, 'Klaviyo vs Mailchimp' VERDICT: HOLD - Critical: all 10 rows favor Klaviyo, including 'Ease of Setup' where G2's Summer 2025 report actually favors Mailchimp EXCERPT: Structured data check - Moderate: no FAQPage schema despite a 5-question FAQ block - Fix before publish: add FAQPage JSON-LD
Success criteria
You're done when you can:
- Correctly identifies all 3 real defects with matching severity
- Does not flag either distractor per item as a defect
- Cites the correct lesson section for each defect found