Comparative Analysis CoT AI Prompt

Design a chain-of-thought prompt for rigorous comparative analysis — comparing two or more entities, time periods, or segments in data.

Comparative questions ('is A better than B?', 'what changed between Q1 and Q2?') are prone to cherry-picking evidence and confirmation bias without structured reasoning.

1. Comparative analysis CoT structure:

   Step 1 — Define what is being compared:
   'State explicitly: what are the entities being compared (A and B)? Over what time period? On what metrics?'

   Step 2 — Establish the comparison framework:
   'Before looking at the numbers, list all the metrics relevant to this comparison. This prevents cherry-picking only favorable metrics.'

   Step 3 — Gather facts for each metric:
   'For each metric: state the value for A, the value for B, the absolute difference, and the percentage difference. No interpretation yet — just facts.'

   Step 4 — Context and normalization:
   'Are the metrics comparable as-is, or do they need normalization? (e.g. revenue needs to be adjusted for market size, conversion rate needs same traffic source)'

   Step 5 — Statistical significance check:
   'For each difference: is the sample size large enough to be confident in this difference? State if sample sizes are too small to draw conclusions.'

   Step 6 — Balanced interpretation:
   'Where does A outperform B? Where does B outperform A? Are there metrics where they are effectively equal?'

   Step 7 — Synthesis:
   'Given the complete picture, what is the overall conclusion? On balance, which is better and why? What are the conditions under which this conclusion might reverse?'

2. Common mistakes to guard against (include in the prompt):
   - 'Do not declare an overall winner based on only 1–2 metrics while ignoring others.'
   - 'Do not interpret noise as signal. Differences smaller than X% on samples smaller than N should be treated as inconclusive.'
   - 'Do not use relative changes that obscure absolute differences. Always state both.'

3. Output format:
   - Comparison table: metric | A value | B value | difference | significance | winner
   - Written summary: balanced narrative, 2–3 paragraphs
   - Bottom line: one sentence conclusion with appropriate caveats

Return: the comparative analysis CoT prompt, a sample comparison scenario with data, expected CoT reasoning, and the comparison table output.