Data Analysis CoT Prompt AI Prompt

Design a chain-of-thought (CoT) prompt that guides an LLM to analyze a dataset systematically rather than jumping to conclusions.

Without CoT, LLMs often pattern-match to the most likely answer rather than reasoning through the data. CoT forces step-by-step reasoning that catches more errors and produces more reliable analysis.

1. The CoT trigger phrase:
   - End your analysis instruction with: 'Think through this step by step before giving your final answer.'
   - Alternative: 'Before answering, work through your reasoning in a <scratchpad> block.'
   - The scratchpad approach separates reasoning from the final answer, making the output cleaner

2. Analysis CoT structure to enforce:

   Instruct the model to reason through these steps explicitly:

   Step 1 — Understand the question:
   'Restate the analysis question in your own words. What exactly is being asked?'

   Step 2 — Identify what data is needed:
   'What columns, filters, or aggregations are needed to answer this question?'

   Step 3 — Check for data quality issues:
   'Before computing, scan for: missing values in key columns, outliers that could skew results, date range coverage.'

   Step 4 — Compute:
   'Perform the calculation. Show intermediate steps for any non-trivial computation.'

   Step 5 — Sanity check the result:
   'Does this result make intuitive sense? Is it in the expected order of magnitude? If it seems surprising, explain why.'

   Step 6 — Answer the question:
   'State the answer clearly in one sentence. Include the key number and appropriate context.'

3. When to use CoT vs direct prompting:
   - Use CoT for: multi-step calculations, comparisons across multiple groups, trend analysis, root cause questions
   - Use direct prompting for: simple lookups, single-step aggregations, formatting tasks
   - CoT adds tokens (cost and latency) — only use it when reasoning quality matters

4. Zero-shot CoT vs few-shot CoT:
   - Zero-shot: just add 'Think step by step' — works surprisingly well for moderate complexity
   - Few-shot: provide 2–3 complete reasoning examples — significantly better for complex or domain-specific analysis

Return: a zero-shot CoT data analysis prompt, a few-shot version with 2 complete reasoning examples, and a comparison of outputs with and without CoT on a sample analysis question.