Q&A

How do I stop AI from making up facts?

Short answer

AI hallucinations (made-up facts) drop dramatically with five moves: give the model an 'admit uncertainty' instruction, ground it in source documents you upload, force structured outputs that are easier to verify, use search-augmented models for time-sensitive facts, and always verify any specific number or name before publishing. Combined, these cut hallucination from common to rare.

Short answer

Five moves cut AI hallucination from common to rare: (1) tell the model to admit uncertainty, (2) ground it in a source document you upload, (3) force structured output that’s easier to verify, (4) use search-augmented mode for time-sensitive facts, (5) verify any specific number or name before publishing. Combine these and your fabrication rate drops below 1%.

The five moves in detail

Move 1: Add the “admit uncertainty” instruction

Single line at the start of your prompt:

If you don’t have enough information to answer confidently, ask me a specific follow-up question rather than guessing. Don’t invent statistics, dates, names or quotes.

This works. Both Claude and ChatGPT are tuned to follow it. Costs nothing.

Move 2: Ground in a source document

Don’t ask “what does Australian Consumer Law say about refunds?”. Upload the actual ACL text and ask “based on the document I uploaded, what does it say about refunds?”.

The AI then quotes the document. Hallucination rates drop close to zero because the model is constrained to what’s actually there.

This is the single highest-use move for any business-critical AI work. It’s why we use Claude Projects + Custom GPTs with knowledge files for repeated workflows.

Move 3: Force structured output

Free-form prose gives the AI room to fabricate. Structured output (JSON, tables, lists) forces explicit field-by-field answers that are easier to verify.

Bad:

Summarise the financial position of this company.

Better:

Return a JSON object with these fields:

  • revenue (number, AUD): only fill if a specific number is in the source
  • revenue_year (integer): only fill if specified
  • profit_margin (number): only fill if specified
  • notes (string): any caveats

For any field where the source doesn’t give a specific number, use null. Do not estimate or fabricate.

Source: [paste]

Forcing the schema makes fabrication visible.

Move 4: Use search-augmented mode for time-sensitive facts

Both ChatGPT and Claude have web search modes. For anything recent (current pricing, news, product releases, current personnel), enable search. The model fetches a real source and grounds its answer.

In ChatGPT this is on by default in 2026. In Claude.ai click the web icon. In Claude Code use the WebSearch tool.

Without search, the model’s training data has a cutoff and it’ll fabricate to fill the gap.

Move 5: Verify before publishing

The hard truth: even with all four moves above, you should still verify any specific number or name before publishing. AI is a draft tool, not a research tool. The verification step takes 30 seconds and is the difference between embarrassment and trust.

Build a checklist for your editorial workflow:

  • Every statistic has a source link?
  • Every person/company named is real and accurately described?
  • Every quote is from a real source?
  • Every date is correct?

For client-facing work, run this before publishing. Always.

The risk categories ranked

From highest to lowest hallucination risk:

Content typeRisk
Specific statistics (“65% of Australians…”)Very high
Citations to academic papers / studiesVery high
Specific dates of historical eventsHigh
Specific quotes (“As X said in 2024…”)High
Specific product features that don’t existMedium
General factual claimsMedium
Conceptual explanationsLow
Creative writingNone (by definition)
Code that compilesLow (you can test it)

Treat the top four with extreme suspicion. Verify everything.

The Australian-specific gotcha

AI models are largely trained on US data. They confidently make up Australian-specific facts: ABN numbers, ATO references, AUD amounts, Australian addresses, AHPRA rules.

For Australian content, source-ground harder. Upload actual ATO documentation, actual ASIC rules, actual current pricing. Don’t trust the model’s training-data knowledge of Australia.

See also

Want this built for your business?

Book a free 30-minute AI audit. We'll map your business and show you exactly which systems we'd build first. No pitch deck, no scoping fee.

Book my free AI audit