Models do not "know" things in a traditional database sense. If a model lacks training data on a specific, niche topic, its mathematical probability engine will simply stitch together related concepts that sound correct in context, but are factually wrong.
- • Lack of grounding: The model isn’t connected to a factual database.
- • Ambiguous prompts: The model tries to guess what the user wants.
- • Data bias: The model over-relies on common patterns in its training data.