What do I do when AI invents false information? — answered by Engineer Saeed Baatiah
This is not a fault fixed once but a property of how models work, managed by design. Three effective measures: require the model to answer only from specified documents and to show its source, make it say "I do not know" explicitly instead of guessing when no source is found, and keep human review on any output with financial, legal, or medical consequence. A well-designed system admits ignorance — that is a quality signal, not a weakness.