Originally Posted by
HDQDD
The more I use AI, the more I've learned that it's fairly easy to get rid of hallucinations by having better context and prompting. PRD files, <agent>.MD files, relevant tools, TODO lists and setting "memory"s within the agent can almost eliminate hallucinations. The biggest mistake I see our new coders making is feeding in too much context to solve a problem.... i.e. sending in a 200 page PDF, when the relevant section is all on two pages. It's a bit like lawyers burying the other side's lawyers with irrelevant information during discovery.
Unfortunately that hasn't been my experience. I've asked some straightforward questions and the AIs I have access too often get it wrong. I mean "Provide me with the URL from Microsoft describing what event ID 4825 is" (as an example) often provides me with links to reddit and other sites rather than learn.microsoft.com. If I were asking for the AI to explain to me what event ID 4825 means, sure, that might make sense, but I'm just asking for the source material so I can figure it out how it fits into my investigation (BTW, no clue what event ID 4825 is, just used it as an example)
If the AI can't answer questions on publicly available information, I'm not going to trust it with private, confidential information.