LLMs will lead you astray

Unlike hallucinations, which introduce false-hoods, sycophancy is a bias in the selection of the data people see. When AI systems are trained to be helpful, they may inadvertently prioritize data that validates the user’s narrative over data that gets them closer to the truth.
A study from Princeton about the “delusion-like states” facilitated by AI, quoted here by Gary Marcus#artificial-intelligence