AI Hallucinations

We tried to recreate Claude’s viral hedge fund demo using IONQ—and the results didn’t hold up. While it summarized the earnings call well, it failed to pull basic financials and ran a flawed DCF with shaky assumptions. The AI analyst hype sounds great, but real-world results still lag.

We tested OpenAI’s new GPT Agent on a real task: calculating our AI SC 15 Index. The result? Fast, accurate, and low-friction. As tools like this improve, startups built on similar workflows may struggle to keep up — a trend we explored in our recent piece on AI’s rapid pace.

What happens when AI systems generate plausible-sounding but completely false information? Welcome to AI hallucinations—fabricated content that's not grounded in context or world knowledge. As AI becomes more sophisticated, distinguishing accurate responses from confident fiction becomes crucial for anyone using these tools.