LLMs Suck at Generating Synthetic Data
LLMs generate each synthetic document that reads fine, yet whole companies fall apart: in EnterpriseRAG, 60% of Slack messages were dated in the future and docs contradicted. Era fixes this by generating the entire company first from a resolved entity graph, then slicing consistent REST/MCP system views (60+ systems). Benchmarking nine models on one rerunnable company showed mean accuracy dropping from 92.6% (simple filtering) to 3.7% (multi-hop), with exact grading.