Reading / 2026-06/2026-06-04t194244-inside-openais-in-house-data-agent
Inside OpenAI's In-House Data Agent
OpenAI built an internal AI data agent powered by GPT-5 and Codex that lets employees query 600+ petabytes across 70k datasets in natural language, using layered context—schema metadata, human annotations, code enrichment, institutional docs, and self-improving memory—to produce accurate, audited analytics.
Jun 04, 2026 · tech · Bonnie Xu, Aravind Suresh, and Emma Tang, OpenAI
Topics
- ai-agents
- retrieval-augmented-generation
- llm-engineering
- agentic-workflows
- context-engineering
Cited by
- Agentic workflows
Systems where AI agents execute multi-step tasks autonomously, raising interconnected questions about harness architecture, state management, reliability engineering, human oversight, and the organizational context those agents operate within.
- AI agents
Autonomous systems that plan, act, and verify across tool calls and multi-step workflows, with active debate over architecture choices, coordination costs, memory design, state management, and the governance infrastructure needed to make them reliable.
- Context engineering
Context engineering is the practice of deliberately constructing what an LLM receives in its context window — structuring, compressing, persisting, and retrieving information so agents produce reliable output across tasks and sessions.
- LLM engineering
LLM engineering spans the full stack of building with large language models: training, inference optimization, agent architecture, harness design, and the operational tradeoffs that determine whether model capability translates into reliable software.
- Retrieval-augmented generation
RAG grounds LLM outputs in external knowledge at inference time; recent work questions when vector similarity retrieval is the right tool and what alternatives — hierarchical indexing, KV caching, compiled wikis — better serve different workloads.
Related
- Your agent loves MCP as much as you love GUIstopic
- Unslothtopic
- The Orchestrator Isn't Your Moattopic
- databricks-solutions/ai-dev-kittopic
- Scaling Managed Agents: Decoupling the Brain from the Handstopic
- Don't Prompt Your Agent for Reliability — Engineer Ittopic
- Agentic Coding is a Traptopic
- Vibe Training: Auto Train a Small Language Model for Your Use Casetopic