Skip to content

Reading / 2026-06/2026-06-04t194244-inside-openais-in-house-data-agent

Inside OpenAI's In-House Data Agent

OpenAI built an internal AI data agent powered by GPT-5 and Codex that lets employees query 600+ petabytes across 70k datasets in natural language, using layered context—schema metadata, human annotations, code enrichment, institutional docs, and self-improving memory—to produce accurate, audited analytics.

Jun 04, 2026 · tech · Bonnie Xu, Aravind Suresh, and Emma Tang, OpenAI

Read at the source →

Topics

  • ai-agents
  • retrieval-augmented-generation
  • llm-engineering
  • agentic-workflows
  • context-engineering

Cited by

  • Agentic workflows

    Systems where AI agents execute multi-step tasks autonomously, raising interconnected questions about harness architecture, state management, reliability engineering, human oversight, and the organizational context those agents operate within.

  • AI agents

    Autonomous systems that plan, act, and verify across tool calls and multi-step workflows, with active debate over architecture choices, coordination costs, memory design, state management, and the governance infrastructure needed to make them reliable.

  • Context engineering

    Context engineering is the practice of deliberately constructing what an LLM receives in its context window — structuring, compressing, persisting, and retrieving information so agents produce reliable output across tasks and sessions.

  • LLM engineering

    LLM engineering spans the full stack of building with large language models: training, inference optimization, agent architecture, harness design, and the operational tradeoffs that determine whether model capability translates into reliable software.

  • Retrieval-augmented generation

    RAG grounds LLM outputs in external knowledge at inference time; recent work questions when vector similarity retrieval is the right tool and what alternatives — hierarchical indexing, KV caching, compiled wikis — better serve different workloads.

Related

back to /reading