Companies

Understudy Labs

understudylabs.com

Open-source toolkit that captures production LLM traces, evaluates cheaper models, and ships specialist routes customers own.

HQSan Francisco, California, United States
Employees1-50
Jobs checked 21h ago
AI / MLAI InfrastructureOpen Source

About

Understudy Labs builds an open-source toolkit and optimization workflow that captures production LLM traces, turns expert judgment into evaluations, and trains or fine-tunes specialist models and routes that customers own. It targets teams running repeated production LLM workflows where cost or latency is painful, differentiating through local-first operation, optional cloud scaling, and deployment only after candidates beat held-out evaluations.

Market

Understudy competes in LLM application infrastructure, specifically production-workflow optimization, model routing, evaluation, and distillation for teams trying to reduce the cost and latency of frontier-model usage. It positions itself as a local-first, open-weight alternative that captures real production traces and expert review, trains specialist models teams own, and shifts traffic only after task-specific quality thresholds are met. Its differentiation versus observability/evaluation tools and generic AI gateways is closing the loop from trace capture through owned model training and deployment while keeping hosted infrastructure optional.

Target Customers

Primary customers are data-rich software engineering and product teams operating repetitive production LLM workflows where cost or latency is becoming painful. Likely buyers are engineering, AI-platform, or product owners working with domain experts who can judge quality but are not ML specialists; the company is currently working with a small private-preview design-partner group.

At a Glance

Problem

Understudy addresses the production cost, latency, and dependency problems that arise when companies rely on expensive general-purpose frontier LLMs for repetitive work. As usage scales, teams pay someone else’s model prices and remain exposed to that provider’s roadmap, while replacing the model can cause silent quality regressions. The clearest use case is a data-rich team running high-volume agent workflows—such as sales and CRM actions—where domain experts know what a good result looks like but do not have the ML resources to build a cheaper alternative. In Understudy’s AutomationBench results, tuned open models scored above Sonnet on both reasoning-heavy and action tasks at 18% and 25% of the cost, respectively.

Product / Service

Understudy is an open-source toolkit and LLM gateway that captures production traces from existing agent workflows, evaluates alternative models against a task-specific quality benchmark, fine-tunes an open-weight successor, and deploys it only after it clears a held-out evaluation. The workflow can be installed inside coding agents and run locally, with hosted infrastructure optional; teams retain control of their prompts and model weights and can serve the resulting model wherever they choose.

The product is designed as a continuous optimization loop rather than a one-time model swap. Production data feeds back into training, while routing and gradual traffic migration let a team keep its incumbent provider in place until the cheaper route proves itself. The intended benefit is a specialist model that delivers comparable or better task quality with materially lower cost and latency, while reducing dependence on frontier-model vendors.

Market

Understudy competes in AI infrastructure and LLMOps, specifically the emerging market for production model optimization, evaluation, routing, distillation, and migration from hosted frontier APIs to owned open-weight models. Its adjacent alternatives include LangSmith and PromptLayer for production tracing, DSPy for automated model or prompt optimization, and TensorZero for an open-source gateway combining observability, optimization, and evaluation. Teams can also simply remain on their existing frontier API, which Understudy characterizes as the most basic competitive alternative.

The company appears to be at an early commercialization stage rather than having demonstrated mature revenue traction. Y Combinator lists Understudy Labs as an active Summer 2026 company, while the company’s own site says it is in private preview with a small group of design partners and is working closely with each team on installation, trace capture, and its first replacement model. The evidence reviewed does not disclose revenue or a customer count, so the best-supported characterization is private-preview and potentially pre-revenue, with early design-partner validation rather than publicly established scale.

Founders & Leadership

Luis ManriqueFounder
Co-founder & CEO
Aamir PoonawallaFounder
Co-founder & CTO

Funding History

2026-06
Seed$125k

Y Combinator

Recent News

2026-07-15product
Understudy Labs describes company-specific AI models 100x smaller than frontier models

In a post on its official X account, Understudy Labs said it trains company-specific AI models that are 100x smaller than frontier models, using work already performed by employees and agents.

2026-07-10
Understudy Labs joins Y Combinator Summer 2026

Y Combinator lists Understudy Labs as an active Summer 2026 company. Its open-source toolkit captures traces from production LLM workflows, evaluates cheaper models against benchmarks, and helps teams train and deploy specialist routes they own.

2026-05-23
Meet the Understudy founders

Understudy Labs’ team page introduced its founders and described the company as building tools that let domain experts turn production traces and feedback into specialist open models.

Active Roles

0

No active roles right now.

Get notified when they post

Business Model

Understudy is commercializing an early-access service in which customers may purchase paid hosted or tooling services through order forms, invoices, checkout pages, or written agreements. Its current BYO model requires customers to bring their own upstream model accounts and API keys and pay upstream provider charges themselves; hosted infrastructure is optional.

Products

Understudy Gateway/API: an OpenAI- and Anthropic-compatible gateway that captures traffic and routes portions of workloads to managed smaller modelsOpen-source Understudy Agent Tools and CLI for local workload evaluation, optimization, model comparison, and routingTrace-to-model optimization workflow covering capture, benchmark creation, fine-tuning/distillation, deployment, and continuous feedbackUnderstudy hosted control plane and dashboard for keys, projects, workloads, capture inspection, model catalog, and routing controlsUnderstudy Desktop for local model downloads, trained-model runs, and portable task classifiers

Customers

Unnamed design partners only; no customer names or logos are publicly disclosed

Tech Stack

Large language models and open-weight modelsOpenAI- and Anthropic-compatible API gateway/proxyProduction trace capture, evaluation, benchmarking, and A/B testingModel routing, traffic splitting, passthrough, and rollbackFine-tuning, model distillation, GEPA/DSPy prompt optimization, and recursive-language-model trainingMIT-licensed, local-first TypeScript CLI and agent-tool skillsLocal model and desktop runtime with optional cloud-hosted training and servingRelational control-plane store with hot-path caching

Competitors

OpenAI Model Distillation
Braintrust
Langfuse
Portkey
LiteLLM
Skan AI