The AI that builds your AI. Now for agents.
Our November product updates bring agent development, Bring Your Own Harness, advanced training, and cost visibility to Oumi.
By Mary Reagan
November 5, 2026
Building an AI agent is easy. Making it reliable, efficient, and continuously improving is hard.
On November 4, we took another step toward automating that work with FAiE (Frontier AI Engineer): the AI engineer that builds and improves your AI.
FAiE automates the complex work of AI engineering, from evaluating performance and identifying failures to synthesizing data, training specialized models, and measuring improvements.
And now, we're extending Oumi's capabilities to complete AI agents, not just individual models.
This release introduces agent development and evaluation, Bring Your Own Harness (BYOH), advanced post-training with DPO and GRPO (private preview), multi-stage training, and greater cost transparency.
Watch the Fall Launch chapters on demand, without a login.
FAiE: Automating AI engineering
Stop manually stitching together evaluations, datasets, training jobs, and experiments. Let FAiE do the heavy lifting.
FAiE brings AI-powered automation to the entire model improvement process:
- Evaluate automatically: Measure performance, uncover failure modes, and identify opportunities for improvement.
- Generate the right training data: Synthesize and curate targeted datasets to address identified weaknesses.
- Train and optimize: Automate training workflows to build specialized models optimized for your tasks.
- Measure and iterate: Compare results, validate improvements, and drive the next optimization cycle.
You define what success looks like. FAiE automates the work to get there.

Build, evaluate, and improve complete AI agents
Oumi now goes beyond optimizing individual models to supporting the agents they power.
- Build agents with tools and environments: Create agents that interact with tools, APIs, and external systems.
- Evaluate real-world agent behavior: Measure multi-turn interactions, tool usage, and task completion.
- Identify what needs improvement: Understand where agents fail and use those insights to improve the models behind them.
Don't just patch your agent's prompts and harness. Improve the intelligence behind it.
Bring Your Own Harness (BYOH)
Already have an agent running in your own framework or infrastructure? Connect it to Oumi without rebuilding it.
Evaluate your agent's behavior while preserving its existing orchestration, tools, memory, and runtime.
Use evaluation results to identify weaknesses and guide improvements to the specialized models powering your agents.
Your harness. Your tools. Your runtime. Oumi's AI engineering.
Advanced post-training: DPO and GRPO
Give FAiE and your team more powerful ways to improve specialized models.
- Direct Preference Optimization (DPO), generally available: Train models to reflect your preferred outputs and quality requirements.
- Group Relative Policy Optimization (GRPO), private preview: Use reinforcement learning and task-based rewards to optimize model behavior, including the models behind AI agents. Contact us to request access.
- Multi-stage training: Combine multiple optimization methods into sequential training workflows.
Go beyond prompt engineering. Train models to actually improve at the tasks your business cares about.
Greater visibility into AI development costs
Building specialized AI should be measurable and cost-efficient.
- Detailed cost breakdowns: Understand spending across data synthesis, evaluations, and model training.
- Upfront estimates: Preview costs before launching data synthesis or evaluation jobs.
Experiment with confidence and make informed decisions about AI quality and cost.
Build your AI. Let FAiE do the engineering.
The future of AI development isn't more manual experimentation. It's AI engineering increasingly automated by AI itself.
With FAiE, Oumi brings together evaluation, data synthesis, training, inference, and continuous improvement to help enterprises build specialized intelligence that gets better over time.
You define the task. You own the intelligence. FAiE does the engineering.
A side quest for your next break
Robin and Vlad turned the Oumi workflow into an 8-bit adventure. Oumi Quest walks you through defining a task, evaluating a baseline, generating training data, training, deploying, and learning from failures. Quest scrolls and swords included.

From #all-random: a peek inside neural networks
Jeremy's building interactive ML tutorials, the kind he wishes he'd had when starting out. This sneak peek shows how two linear layers transform an input, with the network and its geometry side by side. Step through the math and see what changes.

Enjoy the launch. And the side quest.

