← Sottava, jobs the hour they open
Posted 8 mo agoFirst seen 1 mo ago
Member of Technical Staff, Evals Platform
Posted by Sage Care on 18 March 2026, 245 days ago. Still on their Ashby board when we checked 15 min ago. Half of Sage Care's roles come down within 100 days.
What the posting is about
Build systems to analyze and improve AI agents' performance in healthcare. Collaborate with engineers, operations, and product teams. Reduce manual effort and increase agent reliability.
Your experience, ready for this role
Answer a few questions about your real work. Review the additions and download your CV.
Read out of the posting
LevelNot stated
Experience asked5+ years
EmploymentNot stated
LocationHQ (Hybrid)
Work arrangementHybrid
Visa sponsorshipNot stated
SalaryNot extracted, check the posting
Posted2026-03-18
Found viaashby, direct from their system
We saw it 6 months after it went up.
The posting, as the company wrote it
ABOUT SAGE CARE
Sage Care is a fast-growing, early-stage healthcare startup founded by exceptional leaders from Apple, Uber, Carbon Health and backed by top-tier venture capital (General Catalyst, Chelsea Clinton). With a strong customer pipeline, Sage Care is transforming healthcare by simplifying care navigation.
Our platform makes it easier for patients to find the right doctor and helps providers focus on those who need them most through harnessing the latest AI innovations.
Building on our successful collaborations with health systems across the U.S., we have expanded internationally to the MENA region. We are now partnering with health systems there to deploy our AI-powered care navigation platform.
ABOUT THE ROLE
We’re hiring a Software Engineer to build the evaluations platform behind our AI agents. You’ll define how we measure quality, build the systems that make those measurements trustworthy, and turn production failures into improvements.
You’ll work closely with engineering, research, product, and clinical stakeholders. We welcome senior and staff-level engineers; scope will reflect your experience. Healthcare experience is optional.
WHAT YOU’LL DO
- Define metrics and curate datasets that capture quality, task completion, and safety across patient workflows.
- Build the evaluation platform, harnesses, and grading infrastructure to measure agent performance at scale.
- Develop verifiers and LLM-based evaluators for agent actions and outputs, calibrated against expert assessments.
- Analyze production conversations and execution traces, and turn failure modes into regression tests.
- Own the feedback loop from evaluation results to model, prompt, and product improvements.
- Establish evaluation gates that guide whether agent changes ship.
- Build reusable tools that let engineers and domain experts contribute evaluations and act on results.
WHAT WE’RE LOOKING FOR
Required
- 5+ years of software or ML engineering experience shipping production systems.
- You’ve built evaluation platforms or frameworks that other engineers depend on.
- You can design datasets, metrics, and evaluators—and explain why their results are trustworthy.
- Strong backend engineering skills and the ability to own ambiguous problems end to end.
Nice to Have
- Experience with voice AI, agent simulation, or post-training.
- Healthcare experience.
Copied from Sage Care’s own board, not rewritten.
Also open at Sage Care
Why this page exists
We read companies’ own hiring systems every hour, 2,106 of them, and show a job the hour it opens instead of when a job board gets around to indexing it. We saw it 6 months after it went up.
The feed is free. No card, no trial to expire.
A free account and your résumé first, no card