Company signals
Score: 65
Missing required salary
0%
Stale listings
0%
New cities (90d)
1
Buzzword-heavy listings
0%
Wide pay-band rate
17%
Growth-mode language
0%
SEC Form D filed
never
Wikipedia
No
Job facts
- Location
- San Francisco, California, United States of America
- Type
- Full-time
- Salary
- $200K – $300K
Last verified live 2 days, 18 hours ago · checked directly on the company's Y Combinator Work at a Startup
Applications powered by
Y Combinator Work at a Startup
More roles at Jarmin AI
- Member of Technical Staff (Product) · San Francisco, CA, US
- Member of Technical Staff (Agent Infrastructure) · San Francisco, CA, US
- Member of Technical Staff (Models) · San Francisco, CA, US
- Founding Sales - Account Executive · San Francisco, CA, US / Remote (US)
- Member of Technical Staff · San Francisco, CA, US
- Member of Technical Staff (Agents) · San Francisco, CA, US
Member of Technical Staff (Evals)
at Jarmin AI
As a Member of Technical Staff on Evals, you'll own how we measure AI Employee performance on the job.
Areas you may work in:
- Evaluation systems: datasets, offline replay, scorers, and regression alerts
- Feedback loops for models and agents
- Autonomous failure analysis
- Defining what good, degraded, and failed runs look like, and alerting on them
You may be a good fit if you:
- Have built evaluation or measurement systems, such as AI evals, experimentation, ranking, or search quality
- Can turn ambiguous quality questions into concrete metrics and decisions
- Have strong software engineering fundamentals and ship production systems
- Are comfortable where there are few established patterns
- Want to work in person in San Francisco
Even better:
- You've shipped LLM systems to production and learned where they break
- You have strong data instincts and work well with researchers
- You contribute to open source projects