AI-enhanced for better readability
ARTIFICIAL ANALYSIS | MTS, Forward Deployed Engineer + more
Location: San Francisco, CA (ON-SITE, 5 days) or Melbourne, Australia (ON-SITE, 3 days) Employment Type: Full-time Source: Hacker News Apply: https://artificialanalysis.ai/careers
About the Company
We're an independent AI benchmarking company. We benchmark language models, inference providers, hardware, image/video and speech, and our Intelligence Index is widely cited when new models launch. We are a team of ~50, backed by Nat Friedman, Daniel Gross, Andrew Ng and others.
The people who build our evals also work directly with the AI labs, often on pre-release models. We maintain a flat structure with lots of ownership.
Main Hiring Needs
- Forward Deployed Engineer (FDE), Language Models: Run our LLM benchmarking stack and work directly with the labs.
- Member of Technical Staff (MTS), Language Model Evaluations: Build frontier evals (datasets, harnesses, benchmarks).
- MTS, Inference: Benchmark speed, quality and price across server-less inference providers.
- MTS, Hardware: Benchmark GPUs, TPUs and custom silicon.
- MTS, Speech: Own our TTS, STT and speech-to-speech evals.
Additional Roles
We are also hiring for:
- Media generation
- Full stack
- ML engineering
- Robotics
- Product roles
How to Apply
Apply at https://artificialanalysis.ai/careers.