Machine Learning Engineer
Job Description
Arena Intelligence, Inc. is building real-world AI evaluation that scales with confidence. In this onsite role in the San Francisco Bay Area, CA, you will help strengthen the infrastructure behind model benchmarking systems, from data pipelines through inference APIs and evaluation methodologies.
This is a small, mission-driven team focused on shipping quality products. You will work at the intersection of research and engineering, turning ideas into reliable systems while contributing to a culture grounded in transparency, trust, and community impact.
What you will do
- Architect and build foundational modeling capabilities for data and evaluation products.
- Own end-to-end pipelines across data, model training, and evaluation.
- Contribute to a feedback-driven workflow that supports rapid product iteration as new features are built by a tight-knit team.
- Conduct research into state-of-the-art evaluation methods and support the long-term vision for a centralized, scalable evaluation platform.
What you bring
- Strong programming skills with the ability to work across the stack in a typical recommendation system or LLM stack.
- Deep learning experience, including language models or reward model training.
- Practical experience working with LLMs for fine-tuning, prompt engineering, and function calling.
- Self-motivation and willingness to take ownership of tasks.
- Passion for shipping quality products.
- Solid understanding of statistics and evaluation approaches for uncertainty that are tailored to the specific product being shipped.
How the work will make an impact
- Scale and strengthen the core infrastructure powering real-world AI evaluation.
- Shape how model benchmarking systems are built, deployed, and improved, including work across data pipelines, inference APIs, and emerging evaluation methodologies.
- Partner with researchers, engineers, and product leadership to translate new ideas into dependable systems.
- Improve reproducibility, support scaling to new modalities, and deepen the ability to understand and compare frontier models.
Benefits
- Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.
- Opportunity to work on cutting-edge AI with a small, mission-driven team.
- A culture that emphasizes transparency, trust, and community impact.
Experience level: 4+ years.
Compensation: Competitive compensation aligned to the markets where team members are based. The compensation range is listed on the posting and depends on experience and work location.