Software Engineer - Evals

Details

SpaceXAI is seeking a Software Engineer to own and elevate a mission-critical research platform that accelerates frontier AI work. The evals team creates and executes instruments for measuring model capabilities and behaviors. These instruments are used to clean datasets, provide feedback for experiments, and track growth throughout training. The team also diagnoses why agents fail, develops short- and long-term improvements, manages execution infrastructure, and designs datasets and grading schemes.

The role involves designing, building, and shipping high-quality, reliable systems that engineers use every day. The position values attention to detail, first-principles reasoning, strong product judgment, and excellent communication.

Responsibilities

• Own and elevate the mission-critical research platform.
• Design, build, and ship reliable systems for engineering and AI research workflows.
• Create and execute evaluation instruments for measuring model capabilities and behaviors.
• Support dataset cleaning, experiment feedback, and tracking model growth throughout training.
• Diagnose agent failures and develop short- and long-term improvements.
• Manage execution infrastructure.
• Design datasets and grading schemes.
• Translate concepts such as quality, helpfulness, truthfulness, and safety into concrete, measurable criteria.

Requirements

• Software engineering proficiency and at least 3 years of experience actively writing code.
• Track record of shipping high-quality projects and a strong sense of urgency.
• Exceptional product taste and the ability to identify what good output looks like.
• Strong attention to detail.
• Strong communication skills and the ability to share knowledge concisely and accurately.

Bonus Points

• Previously founded a startup or joined a fast-growing early-stage startup.
• Familiarity with AI/ML workflows, annotation tools, or evaluations.
• Experience creating and maintaining component libraries, design systems, or internal tools.

Compensation And Benefits

• Base salary: $175,000–$275,000 USD per year.
• Equity.
• Comprehensive medical, vision, and dental coverage.
• Access to a 401(k) retirement plan.
• Short- and long-term disability insurance.
• Life insurance.
• Various discounts and perks.

SpaceXAI is an equal opportunity employer.