Member of Technical Staff - Mid-Training

Details

SpaceXAI is seeking a hands-on technical team member to help develop AI systems and advance large-scale model training. The role focuses on scaling synthetic coding data, distilling intelligence into flash models, optimizing mid-training data mixtures, engineering long-context data recipes, and evaluating mid-training checkpoints.

Responsibilities

• Scale synthetic coding data to trillions of tokens using large-scale Docker verification.
• Distill the intelligence of flagship models into flash models through synthetic data generation.
• Optimize mid-training data mixtures to increase the ceiling for reinforcement learning.
• Engineer long-context data recipes.
• Develop robust and diverse evaluations for mid-training checkpoints.

Requirements

• Expertise in machine learning and large-model scaling, with familiarity across various scaling laws.
• Strong ability to design machine-learning experiments.
• Familiarity with state-of-the-art techniques for curating AI training data across text, image, audio, and video modalities.
• Strong engineering abilities with Spark, Ray, and other frameworks for large-scale data processing.
• Strong communication, prioritization, and knowledge-sharing skills.

Compensation and Benefits

• Base salary of $180,000–$440,000 USD per year.
• Equity.
• Comprehensive medical, vision, and dental coverage.
• Access to a 401(k) retirement plan.
• Short- and long-term disability insurance.
• Life insurance and various other discounts and perks.