Used Tools & Technologies
Not specified
Required Skills & Competences
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Python @ 5
Spark @ 5
Algorithms @ 3
Machine Learning @ 3
Communication @ 6
Prioritization @ 6
Rust @ 5
Debugging @ 3
PyTorch @ 5
AI @ 6
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
As a multimodal engineer on the Imagine Model Team, you will develop cutting-edge AI experiences beyond text with a strong focus on enabling high-fidelity understanding and generation across image and video modalities, and incorporating audio where it enhances visual content. Responsibilities span data curation, modeling, training, inference serving, and product integration, covering both pretraining and post-training phases. You will collaborate closely with product teams to push model frontiers and deliver exceptional end-to-end user experiences.
Responsibilities
- Create and drive engineering agendas to advance multimodal capabilities, with emphasis on image and video generation, editing, understanding, controllable/long-horizon synthesis, agentic planning, RL training, and world simulation (including audio integration for richer video experiences).
- Improve data quality through annotation, filtering, augmentation, synthetic generation, captioning, and in-depth data studies, particularly for visual and audio data.
- Design evaluation frameworks, metrics, benchmarks, evals, and reward models tailored to image/video/audio quality and coherence.
- Implement efficient algorithms for state-of-the-art model performance, including real-time inference, distillation, and scalable serving for visual content.
- Develop scalable data collection and processing pipelines for multimodal (primarily image/video-focused) datasets.
- Collaborate cross-functionally to integrate AI solutions into production and rapidly iterate based on user feedback.
Requirements (Basic Qualifications)
- Track record in leading studies that significantly improve neural network capabilities and performance through better data or modeling.
- Experience in data-driven experiment designs, systematic analysis, and iterative model debugging.
- Experience developing or working with large-scale distributed machine learning systems.
- Ability to deliver optimal end-to-end user experiences.
- Hands-on contributor with initiative, excellence, strong work ethic, prioritization skills, and excellent communication.
Preferred Skills and Experience
- Experience in SFT, RL, evals, human/synthetic data collection, or agentic systems.
- Proficiency in Python, JAX/XLA, PyTorch, Rust/C++, Spark, Ray, and related large-scale frameworks.
- Domain expertise in multimodal applications such as graphics engines, rendering techniques, image/video understanding and generation, world models, real-time simulation, or controllable/long-horizon visual content creation (audio/speech processing or music/audio generation experience is a plus where it supports video).
- Experience with agentic RL training, controllable/long-horizon generation, or multimodal agents that reason and act across modalities (especially in visual domains).
Compensation and Benefits
- Base salary: $180,000 - $440,000 USD
- Total rewards package includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.