Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI @ 7
API @ 7
AWS
Agentic Systems
Azure
CUDA @ 3
Communication @ 7
Docker @ 6
FastAPI
Flask
GPU
Git @ 6
IaaS
Kubernetes @ 6
LLM @ 7
LangChain @ 4
Machine Learning
Planning @ 4
Python @ 7
RAG @ 7
SGLang @ 4
TensorRT @ 4
Vector Databases @ 7
vLLM @ 4
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Nebius is building a full-stack AI cloud platform supporting data and model training through production deployment. The Forward Deployed Engineer, Ecosystem sits at the intersection of solution architecture and hands-on engineering, assessing partner products on the Nebius stack, defining reference architectures, building production-quality prototypes, and translating integration findings into product requirements.
Responsibilities
Solutioning and Architecture
- Design and prototype technically sound integrations between partner products and the Nebius platform.
- Define reference architectures for partner integrations that work at scale and in production.
- Scope partner architectures against the Nebius stack, identifying integration points and limitations.
- Build proof-of-concepts across agentic pipelines, RAG architectures, inference optimization, and multi-model orchestration.
- Maintain a library of reference architectures and integration patterns.
Technical Partner Scoping
- Work directly with partner engineering teams to scope, prototype, and progress integrations.
- Assess partner architectures and report integration feasibility and complexity.
- Provide technical guidance on performance, reliability, and cost efficiency on Nebius infrastructure.
- Produce technical scoping for partners and internal teams.
Internal Collaboration
- Translate integration findings into actionable product requirements.
- Work with ISV partners, systems integrator teams, and field teams to scale solution adoption.
- Surface architectural patterns and integration gaps to inform the platform roadmap.
- Participate in platform planning as the technical voice of field experience.
Ecosystem Presence
- Represent Nebius at hackathons, open-source communities, and technical events.
- Build public demos, reference architectures, and integrations.
- Stay current with the AI tooling ecosystem.
Platform Focus Areas
- Agentic systems: agent frameworks, memory systems, tool integration, orchestration, MCP, and guardrails.
- Managed inference: inference runtimes, model serving, optimization tooling, speculative decoding, and KV-cache routing.
- IaaS and managed infrastructure: cloud-native integrations, GPU orchestration, and enterprise platform connectors.
- Data: vector databases, retrieval systems, RAG architectures, data pipeline integrations, and synthetic data tooling.
Requirements
- 6+ years of hands-on engineering experience in AI application development, ML systems, or AI infrastructure.
- Deep working knowledge of LLM APIs, inference runtimes, orchestration frameworks, vector databases, RAG architectures, and agentic pipelines.
- Hands-on experience with LangChain, LangGraph, CrewAI, AutoGen, or equivalent agentic frameworks.
- Strong Python programming skills and the ability to prototype end-to-end AI systems quickly.
- Experience defining reference architectures and technical patterns.
- Proven ability to move from an idea to a working prototype under time pressure.
- Experience building integrations across APIs and developer platforms.
- Ability to work with external partner engineering teams and internal product and engineering teams.
- Strong technical communication skills.
Additional Qualifications
- Experience with vLLM, SGLang, TensorRT-LLM, speculative decoding, quantization, batching, or KV-cache routing.
- Familiarity with NVIDIA CUDA, TensorRT, NeMo, or equivalent.
- Experience with multimodal AI models.
- AI hackathon participation or success.
- Experience as a developer advocate, solutions engineer, or technical partner manager at an AI platform or developer tooling company.
- Early engineering experience at an AI startup.
- Open-source projects or public demos with meaningful community adoption.
- Proficiency with Docker, Kubernetes, and Git.
Preferred Technical Stack
- Python
- vLLM, SGLang, TensorRT-LLM, Transformers, OpenAI SDKs, and Anthropic SDKs
- LangChain, LangGraph, CrewAI, AutoGen, and smolagents
- Qdrant, Weaviate, Milvus, and pgvector
- FastAPI and Flask
- Kubernetes, Docker, and Git
- AWS, Google Cloud Platform, and Microsoft Azure
Benefits
- 100% company-paid medical, dental, and vision coverage for employees and families.
- 401(k) plan with up to a 4% company match and immediate vesting.
- 20 weeks of paid parental leave for primary caregivers and 12 weeks for secondary caregivers.
- Up to $85 per month for mobile and internet expenses.
- Company-paid short-term, long-term, and life insurance.
- Career growth and learning opportunities, flexibility and ownership, and the opportunity to work on impactful AI projects.
- Applicants must be authorized to work in the country in which they apply and must provide proof of employment eligibility.
More jobs at Nebius
Forward Deployment Engineering Manager
Nebius · United States
USD 225,800-281,000 per year
IT Risk & Controls Manager
Nebius · United States
USD 120,000-180,000 per year
IT Infrastructure Engineer – RMA & Hardware Diagnostics
Nebius · Kansas City, United States
USD 112,700-140,800 per year
Senior Machine Learning Engineer, Model Training and Reinforcement Learning
Nebius · Palo Alto, United States
USD 195,200-262,200 per year
Senior Machine Learning Engineer, LLM Inference Optimization
Nebius · Palo Alto, United States
USD 195,200-262,200 per year
Similar jobs
ML Solution Architect (Early Talent)
Nebius · United States
USD 102-126 per hour
Senior Sales Engineer - Token Factory
Nebius · United States
USD 180,000-225,000 per year
Principal ML Solutions Architect - Token Factory
Nebius · United States
USD 208,000-261,000 per year
Senior ML Solutions Architect - Token Factory
Nebius · United States
USD 210,000-260,000 per year
Senior Software Engineer, AI Inference Systems
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Senior Software Engineer, DGX Cloud Orchestration
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Senior Technical Marketing Engineer, Enterprise AI Software
Nvidia · Santa Clara, United States
USD 200,000-322,000 per year
Principal Software Engineer - DGX Cloud
Nvidia · Santa Clara, United States
USD 272,000-431,200 per year