Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI
Ansible @ 6
ArgoCD @ 6
Communication @ 6
Compliance @ 4
Debugging @ 4
GPU @ 4
Go @ 6
Kubernetes @ 7
Observability
SRE
Security @ 4
Terraform @ 6
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
SpaceXAI is seeking a highly skilled Senior Infrastructure Engineer to join its US Government Team. The role focuses on designing, building, and operating secure, scalable infrastructure for critical government projects. Responsibilities include developing and managing training and inference clusters and highly reliable applications across bare metal, classified cloud, and hybrid cloud architectures. The role involves working with Kubernetes and GPU hardware to deliver robust, secure systems for large-scale AI workloads while meeting stringent federal compliance requirements.
This is an in-person role based in Palo Alto, California, or Washington, DC, with up to 50% travel required.
Responsibilities
- Develop and optimize software to provision and manage SpaceXAI infrastructure across on-premise, virtual machine, and classified cloud environments.
- Improve the reliability, performance, and cost-effectiveness of infrastructure supporting large-scale AI and application workloads in secure, classified settings.
- Collaborate with SpaceXAI engineers to understand workload requirements and design solutions for government-specific needs and compliance standards.
- Implement observability, monitoring, and security practices to ensure the integrity, availability, and confidentiality of critical systems.
- Manage storage infrastructure using Infrastructure-as-Code tools such as Pulumi, Terraform, or Ansible, with a focus on secure data handling.
- Drive system reliability through incident management, postmortems, and the definition of clear SLAs and SLOs.
Requirements
- Active Top Secret (TS) security clearance.
- At least 5 years of experience as an Infrastructure Engineer, Site Reliability Engineer, or in a similar role, focused on building and maintaining reliable, scalable systems, preferably in secure or government environments.
- Proficiency managing storage infrastructure with Pulumi, Terraform, or Ansible.
- Deep understanding of the Kubernetes stack, including CNI, CRI, CSI, and related components.
- Demonstrated ability to improve system reliability through incident management, postmortems, and defining SLAs and SLOs.
- Excellent communication and documentation skills, including the ability to handle sensitive information concisely and accurately.
Preferred Skills and Experience
- Experience installing and using GPU hardware, including setting up drivers, debugging issues, and ensuring reliability.
- Experience with high-traffic web or mobile application workloads, including optimizing Kubernetes for large-scale deployments in classified or federal settings.
- Familiarity with chaos engineering, capacity planning, or similar resilience practices.
- Proficiency with Kyverno, ArgoCD, or Go programming for infrastructure automation.
- Strong ownership, curiosity, problem-solving skills, and enthusiasm for complex technical challenges in secure environments.
- Certifications in security-related fields, such as CISSP, or experience in secure federal environments.
Compensation and Benefits
- Base salary: $180,000–$440,000 USD per year.
- Equity.
- Comprehensive medical, vision, and dental coverage.
- Access to a 401(k) retirement plan.
- Short- and long-term disability insurance.
- Life insurance, discounts, and other perks.
More jobs at SpaceXAI
Human Data - Business Operations Analyst
SpaceXAI · Palo Alto, United States
USD 122,000-180,000 per year
Program Manager, Harmful Activity
SpaceXAI · New York City, United States, Palo Alto, United States, Bastrop, United States
USD 110,000-145,000 per year
Human Data Manager
SpaceXAI · Palo Alto, United States
USD 100,000-186,000 per year
Analytics Engineer - X
SpaceXAI · Palo Alto, United States
USD 180,000-440,000 per year
Research Analyst
SpaceXAI · United States, New York City, United States
USD 129,600-158,400 per year
Similar jobs
Senior Storage Production Engineer - DGX Cloud
Nvidia · Santa Clara, United States
USD 176,000-333,500 per year
Senior Storage Production Engineer - DGX Cloud
Nvidia · Santa Clara, United States
USD 176,000-333,500 per year
Senior Software Engineer, DGX Cloud Production Engineering
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Senior Engineer System Software, SDN Operations
Nvidia · Santa Clara, United States
USD 184,000-287,500 per year
Senior Systems Software Engineer, Developer Productivity and Cloud Automation - GeForce NOW
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
NCX Senior Engineer
Nvidia · Santa Clara, United States
USD 184,000-356,500 per year
Senior Platform Engineer
Collibra · United States
USD 168,000-210,000 per year
Senior Site Reliability Engineer, GeForce NOW
Nvidia · Santa Clara, United States
USD 168,000-270,200 per year