Systems Test Engineer, End-to-End Validation | Consumer Devices
Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
AI
Debugging @ 6
Manual Testing @ 3
Python @ 3
QA @ 3
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
OpenAI Consumer Devices is building the next generation of products that bring powerful AI into people’s everyday lives. The Systems Integration team validates complete device experiences across software, cloud services, connectivity, accessories, and real-world operating environments through hands-on system testing, structured test development, hardware-in-the-loop environments, diagnostics, and automation.
As a Systems Test Engineer, End-to-End Validation, you will design and execute end-to-end testing for complex device experiences spanning hardware, software, connectivity, cloud services, and accessories. You will translate product behavior and real-world use cases into structured, reproducible test procedures and build test environments that allow failures to be reliably reproduced and diagnosed. You will also identify opportunities to automate repetitive or high-value scenarios and help establish the end-to-end validation foundation from prototype through launch.
Responsibilities
- Develop structured test plans and reproducible procedures for user journeys, realistic usage patterns, edge cases, degraded conditions, and failure scenarios across devices, services, connectivity, and accessories.
- Maintain complex test environments involving devices, servers, networks, accounts, peripherals, accessories, and controlled environmental conditions.
- Prepare devices and environments for release validation, execute test campaigns, track results, and communicate risks and blocking issues.
- Reproduce complex failures, isolate contributing components, collect logs and telemetry, and provide clear reproduction steps and supporting evidence.
- Identify repeatable manual workflows that benefit from automation and develop or partner on tooling for device control, setup, measurement, data collection, and test execution.
- Convert field issues, production failures, and previously discovered bugs into repeatable regression tests and maintain coverage across product releases.
- Work with embedded, systems, cloud, hardware, QA, and product teams to understand system behavior, improve testability, and close validation gaps.
Requirements
- Experience with system-level, integration, end-to-end, or validation testing for complex hardware-software products.
- Ability to translate loosely defined product behavior into clear, repeatable, and measurable test procedures.
- Experience testing systems spanning devices, networks, backend services, mobile applications, or connected accessories.
- Strong hands-on debugging skills and the ability to isolate failures across hardware, firmware, software, connectivity, and cloud services.
- Familiarity with logs, diagnostics, command-line tools, network tools, and device configuration utilities.
- Experience automating tests or test setups using Python or similar scripting tools, while recognizing when manual testing provides better coverage.
- Understanding of reliable test environments, including controlled setup, configuration, preconditions, expected results, and recovery procedures.
- Ability to work across engineering disciplines and communicate complex failures with clear evidence and reproducible steps.
Work Arrangement
This role is based in San Francisco, California, and uses a hybrid work model requiring four days in the office per week.
Benefits
- Medical, dental, and vision insurance with employer contributions to Health Savings Accounts.
- Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses.
- 401(k) retirement plan with employer match.
- Paid parental, medical, and caregiver leave.
- Paid time off, paid company holidays, office closures, and paid sick or safe time as applicable.
- Mental health and wellness support.
- Employer-paid basic life and disability coverage.
- Annual learning and development stipend.
- Daily office meals and eligible meal delivery credits.
- Relocation support for eligible employees.
- Equity and performance-related bonuses may be available for eligible employees.
OpenAI is an equal opportunity employer committed to reasonable accommodations and to ensuring that general-purpose artificial intelligence benefits all of humanity.