Tech Stack
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Airflow @ 3
BI
CI/CD @ 3
Communication @ 3
Flink @ 3
Go @ 5
Java @ 5
Kubernetes @ 3
Leadership @ 3
Machine Learning
Python @ 5
Scala @ 5
Spark @ 3
- 1-2 — basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 — daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 — you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 — exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Reddit's Data Movement team is seeking a Software Engineer to solve large-scale data platform and efficiency challenges. The team supports data infrastructure used for batch and streaming machine learning and business intelligence workloads. Reddit's community generates more than 100 billion events per day, which are ingested into a data warehouse supporting more than 55,000 daily queries.
The Data Movement team empowers the business to process data more efficiently and orchestrates data workloads. You will work with teammates and partner teams to create and improve scalable, fault-tolerant, self-service systems.
Responsibilities
- Refine and maintain data infrastructure technologies supporting machine learning and analytics workflows based on data collected from hundreds of millions of users.
- Own the Data Movement Platform used to enable batch and stream data processing at Reddit.
- Build new infrastructure for Spark, Flink, and Airflow, including contributing to the open-source community as needed.
- Build automated solutions to minimize toil for data users and provide a declarative, self-service experience for working with data.
- Collaborate with teammates on on-call responsibilities, monitoring, and alerting.
- Improve the reliability, scalability, latency, and efficiency of Reddit's Data Platform.
Requirements
- 2+ years of software engineering experience in a production setting, writing clean, maintainable, and well-tested code.
- Proficiency in object-oriented programming languages such as Python, Scala, Go, or Java.
- Demonstrated expertise in designing and implementing large-scale systems.
- Ability to monitor project progress and demonstrate proactive leadership as a self-starter on diverse projects.
- Experience with cloud services, Airflow, Kubernetes, CI/CD, Spark, Flink, and/or modern cloud-based infrastructure.
- Excellent communication skills for effective collaboration within a service-oriented team and across the broader organization.
Benefits
- Comprehensive healthcare benefits and income replacement programs.
- 401(k) with employer match.
- Global benefits programs supporting workspace, professional development, and caregiving.
- Family planning support.
- Gender-affirming care.
- Mental health and coaching benefits.
- Flexible vacation and paid volunteer time off.
- Generous paid parental leave.
Compensation
The base salary range is $164,200–$229,900 USD. The position is also eligible for equity in the form of restricted stock units and, depending on the position offered, may be eligible for commission. Final offer amounts are determined by factors including skills, depth of work experience, and relevant licenses or credentials.