Software Engineer - Data Platform
Used Tools & Technologies
Not specified
Required Skills & Competences
Tag name is followed by "@" symbol and proficiency level value.
About proficiency levels:
- 1-2 β basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 β daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 β you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 β exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Software Development @ 3
Kafka @ 3
Python @ 5
Scala @ 5
Spark @ 3
ETL @ 3
Java @ 5
Flink @ 3
Communication @ 3
Rust @ 5
Hadoop @ 3
- 1-2 β basic awareness. Minimal hands-on experience, and a rudimentary understanding of the technology's purpose;
- 3-6 β daily use. Comfortable and regular usage, capable of handling common tasks and challenges related to the technology;
- 7-9 β you are an expert, you can teach others, you know all the pitfalls and tricks;
- 10 β exceptional knowledge, comprehensive understanding, and adeptness in all aspects of the technology, including advanced problem-solving. Think twice before claiming or demanding such level.
Details
Are you prepared to join the X team and help build the ultimate real-time information-sharing app, revolutionizing how people connect? At X, weβre on a mission to become the trusted global digital public square, committed to protecting freedom of speech and building the future unlimited interactivity. Our goal is to empower every user to freely create and share ideas, fostering open public discourse without barriers. Join us in shaping this thrilling journey where your contribution will be invaluable to our success!
Responsibilities
- Design and develop core functionalities in data ingestion and processing.
- Enhance and optimize Kafka and other transport layer technologies for real-time processing.
- Work closely with other engineers to ensure that our data platform is available, secure, and reliable.
- Uphold service quality throughout the software development lifecycle.
- Drive continuous improvement in our software solutions.
Requirements
We're looking for exceptional engineers who are passionate about our mission and have a strong desire to make a meaningful impact. The ideal candidate will have:
- Minimum 2+ years of backend development experience.
- Proficiency in languages like Java, Scala, Python, Rust.
- Experience in optimizing distributed data processing systems (Spark, Flink, Kafka, Hadoop, Storm) is highly desirable.
- Knowledge of ETL processes and data warehousing.
- Demonstrated experience building data pipelines.
- Independent learning capabilities for new technologies.
- Extremely committed, willing to work in a fast-paced environment.
- Excellent communication and interpersonal skills.
At X, our small but fast-paced team values innovation, creativity, and a strong commitment to our mission. As a Data Platform Software Engineer, you'll have the opportunity to make a significant impact on the future of X and our aspiration to build the Everything App. If you're an exceptional engineer who shares our passion for freedom of speech, weβd love to hear from you.