We are seeking a skilled Data Engineer with a strong background in designing and developing streaming data pipelines to join our dynamic team.

Job Description

Responsibilities:

- Design, develop, and optimize scalable streaming data pipelines to handle large volumes of data.

- Implement data processing solutions using MSK (Managed Streaming for Apache Kafka), Apache Flink, Apache Spark, and Scala.

- Collaborate with cross-functional teams to define data architecture and ensure the integration of various data sources.

- Monitor and manage data pipeline performance, troubleshooting and resolving issues as they arise.

- Utilize AWS native services to deploy and manage data solutions in the cloud.

- Work on at least two implementation projects involving MSK, Flink, Spark, or Scala, demonstrating proficiency in at least three of these technologies.

- Engage in continuous learning and knowledge sharing about streaming technologies and best practices.

- Collaborate with stakeholders to understand data requirements and translate them into technical specifications.

Qualifications:

- 6-8 years of experience in the design and development of streaming data pipelines.

- Proven experience dealing with large stream volumes and real-time data processing.

- Strong implementation experience in at least a couple of projects involving MSK, Flink, Spark, or Scala.

- Very good knowledge of at least three out of the four technologies: MSK, Flink, Spark, Scala.

- Desirable experience with Databricks, Snowflake, or any other data warehouse technologies.

- Proficient in using AWS native services for deploying and managing data solutions.

- Strong problem-solving skills and the ability to troubleshoot complex data processing issues.

- Excellent communication skills to work effectively with technical and non-technical stakeholders.

Preferred Qualifications:

- Familiarity with additional data processing and analytics tools.

- Experience in a similar industry or domain.

- AWS certification is a plus.

Why Join Us:

- Opportunity to work on cutting-edge data technologies and projects.

- Collaborative and innovative work environment.

- Competitive salary.

- Opportunities for professional growth and development.

If you're a passionate Data Engineer looking to make a significant impact in a fast-paced and dynamic environment, we'd love to hear from you. Apply today to join our team!

How to Apply: Please submit your resume, Be sure to include examples of your work and any relevant project experience.