Big Data Engineer
Amston – a team of talent recruitment professionals that ensures exclusive attention to your needs, fosters partnerships based on trust, and provides expert insights throughout the recruitment process.
REIZ TECH, with more than 200 professionals, develops individual software solutions. By using diverse technologies in various industries around the world, the company requires highly qualified specialists with extensive technological experience. REIZ TECH believes in the power of cooperation, and the infinite potential of each individual unlocks the door to success.
Responsibilities
- Design and develop scalable data processing pipelines leveraging AWS services such as S3, Glue, Athena, EMR Serverless, and Kafka
- Implement real-time data processing solutions using Apache Spark and Kafka to ensure timely and accurate data delivery
- Collaborate with DevOps teams to deploy and manage infrastructure as code, ensuring reliability, scalability, and performance of data systems
- Work closely with stakeholders to understand business requirements and translate them into technical solutions
- Utilize Python for scripting and automation tasks, with familiarity in tox and pytest, and potentially Airflow soon
- Maintain and optimize data pipelines for performance, reliability, and cost efficiency
- Stay up to date with emerging technologies and best practices in big data processing and cloud computing
Requirements
- Strong proficiency in real-time data processing and building data pipelines using AWS services (S3, Glue, Athena, EMR Serverless)
- Hands-on experience with Apache Spark for large-scale data processing and analysis
- Expertise in Kafka and Kafka Connect for real-time data streaming and integration
- AWS certifications such as Developer or Solution Architect Associate with Big Data Speciality
- DevOps mindset with experience in infrastructure as code and continuous integration/continuous deployment (CI/CD) pipelines
- Excellent communication skills and the ability to collaborate effectively with cross-functional teams
- Understanding of customer requirements and the ability to propose and develop solutions that meet business needs
- Proficiency in Python for scripting, automation, and data manipulation tasks
- Familiarity with testing frameworks like pytest and version control systems like Git
- Proficiency in English, fluency in German is a plus
- Willingness to travel occasionally (approximately once a month)
Company offers
- Loyalty Day off
- ReizHealth Days
- Flexible Vacation Policy
- Knowledge sharing sessions, team-buildings, learning lunches
- Flexible working hours and remote work possibility
Additional information
Contact person – Goda, +370 630 72429, goda@amston.lt