Data Engineer (Spark/ Python/ SQL)
Amston – a team of talent recruitment professionals that ensures exclusive attention to your needs, fosters partnerships based on trust and provides expert insights throughout the recruitment process.
Our client – TransUnion is a global information and insights company which provides solutions that help create economic opportunity, great experiences and personal empowerment for hundreds of millions of people in more than 30 countries.
Responsibilities
- Design and write programs for data extraction, segmentation and statistical analysis on large population datasets using languages such as R, Python, SQL, Hive, and Spark on server
- Help streamline our data science workflows by improving process speeds and integrating automated quality control
- Follow existing processes to update data products and trouble shoot technical issues
- Be an advocate for best practices and continued learning
- Use agile software development processes to iteratively make improvements to our systems
- Train, coach and support users on environment, tools, data, and services
- Writing technical processing documentation
Requirements
- Experience with Big Data tools, such as Hive and Spark
- Proficiency in Python, SQL, Spark (Pyspark)
- Experience building data pipelines and data-centric applications using distributed storage platforms
- Comfortable working in a dynamic, research-oriented team with concurrent projects
- Strong analytical, critical thinking, and creative problem-solving skills
- Experience in Agile development environment would be considered an advantage
- R knowledge would be considered an advantage
Company offers
- Experienced and highly motivated team
- Big focus on project delivery quality
- Health insurance package
- Business/Individual performance-based annual bonuses
- Financial rewards for Azure/AWS certifications
- Well defined career growth path using a matrix of skills needed to move on to the next level
- Dedicated training budget for professional improvement
- Linux Academy, Ministry of Testing, LinkedIn learning zone memberships
- Modern 2500 square meter office in Zalgiris arena with free parking
- Free of charge entry to Zalgiris LKL and Euroleague basketball games in VIP Zalgiris box
- Regular team events such as team buildings, summer/winter parties, sports & retreats
- Opportunity to participate in TransUnion Share purchase plan
- Flexible working and work-life balance
Additional Information
The recruitment process is due September 2nd. Contact person – Kornelija, +370 638 44 446, kornelija@amston.lt