Share
Senior Data Engineer
on our
You will:
·Support in designing and rolling out the data architecture and infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
Play an important role in the end-to-end delivery of AI solutions, from ideation, feasibility assessment, to data preparation and industrialization.
Design, develop and deploy scalable batch and/or real-time data pipelines, having a strong focus on DataOps.
Identify and investigate potential data quality issues and explore ways to improve data quality and reliability.
Implement data validation, cleaning, and monitoring processes to ensure high-quality data for data science models.
5+ years in data engineering or a related field, with proven success in building scalable data solutions.
Master’s degree in computer science, engineering, mathematics or another relevant subject.
Experience with data modelling, design patterns and building highly scalable and secured data platforms and infrastructures.
Practical experience with Python data exploration, analysis and engineering libraries.
Experience within a commercial environment creating ETL pipelines in python
Experience with development of Enterprise Data Warehouse platforms like Teradata/GreenPlum.
Experience with data orchestrators such as Airflow
These jobs might be a good fit