Senior Data Engineer

About the role

A recruiter representing a client, described as a centre of excellence in personalized customer experiences, marketing automation and CRM, is hiring a Senior Data Engineer. The role builds data pipelines and models for analytics and business intelligence, working closely with CRM developers, data scientists, data analysts and product owners.

Key responsibilities

• Identify, collect and integrate data from various sources by building high-quality data pipelines and data models for analytics and BI.
• Develop and optimize code so pipelines run at minimum cost and are easy to maintain.
• Build monitoring procedures and tools to ensure solid ETL flows and data quality, and design processes to fix ETL incidents.
• Collaborate with CRM developers, data scientists, data analysts and product owners so the data supports business initiatives.
• Work with data analytics teams on best practices for using data technically.
• Design data architectures and collaborate on data migrations in cloud environments.

Required profile

• Experience in data engineering, big data, business intelligence or data science.
• Experience with Spark, Python, Scala or similar.
• Excellent SQL skills for large-scale data transformation and analysis.
• Programming experience in JavaScript, Python or similar.
• Expertise managing databases, including performance tuning, backup and recovery.
• Solid knowledge of data quality management (profiling, cleansing, validation).
• Knowledge of data governance principles and version control tools such as GitHub.

Required skills

• Cloud data warehousing, pipelines and ETL (extract, transform, load); ideally GCP, AWS or Azure.
• Tools such as Google Dataflow, Looker, DBT, EMR, CI/CD pipelines, Airflow DAGs and visualization tools like PowerBI, Tableau or Looker.
• Advantageous: Kubernetes.

The offer is discussed further with the client.