English
  • English
  • Dutch
  • German
Technical Lead Data Engineer

Description

Seeking a Technical Lead Data Engineer,
Initial 12 Month contract and the position will require weekly visits to site in London.

Responsibilities:

  • Lead the design, development, and implementation of data engineering solutions for our data Lakehouse platform.
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Provide technical leadership, mentoring, and coaching to the data engineering team.
  • Ensure best practices in data engineering, including data modeling, ETL processes, and data quality.
  • Manage CI/CD pipelines using Azure DevOps or Git.
  • Develop and maintain event-driven pipelines using .NET and other relevant technologies.


Skills and requirements:

  • Extensive experience with Databricks, Apache Spark, and data lakes.
  • Proficiency in Python and SQL.
  • Experience with CI/CD processes using Azure DevOps or Git.
  • Knowledge of streaming data technologies such as Kafka and KSQL DB.
  • Familiarity with reporting tools like Power BI and Qlik.
  • Software engineering experience with .NET for event-driven pipelines and automation testing.
  • Experience with Databricks Unity Catalog.
  • Strong skills in data modeling, including Snowflake modeling, star schema modeling, and other techniques.
  • Ability to optimize big data workloads in Spark.

Michael Bailey International is acting as an Employment Business in relation to this vacancy.

Technical Lead Data Engineer