Lead Data Engineer

Job Type: Contract
Posted: almost 2 years ago
Contact: Pravin Manandhar
Discipline:
Reference: 248168

About the Company:

Our client is one of the largest suppliers of utility in Australia, providing products and services to millions of customers. They need to strengthen their data engineering capacity and enhance their BI platform.

About the Role:

You will work within an excellent data engineering team. You will lead the data engineers and take responsibilities for defining and implementing the design on the Azure Data Platform, and ideally have worked with Azure. You will be undertaking complex business problems with creative and real-world solutions utilising Azure cloud and data services. You will also bring your experience and expertise from previous Datawarehouse cloud migrations.

Responsibilities:

  • Lead the development and automate the infrastructure that is required to support data across a wide variety of data sources
  • Work with the technical team to assist with data-related issues and their data infrastructure needs.
  • Work with data engineers to organize the direction & control of data for operational processes.
  • Proactively developing and improving of the data engineering capability.
  • Mentoring and providing guidelines in Azure platform and practicing scalable cloud architectures.

Skills and Experience:

  • Expert level Azure Data Platform with data engineering workload - Azure Data Lake, Azure Databricks, Azure Data Factory, Azure DevOps, Azure Synapse
  • Expert level Big data processing - Apache Spark (pyspark), Delta Lake
  • Experience designing Data solution in cloud
  • Experience in metadata driven framework
  • Guide new data engineers on solution design, data frameworks and technologies.

Prefer but not mandatory:

  • SAP BW
  • PowerBI
  • Azure Function (python)



For more information or a confidential discussion, please contact Pravin on 0282672485 quoting reference 248168.

To apply please click the 'Apply Now' button.