One of our clients within the retail and supermarket sector is seeking an experienced Data Engineer to join their team for an initial 6 month contract.
The Data Engineer will be designing, constructing, installing and maintain highlight scalable data management systems for the organisation .
Key Responsibilities:
- Develop and implement data pipelines in Azure Data Factory (ADF)
- Implement complex, scalable, and robust architecture to support real-time data streaming using Spark
- Work closely with data scientists and analysts to provide direct and indirect data-related support
- Integrate up-and-coming data management and software engineering technologies into existing data structures
- Develop set processes for data mining, data modelling, and data production
- Create custom software components and analytics applications
Key Skills and Experiences:
- Proven experience as a Data Engineer
- Strong experience with Azure cloud services, Azure Data Factory (ADF) pipelines, and PySpark
- Experience with Spark implementation and real-time data streaming in Spark
- Excellent analytical and problem-solving skills.
- Strong communication skills and ability to work as part of a team
For more information or a confidential discussion, please contact Abuk Mawn on 0380807265 quoting reference 261036.
To apply please click the 'Apply Now' button.
Diversity and inclusion are strongly supported at Peoplebank. People of all nationalities, gender identities, and cultural backgrounds, including Aboriginal and Torres Strait Islander Peoples, are encouraged to apply.
