Data Engineer

Job Type: Contract
Posted: over 4 years ago
Contact: Chathu Jayawardena
Discipline:
Reference: 199270_1573099039

Data Engineer

  • Initial 6-month contract
  • Perth CBD location
  • Seeking skills in Python, R & Spark

A leading IT consultancy based in the Perth CBD is seeking an experienced Data Engineer for an initial 6-month contract. We are seeking experience with big data and cloud technologies, which includes areas such as Python, R and Spark.

Responsibilities include:

  • Design, develop and implement data pipeline architectures using native cloud services or bespoke custom architectures;
  • Build infrastructure required to extract, transform and load data from a wide variety of legacy data sources into a scalable data lake platform;
  • Use the latest tools to create and maintain metadata catalogues;
  • Create automated data load jobs that are easy to support, maintain and debug;
  • Develop simple data models from complex data structures.

Required skills:

  • Strong , recent experience in a Data Engineering role with technologies listed below;
  • Experience building and optimizing data pipelines, architectures and data sets;
  • Advanced SQL knowledge and experience working with relational databases, query authoring and optimization, and database storage technologies;
  • Strong analytical skills working with both structured and unstructured data;
  • Graduate Degree in Computer Science, Mathematics or Information Systems.

Technical skills:

  • Experience with big data tools: Hadoop, Spark and Kafka;
  • Experience with relational SQL, NOSQL, Graph databases;
  • Experience with AWS Cloud Native Services: Glue, DataPipeline, Redshift, AWS Data Lake, RDS, Lambda, AWS CLI, and SAM;
  • Infrastructure as Code Scripting and deployments;
  • CI/CD, DevOps Methodologies.

If you have the skills and experience for this position, please apply now via the link below. Suitable candidates will be contacted for a confidential discussion.

Please note: we will consider Eastern States and Internationally based candidates who possess Full Australian Work Rights and who can relocate to Perth within approximately 4 weeks.

Contact: Chathu Jayawardena (08) 9423 1426 - (Job reference: 199270)