Our Client:
Our Client is a rapidly growing organization. They are currently seeking an experienced Cloud & Big Data Engineer to join their organisation in Perth. This is an excellent opportunity for candidates with strong experience in the Big Data space.
Responsibilities:
In this role, you will be working on the cutting edge of product development, AWS Cloud, BI and AI technology. Based in Perth but working with a global team, you will be part of a growing and innovative company that is transforming the way advertisers reach their audience.
The role includes:
- Performing advanced SQL queries and data engineering in the AWS cloud
- Building data pipelines using AWS EMR, AWS Glue, S3 or similar service
- Developing, testing and implementing stream processing for real-time and batch analysis
- Ensuring the accuracy, scalability and reliability of data processes, monitoring, and scheduling
- Building and supporting real-time systems using combination of Kinesis Stream/Kafka, Spark Streaming, ElasticSearch, Druid, MEMSQL, Redis, DynamoDb, Postgres
- Help setup pipeline for real-time Artificial Intelligence
- Working as part of a team reporting to the Head of Analytics & Data Science
- Minimum two years previous experience in an engineer/programmer role, ideally in the big data and streaming world
- A degree qualified in computer science or similar
- Experience maintaining and developing message queuing and stream processing using AWS Kinesis Stream, Firehose, Kafka, ZeroMQ or similar
- Experience in building high-performance data pipeline and data stores
- Understanding of moving to severless technologies like Athena, Glue using PySpark
- Experienced in construction of advanced SQL queries and query optimisation
- Experience in developing real-time machine learning and streaming data using Sagemaker, Spark or similar
- Familiarity with web scraping and getting data via HTTP request
Required Skills:
- Sound AWS and Linux knowledge
- Good data visualisation skills set either using Tableau BI or Python based data visualisation stack
- Ability to communicate effectively at all levels
- Good knowledge with AWS SDK, IAM, Role, VPC, Container, EC2
- Good understanding of big data and NoSQL technologies including Apache Hive, Spark, Presto, Airflow
- Bonus points if you have:
- Mobile Marketing, Digital Advertising and Events analytics experience
- Apache Storm, Flink or Beam experience
- Experience in web app development, front end data visualisation
- Ability to work well within a collaborative, team environment;
- Excellent communication skills - both verbal and written.
The Perks:
- Interesting, challenging work;
- Join a rapidly growing organization that will offer growth and career development opportunities;
- Permanent opportunity;
- Fantastic office environment
- Work with the latest technologies;
- Work in an industry that is exciting and currently thriving!!
If you wish to discuss, please contact Mili on 08 9423 1422 quoting ref 184325
If you wish to apply, please click the "APPLY" button with an updated resume in WORD
