Hadoop Developer

Location: Melbourne CBD, Victoria
Job Type: Permanent
Posted: 10 days ago
Contact: Sue Templeton
Reference: 247686

Acting as the Hadoop Developer of the group your main responsibilities include:

  • Designing and developing the bigdata application in Cloudera bigdata clusters
  • Implement the design based on the requirements and architecture decision
  • Administering and supporting Big Data clusters including Hortonworks/Cloudera and Opensource Bigdata eco-system
  • Building robust, efficient and reliable data pipelines consisting of diverse data sources to ingest and process data into cloud platform
  • Providing technical expertise for new and ongoing initiatives to work with project stakeholder to come up most feasible technical solution

You will need to have:

  • Experience within the aspects of implementation, configuration and support of Hadoop environments
  • Experience in designing, developing, and implementing Bigdata applications
  • Experience in Java, Spring, Python, Shell scripting, Ansible, Puppet, Kubernetes, Docker
  • and Terraform.
  • Experience in Building and administration of Opensource Bigdata platforms is advantageous
  • Experience in implementing DevOps tools highly advantageous such Git, Bamboo, Puppet etc.
  • Knowledge in design, development, maintenance, troubleshooting and debugging application in production environments
  • Hands on experience working with Advanced SQL, Java, Python and other Scripting languages.
  • Good time management and ability to successfully juggle multiple projects at the same time.
  • Good stakeholder management and communications skills will allow you to successfully keep the team updated on deliverables and ensure key project stakeholders are aware of progress against project milestones.
  • A degree in Information Technology or similar