Big Data Engineer


New South Wales

Work type:

Full Time


Information & Communication Technology


$115000.00 per annum

Job reference:


Start date:


Contact email:


Rosie Willson

  • Big Data Engineer
  • Permanent Role
  • Sydney CBD Location
  • Global consulting firm, working onsite with a dedicated client within the financial services industry
As a Big Data Engineer you will be engaging with key stakeholders and providing knowledge, experience and thought leadership in big data development and engineering solution implementation.

Key Responsibilities
  • Quick POC implementation for technical feasibility
  • Generic Framework component development
  • Application development and unit testing
  • Design documentation for the sprint tasks
  • Run book and deployment plan preparation for sprint task
  • Production deployment and handover to operational team

Key Skills and experiences
  • Minimum of 4-8 years of total IT experience
  • 2+ big data project development and production deployment experience in data lake environment
  • Hands on Java and Shell script programming experience
  • Solid understanding of HDP/HDF Hadoop components
  • Good experience in data acquisition using HDP native tools like Sqoop, Flume, Hadoop copy etc or using any custom built framework using any other Hadoop native tools
  • Good experience in writing complex map reduce and spark programs for data transformations

For more information, please contact Rosie-

Apply now!

Share this job:

help your friends find their dream job: