Our leading client is looking for a Contract Data Engineer for an initial 6 month engagement based in Auckland (with WFH flexibility of course). 


The role: 

• Lead the ongoing maintenance, development, and enhancement of our data warehouse
• In-depth knowledge of Relational Database technology and multi-dimensional data modelling, structured query language (SQL) skills, data warehouse and reporting techniques
• Expert in design and development of data pipelines
• Experience with enterprise ETL platforms (such as Informatica, SSIS etc.)
• Understanding of Unix scripting is preferred
• A good working experience on several open-source technologies and big data components such as HDFS, Airflow, Spark, Scala, Hive, Apache Kafka, HBase etc.
• Hands on experience of working on cloud-based data platforms like AWS, Azure is a big advantage
• Proven experience in establishing best practices in data management
• Use the tools and techniques for specific areas of release and deployment activities
• Mentor less experienced team members and new joiners

Tech:

• Databases Oracle, Postgresql, Sqlite
• Advanced SQL
• Scala
• Python
• Git
• Apache Spark & ETL processing
• Hive, Yarn, MapReduce
• Test frameworks (both in Scala and Python)
• (Optionally) Apache Kafka
• Apache Airflow
• Hadoop
• Building and running Docker containers
• IDEs: Intellij, PyCharm, optionally VSCode
• O/S: Ubuntu

If you have experience across some of the above and are ready for a new challenge, APPLY NOW!