The role:Â
- Lead the ongoing maintenance, development, and enhancement of our data warehouse
- In-depth knowledge of Relational Database technology and multi-dimensional data modelling, structured query language (SQL) skills, data warehouse and reporting techniques
- Expert in design and development of data pipelines
- Experience with enterprise ETL platforms (such as Informatica, SSIS etc.)
- Understanding of Unix scripting is preferred
- A good working experience on several open-source technologies and big data components such as HDFS, Airflow, Spark, Scala, Hive, Apache Kafka, HBase etc.
- Hands on experience of working on cloud-based data platforms like AWS, Azure is a big advantage
- Proven experience in establishing best practices in data management
- Use the tools and techniques for specific areas of release and deployment activities
- Mentor less experienced team members and new joiners
Tech:
- Databases Oracle, Postgresql, Sqlite
- Advanced SQL
- Scala
- Python
- Git
- Apache Spark & ETL processing
- Hive, Yarn, MapReduce
- Test frameworks (both in Scala and Python)
- (Optionally) Apache Kafka
- Apache Airflow
- Hadoop
- Building and running Docker containers
- IDEs: Intellij, PyCharm, optionally VSCode
- O/S: Ubuntu
If you have experience across some of the above and are ready for a new challenge, APPLY NOW!