Lead Data Engineer - Big Data, Python, AWS

* Permanent position, hybrid working arrangements * Big Data, Kafka, AWS, Python/PySpark, ETL * Hands-on role where you will oversee the design, development, and maintenance of their data infrastructure

Key Responsibilities

• Lead the design, development, and implementation of scalable and robust data pipelines, ETL processes.
• Oversee the maintenance and optimisation of our data warehouse and data lake.
• Manage data platform governance, data modelling, and solution development.
• Mentor and guide other data engineers, fostering a culture of continuous learning and improvement.
• Contribute to the architecture and scaling of their data platform to support ever-growing data-intensive strategies

Key Requirements

• 8+ years experience in data engineering within big data environments; Spark, Hadoop, Kafka
• Strong, hands-on experience with designing and developing data platform solutions
• Experience providing leadership for critical initiatives covering the end-to-end data development lifecycle
• Strong experience engineering in cloud platforms; AWS/GCP
• In-depth data platform infrastructure experience to enable the definition and measurement of non-functional requirements, such as reliability, availability, security, and performance

Hybrid working arrangements

Sydney, CBD 2000

Aboriginal and Torres Strait Islander Peoples are encouraged to apply.
To apply please click apply or call Christina Tran on 02 8289 3127 for a confidential discussion.