en

Services

Australia's leading employers trust us to deliver fast, efficient hiring solutions that are tailored to their exact requirements. Browse our range of bespoke services and resources.

Read more

Contact Us

Truly global and proudly local, we've been serving Australia for over 25 years with offices in Adelaide, Brisbane, Melbourne, Perth, and Sydney.

Get in touch
Jobs

Our industry specialists will listen to your aspirations and share your story with Australia’s most prestigious organisations. Together, let’s write the next chapter of your career.

See all jobs

Exclusive recruitment partners

Explore the opportunities from a range of organisations that exclusively partner with Robert Walters for their hiring needs.

Learn more
Services

Australia's leading employers trust us to deliver fast, efficient hiring solutions that are tailored to their exact requirements. Browse our range of bespoke services and resources.

Read more
About Robert Walters Australia

G'day! For us, recruitment is more than just a job. We understand that behind every opportunity is the chance to make a difference in people's lives.

Learn more

Work for us

Our people are the difference. Hear stories from our people to learn more about a career at Robert Walters Australia

Learn more
Contact Us

Truly global and proudly local, we've been serving Australia for over 25 years with offices in Adelaide, Brisbane, Melbourne, Perth, and Sydney.

Get in touch

Senior Data Engineer (Python, Snowflake, Redshift, Athena)

Save job

This role will play a critical part in designing, building, and maintaining robust data infrastructure and pipelines to support trading strategies and operations. The ideal candidate will have a strong background in Python programming, experience with Apache Airflow for workflow orchestration, and proficiency in SQL for data manipulation and querying.

Key Requirements: Snowflake, Databricks, Redshift, Athena and BitQuery.

As a Senior Data Engineer, you will be instrumental in shaping the future of our client's data infrastructure. You will be responsible for building, designing, and developing their data pipelines to support real-time trading systems and analytics. Your role will involve close collaboration with quantitative researchers, traders, and developers to understand their data requirements and implement efficient solutions. You will also be tasked with evolving the company's data models, pipeline, and systems architecture. Your expertise in automating day-to-day data operations (DataOps) will be crucial in troubleshooting data issues and maintaining reliability across the company's data assets.

Build, design and develop data pipelines to support real-time trading systems and analytics
Collaborate with quantitative researchers, traders, and developers to understand data requirements
Evolve the company's data models, pipeline and systems architecture
Perform and automate day-to-day data operations (DataOps)
Troubleshoot data issues and maintain reliability across the company's data assets
Ensure data quality and availability for all trading teams
Create technical documentation related to system configuration and operation
Lead projects, provide technical guidance and mentor junior engineers

The ideal candidate for this Senior Data Engineer position brings a wealth of skills and qualifications. You should hold a Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or a related field. Your proven experience as a Senior Data Engineer or in a similar role will be essential for success in this position. You should have expertise in Python programming and software development best practices. Hands-on experience with Snowflake, Databricks, Redshift, Athena, BitQuery is highly desirable. A strong proficiency in SQL and relational databases (e.g., PostgreSQL, MySQL) is required. Experience with distributed computing frameworks such as Spark, Dask, Ray or HT Condur will be beneficial.

Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field
Proven experience as a Senior Data Engineer or similar role
Expertise in Python programming and software development best practices
Hands-on experience in Snowflake, Databricks, Redshift, Athena, BitQuery
Strong proficiency in SQL and relational databases (e.g., PostgreSQL, MySQL)
Experience with distributed computing frameworks such as Spark, Dask, Ray or HT Condur
Understanding of Infrastructure as Code (Chef, Ansible)
Solid understanding of data modelling and data warehousing concepts

Aboriginal and Torres Strait Islander Peoples are encouraged to apply.
To apply please click apply or call Joe Spencer-Lewis on 02 8289 3148 for a confidential discussion.

Contract Type: FULL_TIME

Specialism: Banking & Financial Services

Focus: Private Wealth Management

Industry: Financial Services

Salary: Negotiable

Workplace Type: Hybrid

Experience Level: Associate

Location: Australia

Job Reference: 1983370/001

Date posted: 24 June 2024

Consultant: Joe Spencer-Lewis

I'm Robert Walters Are you?

Come join our global team of creative thinkers, problem solvers and game changers. We offer accelerated career progression, a dynamic culture and expert training.