Browse IT jobs

Data Engineer

Australian Payments Plus · Sydney, Sydney Region · Full time · Onsite

At a glance

Data Engineer at Australian Payments Plus, working with Python, SQL and AWS.

Location
Sydney, Sydney Region
Work mode
On-site
Job type
Full-time
Seniority
Junior
Technologies
Python, SQL, AWS, Spark / Big Data

Key requirements

  • Design, build, deploy and maintain scalable batch and real‑time data pipelines for large, complex datasets
  • Build ingestion pipelines to integrate data from APIs, databases, files, event streams and third‑party platforms
  • Implement orchestration, observability, error handling, reconciliation and recovery mechanisms
  • Develop Snowflake data objects (tables, views, schemas, stored procedures) and data quality tests
  • Monitor and optimise pipeline and platform performance, troubleshoot technical issues

Hirepins insights

  • Python is asked for in 8% of the 24 live IT jobs in Australia on Hirepins.
  • 1 other Data Engineer role is open in Australia on Hirepins right now.

About this role

A Data Engineer role at Australian Payments Plus (AP+) based in Sydney, focused on building secure, scalable data pipelines across Snowflake and AWS to power payment insights. The position requires hands‑on experience with batch and real‑time data engineering, APIs, and cloud orchestration, and is suited to engineers who thrive in an agile, collaborative environment.

Key details

  • Location: Sydney, Sydney Region
  • Level: Mid-level

What you'll do

  • Design, build, deploy and maintain scalable batch and real‑time data pipelines for large, complex datasets
  • Build ingestion pipelines to integrate data from APIs, databases, files, event streams and third‑party platforms
  • Implement orchestration, observability, error handling, reconciliation and recovery mechanisms
  • Develop Snowflake data objects (tables, views, schemas, stored procedures) and data quality tests
  • Monitor and optimise pipeline and platform performance, troubleshoot technical issues
  • Provide on‑call support as part of a rotational roster

What you'll need

  • 2+ years of hands‑on experience building and maintaining enterprise or bank‑grade data infrastructure
  • Prior experience in cloud databases like Snowflake, DBT, orchestration tools like Airflow, event streaming platform like Kafka
  • Strong experience with Snowflake, SQL and NoSQL data stores, including complex queries and transformations
  • Strong Python capability and experience building data pipelines and integrations using APIs, ETL/data processing technologies and cloud infrastructure such as AWS
  • Solid understanding of data modelling, data quality, reconciliation, governance and security when working with transaction or payment data
  • Experience connecting and operationalising data across warehouses, lakes, streaming platforms and analytics tools, with an eye for performance, scalability and reliability

Tech stack

Snowflake, AWS, Python, SQL, APIs, DBT, Airflow, Kafka, NoSQL

How to stand out for this role

Likely interview topics

  • Designing scalable batch and real‑time pipelines – discuss architecture choices and trade‑offs
  • Data governance and security – explain how you enforce policies for payment data
  • Orchestration and error handling – describe Airflow DAGs or similar patterns you’ve implemented

Keywords to mirror in your CV

Snowflake, Python, SQL, AWS, Kafka, Airflow, DBT, data quality, governance

What to show

  • Create a Snowflake data warehouse with sample payment data and expose views for analytics
  • Build a real‑time ingestion pipeline using Kafka and AWS Lambda that feeds into Snowflake
  • Develop automated data quality tests that validate schema and reconciliation logic

How to apply

Use the "Apply on company website" button to continue to Australian Payments Plus' careers page and submit your application there.

More IT jobs at Australian Payments Plus

Source: Adzuna