Databricks Data Engineer | Mid Level
Mane Consulting · Chatswood, Willoughby Area · Contract · Onsite · AUD 16,250 – 18,417 / month
At a glance
Databricks Data Engineer | Mid Level at Mane Consulting, working with Spark / Big Data, SQL and Azure.
- Location
- Chatswood, Willoughby Area
- Work mode
- On-site
- Job type
- Contract
- Seniority
- Mid-level
- Salary
- A$16,250 – A$18,417 / month
- Technologies
- Spark / Big Data, SQL, Azure, Power BI / Tableau
Key requirements
- Work with business and technical stakeholders to understand data and analytics requirements
- Design, develop, test, document and maintain data models, reports and dashboards
- Build and maintain data pipelines across various technologies, extracting, loading, combining and transforming data
- Translate business requirements into logical and physical data models aligned with reporting and BI needs
- Implement data governance, security, quality, classification and re‑usability
Hirepins insights
- Spark is asked for in 8% of the 24 live IT jobs in Australia on Hirepins.
- Mane Consulting has 1 other open IT role on Hirepins.
About this role
A mid‑level Data Engineer will work on a 6‑12 month contract in Chatswood, Willoughby, designing and maintaining data pipelines, models and dashboards for a data‑driven organisation. The role involves collaborating with product owners, data architects and stakeholders to deliver business outcomes and support data governance.
Key details
- Location: Chatswood, Willoughby Area
- Work mode: On-site
- Contract: 6-12 month Contract, full-time
- Pay: $750 - $850 per day
- Level: Mid-level
What you'll do
- Work with business and technical stakeholders to understand data and analytics requirements
- Design, develop, test, document and maintain data models, reports and dashboards
- Build and maintain data pipelines across various technologies, extracting, loading, combining and transforming data
- Translate business requirements into logical and physical data models aligned with reporting and BI needs
- Implement data governance, security, quality, classification and re‑usability
- Design and implement star and snowflake schemas for scalable analytics
- Collaborate with cross‑functional delivery teams, analytics practice group and platform team
What you'll need
- Extensive expertise in data engineering and data analysis
- Proficient in T‑SQL, SQL Server, Databricks, PySpark, Power BI and related data tools
- Experience with Lambda and Kappa architecture stacks
- Hands‑on experience building Data Streaming solutions using Apache Kafka, Azure Event Hub, Confluent and Apache Flink
- Skilled in constructing and optimizing data pipelines, data models, reports and dashboards
- Experience with Azure services: Azure Data Factory, Azure Databricks, Delta Lake, Azure Synapse Analytics
- Experience in star/snowflake schema design
- Understanding of slowly changing dimensions (SCD Types 1, 2, etc.)
- Ability to translate business logic into fact/dimension tables
- Proficient in handling large and complex datasets
Tech stack
SQL Server, Databricks, PySpark, Power BI, Lambda, Kappa, Apache Kafka, Azure Event Hub, Confluent, Apache Flink, Azure Data Factory, Azure Databricks, Delta Lake, Azure Synapse Analytics
How to stand out for this role
Likely interview topics
- Designing star/snowflake schemas and handling slowly changing dimensions
- Building and optimizing data pipelines across Azure services
- Implementing data governance and security requirements
- Experience with Lambda and Kappa architectures and streaming solutions
- Mentoring and guiding technical decisions
Keywords to mirror in your CV
Data Engineering, Data Analysis, Databricks, PySpark, Power BI, Azure Data Factory, Azure Databricks, Delta Lake, Azure Synapse Analytics
What to show
- Showcase a data pipeline built on Azure Data Factory and Databricks that ingests, transforms and loads data into a star schema
- Provide a Power BI dashboard that visualises key metrics from a complex dataset
- Demonstrate a streaming solution using Kafka and Azure Event Hub with real‑time data processing
How to apply
Use the "Apply on company website" button to continue to Mane Consulting's careers page and submit your application there.
More IT jobs at Mane Consulting
Source: Adzuna