Senior Databricks Developer Jobs in Australia 2026

Want to shape data platforms that improve public health outcomes? A leading Government Health sector client is hiring a Senior Databricks Developer. This role offers 482 visa sponsorship for the right candidate. If Lakehouse architecture excites you, this role delivers real impact.

About the Role

This is a technical leadership role for Analytics and Research workloads. You will architect scalable data pipelines using PySpark and Scala. Additionally, you will manage the Databricks Lakehouse Platform for sensitive health data. Strict governance and compliance remain essential throughout every stage of this work.

About the Hiring Firm

The hiring firm partners with a major player in Government Health. This client focuses on optimising public health outcomes and resource allocation. It operates a modern, cloud-native data platform for research and analytics. Further company details were not included in the original posting.

Job Duties

• Lead design of large-scale ETL and ELT pipelines using PySpark
• Architect and manage the Delta Lake environment for health datasets
• Enforce data quality using Delta Live Tables or similar tools
• Optimise Databricks clusters and Spark jobs for cost and performance
• Define governance practices using Unity Catalogue for access control
• Collaborate with analysts to productionise research models and findings
• Champion CI/CD and MLOps practices across Databricks workflows
• Mentor junior engineers on Spark optimisation and engineering standards

Job Requirements

• 6+ years of progressive experience in Data Engineering required
• At least 3 years building solutions on the Databricks Platform
• Expert-level proficiency in PySpark and/or Scala required
• Hands-on experience with Delta Lake, including DLT and time travel
• Strong understanding of cloud infrastructure, with Azure preferred
• Experience integrating Databricks with ADLS Gen2 and cloud services
• Expert proficiency in SQL and dimensional modelling principles
• Proven experience with CI/CD and Infrastructure as Code tools
• Strong communication skills within highly regulated environments

#339966;">#339966;" href="https://www.linkedin.com/jobs/view/senior-databricks-developer-at-ai-talent-4445431889/" target="_blank" rel="noopener">Click Here to Apply

Conclusion

This role offers more than a technical challenge; it offers genuine purpose. Building pipelines that support public health carries lasting, real-world value. For senior data engineers seeking meaningful work, this opportunity stands out clearly.