A fast-growing Google Cloud consulting firm is seeking an experienced Databricks Architect for an immediate-start engagement to lead the design and delivery of enterprise-scale modern data platforms on Google Cloud Platform (GCP). The consultant will work within a high-calibre team of cloud engineers to build robust, AI-ready lakehouse architectures that unify data management, governance, and performance at scale.

The ideal talent is a technically excellent, hands-on architect who can hit the ground running on day one — combining deep Databricks expertise with strong GCP knowledge to deliver clean, production-grade solutions.

Key Activities

• Lead end-to-end design and implementation of scalable enterprise data platforms using Databricks on GCP, including lakehouse architecture, workspace configuration, and cluster management.
• Implement Delta Lake and Unity Catalog architectures to establish secure, governed, and auditable data management across hybrid and multi-cloud environments.
• Design and optimise ETL/ELT pipelines using Delta Live Tables (DLT) and tune Photon engine performance to reduce processing latency at scale.
• Integrate Databricks environments with core GCP components — including Google Cloud Storage, BigQuery (via the BigQuery-Databricks connector), and IAM — for cohesive and secure workspace access.
• Build Infrastructure as Code (IaC) deployment pipelines using Terraform to dynamically provision workspaces, clusters, and security policies with production-grade reliability.
• Collaborate with AI and data science teams to design feature stores and high-performance data streams that underpin RAG pipelines and Vertex AI models.

Your Background

Essential

• 3+ years of hands-on architectural experience designing, scaling, and managing enterprise Databricks workspaces in production environments.
• 2+ years engineering data solutions specifically on Google Cloud Platform (GCP) — this is a hard requirement.
• Expert-level proficiency in PySpark/Spark SQL, Delta Lake, Python or Scala, and modular Terraform.
• Ability to start immediately — this engagement is urgent and requires a consultant available without delay.
• Based in Australia with full working rights.
• Google Cloud Certification (Professional Data Engineer or Professional Cloud Architect) held or willingness to obtain within one month of commencement.

Desirable

• Databricks certifications (Certified Data Engineer Professional or Certified Solutions Architect).
• Proven experience migrating on-premises Hadoop infrastructure or legacy data warehouses into a Databricks-on-GCP lakehouse environment.
• Hands-on experience with real-time streaming architectures using Structured Streaming or Pub/Sub.