About the role
A large IT services and consulting company in Canada is hiring for this role. You will lead the design and technical direction of an Azure Databricks platform and guide the migration of production workloads onto it. You will also mentor client engineers as they take ownership of the platform.
What you'll do
- Lead the design and technical direction of the Azure Databricks platform
- Establish medallion architecture and pipeline standards
- Guide the migration of production workloads from Dataiku and Cloudera/Hadoop
- Design and support streaming ingestion and dashboard transitions
- Keep production outputs stable through cutover and mentor client engineers
What you bring
- Experience architecting data platforms on Azure Databricks
- Working knowledge of medallion architecture and pipeline standards
- Familiarity with Dataiku and Cloudera/Hadoop environments
- Experience with streaming ingestion and dashboard migrations
- Ability to mentor engineers through a platform handover
Details
- Location: Canada
- Type: Full-time
Apply below and a Traverse recruiter will be in touch.