Databricks Data Engineer / Developer (PL 866)

Location: Remote within Canada Client: Consulting Client Contract Duration: 6 months contract MUST HAVE atleast 3+ years of hands-on Databricks development experience. Overview Our consulting client is seeking a Databricks Data Engineer / Developer to support a strategic Enterprise Data Platform (EDP) transformation initiative. The organization is modernizing its enterprise data landscape and building a next-generation data platform leveraging Databricks and modern cloud-based architecture. This role will play a key part in designing, developing, and implementing scalable data solutions that support enterprise reporting, analytics, AI initiatives, and future data-driven capabilities. The ideal candidate will possess strong data engineering expertise, hands-on Databricks development experience, and a solid understanding of ETL/ELT processes, data integration, and modern data architecture . This individual will work closely with data architects, project managers, analysts, and business stakeholders to deliver high-quality data solutions within a rapidly evolving environment. Key Responsibilities • Design, develop, and maintain data pipelines within the Enterprise Data Platform (EDP) . • Build and optimize ETL/ELT processes to support data ingestion, transformation, and integration requirements. • Make use of an Agentic approach to development and ensure that output matches development standards. • Develop scalable and reusable data solutions using Databricks and cloud-based data technologies . • Support migration and modernization activities from HANA environments to a modern data platform . • Collaborate with Data Architects to implement scalable data models and platform solutions. • Develop data transformation logic and workflows to support business and analytics requirements. • Ensure data quality, integrity, consistency, and performance across platform solutions. • Troubleshoot and resolve data-related issues, bottlenecks, and performance concerns. • Participate in code reviews, testing, deployment, and release activities. • Work closely with business and analytics teams to understand data requirements and deliver fit-for-purpose solutions. • Contribute to platform best practices, documentation, and continuous improvement initiatives. Requirements MUST HAVE atleast 3+ years of hands-on Databricks development experience. Required Qualifications • 3+ years of hands-on Databricks development experience . • 4+ years of overall Data Engineering, ETL, or Data Integration experience. • Strong experience building ETL/ELT data pipelines and transformation processes. • Proven experience working with large and complex datasets. • Experience with Agentic frameworks and AI-assisted coding is a value add. • Experience developing data solutions within cloud-based platforms. • Solid understanding of data warehousing, data lake, and lakehouse concepts. • Experience working in Agile delivery environments. • Strong problem-solving and analytical skills. • Excellent communication and collaboration abilities. Preferred Qualifications • Experience supporting large data platform initiatives. • Experience in significant data migration efforts. • Experience with Azure Data Services and Databricks Lakehouse architecture. • Experience with modern data engineering frameworks and best practices. • Exposure to AI, GenAI, Machine Learning, or advanced analytics initiatives. • Experience working in large enterprise or consulting environments. • Knowledge of data governance, metadata management, and data quality frameworks. Technical Knowledge Required • Databricks • ETL / ELT Development • Data Engineering • Data Integration • SQL • Python • Data Pipeline Development • Data Transformation • Data Warehousing Concepts • Agile Delivery Preferred • Azure Data Factory • Delta Lake • Spark / PySpark • Azure Synapse • Data Lake Architecture • Cloud Data Platforms • Data Governance & Data Quality • CI/CD for Data Solutions Key Skills & Experience • Databricks Development • Data Engineering • ETL/ELT Design & Development • Enterprise Data Platforms • Data Modernization • Data Migration • Data Warehousing • Cloud Data Platforms • SQL & Python Development • Data Quality & Validation • Agile Delivery • Stakeholder Collaboration Ideal Candidate Profile We are seeking a developer who: ✅ Has hands-on Databricks experience and can contribute immediately ✅ Understands enterprise data concepts and platform modernization initiatives ✅ Has strong ETL/ELT and data engineering experience ✅ Can partner effectively with architects, project managers, and business teams ✅ Is comfortable working in a fast-paced, highly visible enterprise transformation program ✅ Can help build a scalable lakehouse architecture supporting reporting, analytics, and future AI capabilities Originally posted on Himalayas