SAPSOL Technologies Inc.
Azure Data Engineer
Must Have: Certification: Required – Microsoft Certified: Azure Data Engineer Associate (or higher), Azure Data Factory, Job Summary: We are seeking a highly skilled Data Engineer with strong expertise in Azure Data Factory , Azure Databricks , Oracle , and PostgreSQL . The ideal candidate will design and implement robust data pipelines, optimize data flows, and contribute to our cloud data platform initiatives using the Microsoft Azure ecosystem. Key Responsibilities: • Design, build, and maintain scalable data pipelines using Azure Data Factory and Databricks (Spark-based) . • Ingest, transform, and orchestrate data from various sources including Oracle and PostgreSQL databases. • Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and deliver clean, reliable data. • Optimize performance of data workflows, especially within Azure environments. • Implement data quality checks, lineage tracking, and monitoring processes. • Follow and contribute to data governance, security, and compliance policies. • Participate in code reviews, documentation, and continuous improvement initiatives. Required Skills & Experience: • Strong hands-on experience with Azure Data Factory and Azure Databricks (PySpark/Scala preferred). • Solid working knowledge of Oracle and PostgreSQL databases, including writing efficient SQL queries. • Proficient in building ETL/ELT workflows and data orchestration on Azure. • Experience with Azure storage solutions (Blob Storage, ADLS Gen2). • Strong understanding of data modeling, warehousing concepts, and performance optimization. • Familiarity with CI/CD pipelines in Azure DevOps is a plus. • Excellent problem-solving skills and ability to work independently or in a team. Originally posted on Himalayas
