Azure Data Engineer

Summary

Abode TechZone, LLC is seeking an Azure Data Engineer with deep Microsoft Fabric expertise to develop and optimize a next-generation data analytics platform. The role focuses on designing end-to-end data pipelines, building scalable OneLake and Lakehouse architectures, transforming data with PySpark and Python, and integrating semantic models with Power BI. The engineer will also support performance tuning, governance, security, and CI/CD deployment workflows.

Responsibilities

• **Fabric Architecture Design:** Architect and deploy end-to-end data engineering solutions leveraging the Microsoft Fabric ecosystem including OneLake, Lakehouses, Warehouses, and Streamhouses
• **Pipeline Development:** Design, build, and maintain scalable ETL/ELT pipelines using Fabric Datafactory, Pipelines, and Dataflows Gen2
• **Data Processing & Transformation:** Write complex, optimized data transformation scripts using PySpark, Spark SQL, and Python within Fabric Notebooks
• **Modern Data Warehousing:** Implement a Medallion Architecture (Bronze/Silver/Gold layers) inside OneLake utilizing Delta Lake formats for Delta Live Tables
• **Performance Tuning:** Optimize query speeds and pipeline performance through strategic file partitioning, indexing, and workspace capacity management
• **Data Modeling & Analytics Integration:** Construct and optimize Fabric Semantic Models to ensure seamless, high-performance integration with Power BI reporting
• **Governance & Security:** Enforce enterprise data security using Fabric RBAC, Azure Key Vault, Managed Identities, and Microsoft Purview for metadata lineage
• **DevOps Integration:** Implement CI/CD workflows using Git integration and Azure DevOps to automate code deployment across development, testing, and production environments

Skills

• Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related technical field
• Minimum 3+ years of professional experience in Azure Data Engineering, with at least 1 year of dedicated hands-on experience working directly inside Microsoft Fabric
• Advanced proficiency in SQL, Python, and PySpark
• Deep knowledge of Fabric Lakehouse, Dataflows Gen2, Shortcuts, and Fabric Notebooks
• Solid background in traditional Azure data stack tools like Azure Data Factory (ADF), Azure Synapse Analytics, and ADLS Gen2
• Strong comprehension of Kimball data warehousing methodologies, dimensional modeling, and Delta Lake frameworks
• First preference in Phoenix, AZ

Qualifications

Must Haves

• Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related technical field
• Minimum 3+ years of professional experience in Azure Data Engineering, with at least 1 year of dedicated hands-on experience working directly inside Microsoft Fabric
• Advanced proficiency in SQL, Python, and PySpark
• Deep knowledge of Fabric Lakehouse, Dataflows Gen2, Shortcuts, and Fabric Notebooks
• Solid background in traditional Azure data stack tools like Azure Data Factory (ADF), Azure Synapse Analytics, and ADLS Gen2
• Strong comprehension of Kimball data warehousing methodologies, dimensional modeling, and Delta Lake frameworks

Nice to Haves

• First preference in Phoenix, AZ

Benefits

• Remote work arrangement with occasional travel to Phoenix, AZ