Diverse Lynx
Posted 3 days agoVerified live 2d ago
Data Engineer
Brief overview
Remote
UndergradOr in progress
3+ yrsMinimum
1 H-1B approvalsDept. of Labor
Azure Synapse AnalyticsAzure Data FactoryAzure DatabricksSQL Stored ProceduresPythonPySparkAPI IntegrationAzure StorageAzure Key VaultCI/CD Pipeline DesignGitHubPower BI
About the company
Diverse Lynxdiverselynx.com
Diverse Lynx is a WBENC- and NMSDC-certified partner, helping organizations turn diversity goals into measurable impact through staffing and contingent workforce solutions.
Visa sponsorship history
1 year sponsoring, last filed FY2025
Data powered by U.S. Department of Labor. This does not guarantee sponsorship for this specific role.1H-1B approved
100%approval rate
H-1B Petition ApprovalsVisas USCIS actually granted: the strongest sign the company sponsors.
20251
Job description
Summary
Diverse Lynx is seeking a Data Engineer to support cloud-based data engineering and analytics initiatives. The role focuses on Azure data services, data pipelines, SQL stored procedures, Python and PySpark development, API integrations, CI/CD deployments, debugging, and Power BI.
Responsibilities
- Hands on Experience in Azure Synapse Analytics, Azure Data Factory and Data Bricks, Azure Storage, Azure Key Vault, SQL Pools CI/CD Pipeline Designing and other Azure services like functions, logic apps - Linked services, Various Runtimes, Datasets, Pipelines, Activities
- Strong Hands-on Experience in Various Activities like Control flow logic and conditions (For Each, if, switch, until), Lookup, Stored procedure, scripts, validations, Copy Data, Data flow, Azure functions, Notebooks, SQL Pool Stored procedures etc
- Strong hands on exp in deployment of code throughout landscape (Dev -> QA -> Prod), Git Hub, CI/CD pipelines etc
- Strong hands on creating the SQL stored procedures - Functions, Stored Procedures, how to call one SP into another, how to process record-by-record - Dynamic SQL - Data Bricks - Must have
- Strong background about the Python libraries like PySpark, Pandas, NumPy, MySQL, Oracle, PySpark libraries
- Must have strong hands on to get data through APIs
- Must be able to install libraries and help users to troubleshoot issues
- Must have knowledge to get the data through stored procedures via Python
- Should be able to debug the Python code Hands on experience in Spark Pools, Spark
- Should be able to merge data/delta loads through Notebooks
- Must have strong background about the Python libraries and PySpark - Hands on Exp on Power BI
Skills
- Hands on Experience in Azure Synapse Analytics, Azure Data Factory and Data Bricks, Azure Storage, Azure Key Vault, SQL Pools CI/CD Pipeline Designing and other Azure services like functions, logic apps - Linked services, Various Runtimes, Datasets, Pipelines, Activities
- Strong Hands-on Experience in Various Activities like Control flow logic and conditions (For Each, if, switch, until), Lookup, Stored procedure, scripts, validations, Copy Data, Data flow, Azure functions, Notebooks, SQL Pool Stored procedures etc
- Strong hands on exp in deployment of code throughout landscape (Dev -> QA -> Prod), Git Hub, CI/CD pipelines etc
- Strong hands on creating the SQL stored procedures - Functions, Stored Procedures, how to call one SP into another, how to process record-by-record - Dynamic SQL - Data Bricks - Must have
- Strong background about the Python libraries like PySpark, Pandas, NumPy, MySQL, Oracle, PySpark libraries
- Must have strong hands on to get data through APIs
- Must be able to install libraries and help users to troubleshoot issues
- Must have knowledge to get the data through stored procedures via Python
- Should be able to debug the Python code Hands on experience in Spark Pools, Spark
- Should be able to merge data/delta loads through Notebooks
- Must have strong background about the Python libraries and PySpark - Hands on Exp on Power BI
Qualifications
Must Haves
- Hands on Experience in Azure Synapse Analytics, Azure Data Factory and Data Bricks, Azure Storage, Azure Key Vault, SQL Pools CI/CD Pipeline Designing and other Azure services like functions, logic apps - Linked services, Various Runtimes, Datasets, Pipelines, Activities
- Strong Hands-on Experience in Various Activities like Control flow logic and conditions (For Each, if, switch, until), Lookup, Stored procedure, scripts, validations, Copy Data, Data flow, Azure functions, Notebooks, SQL Pool Stored procedures etc
- Strong hands on exp in deployment of code throughout landscape (Dev -> QA -> Prod), Git Hub, CI/CD pipelines etc
- Strong hands on creating the SQL stored procedures - Functions, Stored Procedures, how to call one SP into another, how to process record-by-record - Dynamic SQL - Data Bricks - Must have
- Strong background about the Python libraries like PySpark, Pandas, NumPy, MySQL, Oracle, PySpark libraries
- Must have strong hands on to get data through APIs
- Must be able to install libraries and help users to troubleshoot issues
- Must have knowledge to get the data through stored procedures via Python
- Should be able to debug the Python code Hands on experience in Spark Pools, Spark
- Should be able to merge data/delta loads through Notebooks
- Must have strong background about the Python libraries and PySpark - Hands on Exp on Power BI
More jobs like this
