Data Engineer--US Citizens/Green Card

Summary

Software Technology Inc. is currently seeking a Data Engineer to join their team. The role involves developing and deploying data pipelines, creating data models, and working with various data technologies in a cloud environment.

Responsibilities

• Experience working in Azure Databricks, Apache Spark
• Proficient programming in Scala/Python/Java
• Experience developing and deploying data pipelines for streaming and batch data sources getting from multiple sources
• Experience creating data models and implementing business logic using tools and languages listed
• Working knowledge in Kafka, Structured Streaming, DataFrame API, SQL, NoSQL Database
• Comfortable with API, Azure Datalake, Git, Notebooks, Spark Cluster, Spark Jobs, Performance tuning
• Must have excellent communication skills
• Familiarity with Power BI, Delta Lake, Lambda Architecture, Azure Data Factory, Azure Synapse a plus
• Telecom domain experience not necessary but really helpful

Skills

• Experience working in Azure Databricks, Apache Spark
• Proficient programming in Scala/Python/Java
• Experience developing and deploying data pipelines for streaming and batch data sources getting from multiple sources
• Experience creating data models and implementing business logic using tools and languages listed
• Working knowledge in Kafka, Structured Streaming, DataFrame API, SQL, NoSQL Database
• Comfortable with API, Azure Datalake, Git, Notebooks, Spark Cluster, Spark Jobs, Performance tuning
• Must have excellent communication skills
• Familiarity with Power BI, Delta Lake, Lambda Architecture, Azure Data Factory, Azure Synapse a plus
• Telecom domain experience not necessary but really helpful

Qualifications

Must Haves

• Experience working in Azure Databricks, Apache Spark
• Proficient programming in Scala/Python/Java
• Experience developing and deploying data pipelines for streaming and batch data sources getting from multiple sources
• Experience creating data models and implementing business logic using tools and languages listed
• Working knowledge in Kafka, Structured Streaming, DataFrame API, SQL, NoSQL Database
• Comfortable with API, Azure Datalake, Git, Notebooks, Spark Cluster, Spark Jobs, Performance tuning
• Must have excellent communication skills

Nice to Haves

• Familiarity with Power BI, Delta Lake, Lambda Architecture, Azure Data Factory, Azure Synapse a plus
• Telecom domain experience not necessary but really helpful