Dice
Posted 82 days agoVerified live 4d ago
Data Engineer
Brief overview
Santa Clara, CAIn-person
MastersOr in progress
$135k–$180k/yrStated range
1+ yrsMinimum
PythonSQLMicroservicesDatabasesData pipelinesData modelsDatabase designData miningSegmentation techniquesMapReduceSparkKafkaAWS S3AWS EC2AWS RDSSoftware designSoftware development
About the company
Dicedice.com
Dice is the go-to career marketplace for tech professionals.
Job description
Summary
PlusAI is a Physical AI company pioneering AI-based virtual driver software for factory-built autonomous trucks. They are seeking a Data Engineer to create and maintain optimal data processing pipeline architecture, build infrastructure for data extraction and loading, and provide actionable insights into business performance metrics.
Responsibilities
- Create and maintain optimal data processing pipeline architecture
- Build the infrastructure required for optimal extraction, transformation, and loading of data using SQL and big data technologies
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics
- Interpret data, analyze results using statistical techniques and provide ongoing reports
- Identify, analyze, and interpret trends or patterns in complex data sets
- Work with stakeholders including the Executive, Engineering, and Operation teams to assist with data-related technical issues and support their data infrastructure, analysis, and reporting needs
- Keep our data secure through multiple data centers and AWS regions
Skills
- MS in Computer Science, Electrical Engineering, or related field
- 1+ years of software engineering experience
- Good oral and written communication skills
- Expertise in Python, SQL, microservices, databases, data pipelines
- Technical expertise regarding data models, database design and development, data mining and segmentation techniques
- Experience with large scale data processing, e.g. MapReduce, Spark, Kafka
- Experience with AWS core technologies such as S3, EC2, RDS
- Extensive software design and development skills
- Ability to learn and adapt to new technologies and contribute in a productive environment
- Strong knowledge of and experience with reporting packages
- Experience with deep learning frameworks (e.g. TensorFlow, PyTorch)
- Experience working with autonomous vehicles or robotics
Qualifications
Must Haves
- MS in Computer Science, Electrical Engineering, or related field
- 1+ years of software engineering experience
- Good oral and written communication skills
- Expertise in Python, SQL, microservices, databases, data pipelines
- Technical expertise regarding data models, database design and development, data mining and segmentation techniques
- Experience with large scale data processing, e.g. MapReduce, Spark, Kafka
- Experience with AWS core technologies such as S3, EC2, RDS
- Extensive software design and development skills
- Ability to learn and adapt to new technologies and contribute in a productive environment
- Strong knowledge of and experience with reporting packages
Nice to Haves
- Experience with deep learning frameworks (e.g. TensorFlow, PyTorch)
- Experience working with autonomous vehicles or robotics
Benefits
- Wide range of opportunities for personal and professional development.
- Catered free lunch, unlimited snacks and beverages.
- Highly competitive salary and benefits package, including 401(k) plan.