Data Engineer

Summary

1872 Consulting is the world's leading B2B research company, utilizing AI-driven search technology to connect professionals across various industries. They are looking for passionate data engineers to develop and enhance key systems, solve data problems, and influence data technologies within a growing team.

Responsibilities

• Build reliable data pipelines to clean, aggregate, and transform large volumes of data from multiple sources
• Develop versatile software components to extract useful information from various unstructured or semi-structured text data
• Improve the performance and quality of search services
• Build effective data API endpoints to support data applications across the company

Skills

• 3+ yrs experience in software development
• Strong proficiency with Python
• Hands-on experience building large scale batch and streaming data pipelines with mainstream big data stack preferably GCP dataflow
• Bachelor's degree or greater in relevant field of study
• Experience working with a major Cloud platform (AWS, Azure, GCP), preferably GCP
• Experience with Elasticsearch
• Experience in NLP or Text Mining
• Experience building Flask microservices
• Experience writing SQL, particularly in BigQuery

Qualifications

Must Haves

• 3+ yrs experience in software development
• Strong proficiency with Python
• Hands-on experience building large scale batch and streaming data pipelines with mainstream big data stack preferably GCP dataflow
• Bachelor's degree or greater in relevant field of study

Nice to Haves

• Experience working with a major Cloud platform (AWS, Azure, GCP), preferably GCP
• Experience with Elasticsearch
• Experience in NLP or Text Mining
• Experience building Flask microservices
• Experience writing SQL, particularly in BigQuery

Benefits

• 10-15K bonus
• Stock options (more salary, less equity or less salary, more equity