Summary
Diverse Lynx is hiring for a Google Cloud Platform data engineering role. The position focuses on designing scalable data pipelines, developing batch and real-time ETL/ELT workflows, managing GCP data services, and ensuring data quality, security, governance, and performance.
Responsibilities
- Design, develop, and maintain scalable data pipelines using GCP services
- Build and optimize ETL/ELT workflows for batch and real-time data processing
- Develop and manage data solutions using BigQuery, Dataflow, Dataproc, Cloud Composer, Pub/Sub, and GCS
- Create and maintain robust data models and data warehouses
- Ensure data quality, governance, security, and performance optimization
- Collaborate with business stakeholders, analysts, and engineering teams to deliver data-driven solutions
- Troubleshoot production issues and perform performance tuning
- Implement CI/CD and automation best practices for data platforms
- Create technical documentation and support knowledge-sharing initiatives
Skills
- BigQuery
- Dataflow
- Dataproc
- Cloud Composer (Airflow)
- Cloud Storage (GCS)
- Pub/Sub
- Cloud Functions (preferred)
Qualifications
Must Haves
- BigQuery
- Dataflow
- Dataproc
- Cloud Composer (Airflow)
- Cloud Storage (GCS)
- Pub/Sub
Nice to Haves
- Cloud Functions (preferred)