Summary
Georgia IT, Inc. is a company seeking a Data Engineer to design and implement data ingestion and pipeline workflows. The role involves collaborating with team members, preparing specifications, and ensuring compliance with security standards for handling sensitive data.
Responsibilities
- Design and implement data ingestion and pipeline workflows based on business needs and technical specifications
- Collaborate with team members and leaders, providing progress updates
- Prepare detailed specifications for the development of data ingestion processes
- Develop, configure, and troubleshoot technical solutions
- Query databases using SQL for analysis and bug troubleshooting
- Develop and execute testing and implementation plans (unit, system, integration, and UAT)
- Participate in project planning and estimation of coding work
- Conduct reviews of solution designs, configurations, and code
- Provide technical expertise for project and baseline support
- Ensure compliance with security standards for handling sensitive data
- Recommend and adhere to development standards
Skills
- 4-Year Bachelor's Degree
- 3+ years of professional experience
- Google Pub/Sub
- BigQuery
- Google Dataform
- Data ingestion to BigQuery
- Google Cloud Storage
- Cloud Composer
- GitHub
- SQL
- Software SDLC
- DBMS connectivity (SQL Server, DB2, Oracle)
- Experience with RESTful APIs and SOAP Webservices
- BigQuery Query Optimization
- Jira, Confluence
- Dataflow, Terraform
- Python
- Agile Methodology
- CI/CD tools
Qualifications
Must Haves
- 4-Year Bachelor's Degree
- 3+ years of professional experience
- Google Pub/Sub
- BigQuery
- Google Dataform
- Data ingestion to BigQuery
- Google Cloud Storage
- Cloud Composer
- GitHub
- SQL
- Software SDLC
Nice to Haves
- DBMS connectivity (SQL Server, DB2, Oracle)
- Experience with RESTful APIs and SOAP Webservices
- BigQuery Query Optimization
- Jira, Confluence
- Dataflow, Terraform
- Python
- Agile Methodology
- CI/CD tools