Dice logo
Dice
Posted 21 days agoVerified live 5h ago

IAM Hub: Data Engineering and Reporting

Brief overview

Remote
UndergradOr in progress
$80–$85/hrStated range
4+ yrsMinimum
Data EngineeringBigQueryGoogle Cloud PlatformEnd-to-End Data Pipeline DevelopmentdbtAirflow / Cloud ComposerPythonMicrosoft Power BIChange Data CaptureStreaming IngestionActive Directory / LDAPCosmos DB

About the company

Dice is the go-to career marketplace for tech professionals.

Job description

Summary

CTG delivers IT and business solutions that enhance clients' digital agility and help them seize new opportunities. The Senior Data Engineer will own complex identity and access management data engineering work, including pipeline development, data governance, business intelligence, analytics, and reporting. The role also involves implementing data certification frameworks, reverse ETL enhancements, schema registry capabilities, and comprehensive documentation.

Responsibilities

  • Build and certify identity source pipelines: AD LDAP (Bronze Gold), Entra Event Hub ETL, SailPoint history recovery and CDC assessment
  • Implement and operationalize dataset certification framework - DBT test suite, CI/CD gate, schema change alerting
  • Support SCD 2 completion and Gold layer fact table validation in coordination with Mayo data engineering team
  • Contribute to Power BI report delivery and semantic model design across all three report batches
  • Implement reverse ETL delta enhancement - CDC-based push to Cosmos DB, replacing current full primary key scan
  • Build contract schema registry with version-aware drift detection and migration window support
  • Author pipeline runbooks and full handoff documentation for client team

Skills

  • * 4+ years data engineering with BigQuery and Google Cloud Platform
  • * End-to-end pipeline development - ingest, transform, serve
  • * DBT - test authoring, incremental models, model design
  • * Airflow / Cloud Composer DAG development
  • * Python for pipeline logic and tooling
  • * Power BI - can build and publish reports against a semantic model
  • * Familiarity with CDC patterns and streaming ingestion
  • Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required
  • * Active Directory / LDAP query and pipeline experience
  • * Cosmos DB or NoSQL serving layer
  • * SailPoint or IGA source system familiarity
  • * Debezium, DataStream, or Pub/Sub
  • * Terraform / infrastructure-as-code
  • * Private networking constraints on Google Cloud Platform or Azure

Qualifications

Must Haves

  • * 4+ years data engineering with BigQuery and Google Cloud Platform
  • * End-to-end pipeline development - ingest, transform, serve
  • * DBT - test authoring, incremental models, model design
  • * Airflow / Cloud Composer DAG development
  • * Python for pipeline logic and tooling
  • * Power BI - can build and publish reports against a semantic model
  • * Familiarity with CDC patterns and streaming ingestion
  • Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required

Nice to Haves

  • * Active Directory / LDAP query and pipeline experience
  • * Cosmos DB or NoSQL serving layer
  • * SailPoint or IGA source system familiarity
  • * Debezium, DataStream, or Pub/Sub
  • * Terraform / infrastructure-as-code
  • * Private networking constraints on Google Cloud Platform or Azure

More jobs like this