Data Engineer - Databricks

Summary

Iberia Advisory is an award-winning Service-Disabled Veteran-Owned Small Business supporting critical government and defense initiatives. The company is seeking a Databricks Engineer to develop, integrate, and sustain secure, scalable data pipelines and processing solutions for U.S. Army financial management and data modernization. The role involves integrating enterprise data sources, ensuring data quality and governance, troubleshooting systems, and collaborating with technical and government stakeholders.

Responsibilities

• Design, develop, configure, and maintain data pipelines and data processing solutions within the Databricks platform, including scalable data ingestion, transformation, and integration processes
• Integrate data from Army financial and enterprise systems and other approved data sources, including modern data platforms, enterprise applications, and legacy systems through APIs and other integration technologies
• Develop data transformation logic, workflows, data models, and analytical datasets that support financial management, reporting, analytics, and execution requirements
• Build and maintain reliable data solutions while ensuring data quality, accuracy, consistency, governance, security, lineage, and appropriate access controls
• Troubleshoot data pipeline, integration, and application issues; support testing, deployment, documentation, lifecycle management, and ongoing system sustainment
• Collaborate with technical teams, government stakeholders, and project personnel to translate business requirements into effective data solutions, while assuming progressive responsibility for user intake, recurring run support, and issue resolution during the sustainment handoff period

Skills

• Experience developing and maintaining data pipelines in Databricks with strong knowledge of SQL and data engineering concepts
• Experience with data ingestion, transformation, integration, and processing, including working with enterprise data sources, databases, and/or ERP systems
• Experience developing scalable and reliable data solutions in a production environment
• Strong analytical and problem-solving skills, with the ability to troubleshoot technical issues and identify appropriate solutions
• Ability to work independently and manage multiple priorities in a dynamic environment
• Excellent written and verbal communication skills
• Experience with Apache Spark, Delta Lake, or related technologies
• Knowledge of DoW and Army financial management, ERP systems, and enterprise data environments
• Direct experience with Army platforms such as GFEBS or GCSS-Army
• Experience with complex system integrations

Qualifications

Must Haves

• Experience developing and maintaining data pipelines in Databricks with strong knowledge of SQL and data engineering concepts
• Experience with data ingestion, transformation, integration, and processing, including working with enterprise data sources, databases, and/or ERP systems
• Experience developing scalable and reliable data solutions in a production environment
• Strong analytical and problem-solving skills, with the ability to troubleshoot technical issues and identify appropriate solutions
• Ability to work independently and manage multiple priorities in a dynamic environment
• Excellent written and verbal communication skills

Nice to Haves

• Experience with Apache Spark, Delta Lake, or related technologies
• Knowledge of DoW and Army financial management, ERP systems, and enterprise data environments
• Direct experience with Army platforms such as GFEBS or GCSS-Army
• Experience with complex system integrations

Benefits

• Remote work in the United States
• A collaborative and supportive work environment.
• A community of growth-minded colleagues.
• Opportunities for professional growth and development, including 1:1 professional coaching with on-staff ICF coach.