Silverthorne Advisory Group logo
Silverthorne Advisory Group
Verified live 2d ago

Data Engineer (All Levels)

Brief overview

Arlington, VAIn-person
Clearance requiredU.S. government
ETL processesDatabricksPythonSparkScalaJavaScript/JSONSQLJupyter NotebooksBig data technologiesData modelingData visualizationDatabase designData governanceProblem-solvingCommunicationCollaborationData cleansing

About the company

Silverthorne Advisory Group logo
Silverthorne Advisory Groupsilverthorneadvisory.com

Silverthorne Advisory Group is a data, cloud engineering, management and IT consulting firm.

Job description

Summary

Silverthorne Advisory Group is seeking a skilled and highly motivated Data Engineer to join an exciting and growing opportunity within the Defense sector. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our Advana data infrastructure and systems.

Responsibilities

  • Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks
  • Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing
  • Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets
  • Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency
  • Troubleshoot data-related problems and provide innovative solutions to address complex data challenges
  • Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices
  • Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures
  • Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes
  • Maintain documentation for software applications, workflows, and processes
  • Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement

Skills

  • Secret clearance or higher required (can be sponsored)
  • High level of proficiency in ETL processes and demonstrated, hands-on experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks
  • Strong problem-solving skills and ability to solve complex data-related issues
  • Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently
  • Understanding of data modeling/visualization, database design principles, and data governance practices
  • Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams
  • Detail-oriented mindset with a commitment to delivering high-quality results

Qualifications

Must Haves

  • Secret clearance or higher required (can be sponsored)
  • High level of proficiency in ETL processes and demonstrated, hands-on experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks
  • Strong problem-solving skills and ability to solve complex data-related issues
  • Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently
  • Understanding of data modeling/visualization, database design principles, and data governance practices
  • Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams
  • Detail-oriented mindset with a commitment to delivering high-quality results

Benefits

  • Retirement Plan
  • 401(k)
  • 401(k) matching
  • Bonus based on performance
  • Company parties
  • Competitive salary
  • Dental insurance
  • Health insurance
  • Opportunity for advancement
  • Paid time off
  • Training & development
  • Vision insurance

More jobs like this