Data Engineer (Databricks)

Summary

Fluent is building the next generation advertising network focused on Partner Monetize and Advertiser Acquisition. The Data Engineer will use Databricks, Python, SQL, and Spark to build and operate audience data products and pipelines, translate business requirements into engineering solutions, and partner with Data Science and commercial teams.

Responsibilities

• Majority of the role will be data engineering: tables, views, jobs/pipelines, and orchestration within the Databricks environment, following Fluent’s data model and architecture best practices. You will help elevate standards across testing, code repository, ci/cd, and naming conventions
• Build and maintain pipelines that create and deliver syndicated and custom audience segments, spanning declared (survey-based) and modeled (ML driven) methodologies
• Support delivery and performance reporting of finished segments on distribution marketplaces such as LiveRamp, TruAudience (TransUnion), and Lotame
• Investigate and leverage Databricks' latest capabilities for real-time processing and operational workloads, such as Spark structured Streaming and Lakeflow Declarative Pipelines
• Contribute to and maintain a high-quality codebase with comprehensive data observability, metadata standards, and best practices, including compliant handling of consumer data in line with Fluent's data privacy standards
• Apply AI-assisted development practices, using tools such as Claude Code, to accelerate pipeline development, testing, and documentation, while upholding Fluent's engineering and data quality standards
• Partner with the Data Engineering team, Data Science, and commercial stakeholders to define business requests and translate them into functional requirements
• Keep track of emerging tech and trends within the Databricks ecosystem
• Share your knowledge by giving brown bags, tech talks, and evangelizing appropriate tech and engineering best practices
• Empower internal teams by providing communication on architecture, execution plans, releases, and training

Skills

• Bachelor's or Master's degree in computer science or related field
• 4+ years of industry experience in Data Engineering, including expertise in SQL, Python, Spark, and distributed processing
• 2+ years of experience with Databricks environment leveraging Data Engineering and Data Warehousing features such as Jobs & Workflows, Notebooks, Unity Catalog, and Delta Lake
• Strong foundation in database design, data structures, and algorithms
• Experience using AI coding assistants (e.g., Claude Code, GitHub Copilot) as part of a modern engineering workflow
• Nice to have: familiarity with Databricks emerging technologies and latest offerings such as: Genie, Lakebase, AI/BI Dashboards, Databricks Apps
• Nice to have: Prior experience in digital marketing, ad-tech, media/advertising, or related field
• In addition, familiarity with audience, identity, or consumer segmentation data, and experience with data marketplaces such as LiveRamp, TransUnion, and/or Lotame

Qualifications

Must Haves

• Bachelor's or Master's degree in computer science or related field
• 4+ years of industry experience in Data Engineering, including expertise in SQL, Python, Spark, and distributed processing
• 2+ years of experience with Databricks environment leveraging Data Engineering and Data Warehousing features such as Jobs & Workflows, Notebooks, Unity Catalog, and Delta Lake
• Strong foundation in database design, data structures, and algorithms
• Experience using AI coding assistants (e.g., Claude Code, GitHub Copilot) as part of a modern engineering workflow

Nice to Haves

• Nice to have: familiarity with Databricks emerging technologies and latest offerings such as: Genie, Lakebase, AI/BI Dashboards, Databricks Apps
• Nice to have: Prior experience in digital marketing, ad-tech, media/advertising, or related field
• In addition, familiarity with audience, identity, or consumer segmentation data, and experience with data marketplaces such as LiveRamp, TransUnion, and/or Lotame

Benefits

• Fully remote in the United States or Canada, with occasional travel to NYC.
• Fully stocked kitchen, catered breakfast and lunch, and activity-filled events.
• Recreational sports leagues, networking with She Runs It, and quarterly outings to baseball games, fancy dinners, and pizza-making classes.
• Ample career and professional growth opportunities.
• Health, dental, and vision insurance.
• Pre-tax savings plans and transit/parking programs.
• 401K with competitive employer match.
• Volunteer and philanthropic activities throughout the year.
• Educational and social events.