Senior Data Engineer

Brooksource is hiring a Senior Data Engineer for a 12-month contract-to-hire role based on-site in Kansas City, MO. In this position, you’ll help build and operate reliable data pipelines that turn raw inputs into clean, consumable datasets for enterprise analytics, reporting, and AI/ML usage.

What you’ll do

• Design, develop, and maintain scalable, reliable data pipelines and platforms supporting enterprise analytics and reporting.
• Partner with business and technical teams to understand data requirements and translate them into efficient data engineering solutions.
• Create ingestion frameworks using Kafka Confluent and integrate data from multiple cloud and on-premises sources.
• Build ELT/ETL pipelines using PySpark, SQL, Dataform, DBT, and Dataproc.
• Design and manage data models, schemas, and data warehousing structures optimized for performance and scalability.
• Improve trust in the data through validation, monitoring, and mechanisms that support consistency and integrity.
• Apply data governance practices including data lineage, metadata management, privacy, and compliance.
• Implement automated monitoring and alerting to support reliability, availability, and performance.
• Collaborate across teams to enable downstream reporting, analytics, and AI/ML model consumption.
• Follow engineering best practices for version control, documentation, and CI/CD workflows using Git and infrastructure-as-code tooling.
• Provide operational support for pipelines, proactively troubleshooting performance issues.
• Continuously optimize data processing, query execution, and resource utilization in Azure environments.
• Build and maintain RESTful API integrations to support data ingestion from and synchronization with web applications and enterprise systems.
• Contribute to lightweight web application efforts where data pipelines interface directly with front-end or full-stack components.

Core qualifications

• Education and experience: Bachelor Degree in Computer Science or related field with 8 years related professional experience (required). Alternatively: Associate Degree with 10 years, or High School Diploma/GED with 12 years.
• Strong programming skills in Python and PySpark for large-scale data processing.
• Proficiency in SQL for data manipulation, analysis, and performance tuning.
• Experience with Dataform, Dataproc, and BigQuery for pipeline development and orchestration.
• Understanding of Data Governance principles and implementation practices.
• Experience using Git for version control and CI/CD pipelines for automated deployments.
• Experience building and consuming RESTful APIs, including enterprise integrations: OAuth2, OpenID Connect, webhooks, pagination, rate limiting, retry logic, and error handling.
• Some hands-on web application development experience (full-stack or front-end).

Technologies you’ll work with

Python, PySpark, SQL, Dataform, DBT, Dataproc, BigQuery, Kafka, Confluent, Azure, Git, RESTful APIs, OAuth2, OpenID Connect, webhooks, Infrastructure as Code

Benefits

• Dental insurance
• Health insurance
• Vision insurance
• Health Savings Account, Dependent Care FSA, and supplemental coverage with plan options to fit employee needs
• 401k with company match; fully vested after eligibility
• Paid time off, sick time, and paid company holidays
• Employee Assistance Program (EAP) including virtual counseling, financial services, legal services, and life coaching

NICE TO HAVE

• Experience configuring and building pipelines within Databricks
• Working knowledge of Infrastructure as Code (IaC)
• Familiarity with DBT, Machine Learning, and AI concepts
• Hands-on experience with Kafka and Confluent for real-time streaming
• Knowledge of Cloud Scheduler and Dataflow for automation and workflow management
• Full-stack application development experience using Node.js, TypeScript, React, and Express
• Experience designing contract-first APIs (OpenAPI, Orval, Zod)
• Proficiency with React, Vite, Tailwind CSS, shadcn/ui, and TanStack Query
• Experience with PostgreSQL and ORM frameworks (Drizzle ORM preferred)
• Experience integrating engineering, construction, ERP, or project management systems
• Experience with metadata-driven applications, configurable mappings, and schema transformation frameworks
• Legally authorized to work permanently in the country where this position is located (without time limitations or restrictions, and without needing work sponsorship)

Compensation: USD 55 - 60 per hourly. Pay disclaimer: The pay range is a general guideline only and not a guarantee. Offer decisions may consider responsibilities, education, experience, skills, internal equity, market alignment, any applicable bargaining agreement, and other factors under applicable law.