Brooksource is hiring a Senior Data Engineer for a 12-month contract-to-hire role based on-site in Kansas City, MO. In this position, you’ll help build and operate reliable data pipelines that turn raw inputs into clean, consumable datasets for enterprise analytics, reporting, and AI/ML usage.
What you’ll do
- Design, develop, and maintain scalable, reliable data pipelines and platforms supporting enterprise analytics and reporting.
- Partner with business and technical teams to understand data requirements and translate them into efficient data engineering solutions.
- Create ingestion frameworks using Kafka Confluent and integrate data from multiple cloud and on-premises sources.
- Build ELT/ETL pipelines using PySpark, SQL, Dataform, DBT, and Dataproc.
- Design and manage data models, schemas, and data warehousing structures optimized for performance and scalability.
- Improve trust in the data through validation, monitoring, and mechanisms that support consistency and integrity.
- Apply data governance practices including data lineage, metadata management, privacy, and compliance.
- Implement automated monitoring and alerting to support reliability, availability, and performance.
- Collaborate across teams to enable downstream reporting, analytics, and AI/ML model consumption.
- Follow engineering best practices for version control, documentation, and CI/CD workflows using Git and infrastructure-as-code tooling.
- Provide operational support for pipelines, proactively troubleshooting performance issues.
- Continuously optimize data processing, query execution, and resource utilization in Azure environments.
- Build and maintain RESTful API integrations to support data ingestion from and synchronization with web applications and enterprise systems.
- Contribute to lightweight web application efforts where data pipelines interface directly with front-end or full-stack components.
Core qualifications
- Education and experience: Bachelor Degree in Computer Science or related field with 8 years related professional experience (required). Alternatively: Associate Degree with 10 years, or High School Diploma/GED with 12 years.
- Strong programming skills in Python and PySpark for large-scale data processing.
- Proficiency in SQL for data manipulation, analysis, and performance tuning.
- Experience with Dataform, Dataproc, and BigQuery for pipeline development and orchestration.
- Understanding of Data Governance principles and implementation practices.
- Experience using Git for version control and CI/CD pipelines for automated deployments.
- Experience building and consuming RESTful APIs, including enterprise integrations: OAuth2, OpenID Connect, webhooks, pagination, rate limiting, retry logic, and error handling.
- Some hands-on web application development experience (full-stack or front-end).
Technologies you’ll work with
Python, PySpark, SQL, Dataform, DBT, Dataproc, BigQuery, Kafka, Confluent, Azure, Git, RESTful APIs, OAuth2, OpenID Connect, webhooks, Infrastructure as Code
Benefits
- Dental insurance
- Health insurance
- Vision insurance
- Health Savings Account, Dependent Care FSA, and supplemental coverage with plan options to fit employee needs
- 401k with company match; fully vested after eligibility
- Paid time off, sick time, and paid company holidays
- Employee Assistance Program (EAP) including virtual counseling, financial services, legal services, and life coaching
NICE TO HAVE
- Experience configuring and building pipelines within Databricks
- Working knowledge of Infrastructure as Code (IaC)
- Familiarity with DBT, Machine Learning, and AI concepts
- Hands-on experience with Kafka and Confluent for real-time streaming
- Knowledge of Cloud Scheduler and Dataflow for automation and workflow management
- Full-stack application development experience using Node.js, TypeScript, React, and Express
- Experience designing contract-first APIs (OpenAPI, Orval, Zod)
- Proficiency with React, Vite, Tailwind CSS, shadcn/ui, and TanStack Query
- Experience with PostgreSQL and ORM frameworks (Drizzle ORM preferred)
- Experience integrating engineering, construction, ERP, or project management systems
- Experience with metadata-driven applications, configurable mappings, and schema transformation frameworks
- Legally authorized to work permanently in the country where this position is located (without time limitations or restrictions, and without needing work sponsorship)
Compensation: USD 55 - 60 per hourly. Pay disclaimer: The pay range is a general guideline only and not a guarantee. Offer decisions may consider responsibilities, education, experience, skills, internal equity, market alignment, any applicable bargaining agreement, and other factors under applicable law.
