Data Engineer II

The Data Engineer II role sits within the Data & Analytics organization on the Warehousing & Pipelines team. The position focuses on building and evolving enterprise data integration solutions that support operational reporting, analytics, machine learning, and broader data initiatives.

Team Collaboration

• Work with the Data & Analytics team in the Warehousing & Pipelines function.
• Collaborate with DBAs, Data Architects, BI Developers, Data Scientists, Software Engineers, and business stakeholders.

Core Responsibilities

• Design, develop, test, deploy, and maintain batch and streaming data pipelines for payment processing systems with strict availability and performance requirements.
• Build data integration solutions using SQL, C#, Python, PowerShell, and related automation technologies.
• Develop and support event-driven architectures using Change Data Capture (CDC), Kafka, messaging platforms, and stream-processing technologies.
• Maintain and modernize legacy data integration solutions, including SQL Server Integration Services (SSIS), and transition workloads toward code-first, version-controlled development practices.
• Create and maintain CI/CD pipelines for data integration, analytics, and data platform solutions.
• Implement monitoring, logging, alerting, and observability for data platforms and pipelines.
• Partner with Data Architects and enterprise data governance teams to populate and maintain enterprise data warehouse, lakehouse, and analytical data platform solutions.
• Tune SQL queries and database interactions to reduce impact on source systems and improve application performance.
• Optimize data pipelines to improve throughput, scalability, resiliency, and cost efficiency.
• Produce and maintain technical documentation, architectural diagrams, operational runbooks, and deployment procedures.
• Use AI-assisted development tools responsibly to improve productivity and code quality, while independently validating, reviewing, and testing all generated code.
• Participate in on-call rotations and provide after-hours support as required.
• May perform other job duties as assigned.

Required Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or Engineering.
• Minimum 3 years of experience in data engineering, software engineering, or database development.
• Experience developing solutions on relational database platforms such as SQL Server and/or MySQL.
• Experience developing applications or services using C# or similar object-oriented programming languages.
• Experience developing and supporting ETL/ELT and data integration solutions.
• Experience working with source control systems such as Git, including code reviews and pull request workflows.
• Experience with containerization technologies such as Docker.

Preferred Qualifications

• Experience modernizing legacy analytics platforms, OLAP solutions, or analytical workloads.
• Experience with cloud services and data platforms in GCP, AWS, and/or Azure.
• Experience with Infrastructure as Code (IaC) using Terraform, Pulumi, Bicep, Ansible, or similar technologies.
• Experience building and supporting Kubernetes-based applications and services.
• Experience building and supporting data lakes and lakehouses, including open table format solutions such as Apache Iceberg, Delta Lake, Hudi, and Parquet.
• Experience operating under PCI DSS, SOC, financial services, healthcare, or other regulatory frameworks.

Technology Stack

SQL, C#, Python, PowerShell, Change Data Capture (CDC), Kafka, SQL Server Integration Services (SSIS), CI/CD, Git, Docker, MySQL, ETL/ELT

Location and Interview Requirements

• Remote position based in the Allen, TX 75013 area.
• Candidates must live within approximately a 70-mile radius of office locations in Allen, TX; Lenexa, KS; Springfield, MO; or Monett, MO; and Louisville, KY; Troy, MI; or Birmingham, AL.
• All positions, regardless of location, may require an onsite interview or in-person onboarding requirement to verify identity.