EngineerJobs.io
← Back to all jobs
American Medical Association

Sr Data Engineer

American Medical Association
Chicago, IL $99k - $132k/yr Full time Posted 21d ago
Senior Cloud Data Warehouse Cloud Data Warehouse Data Engineer Data Integration Data Pipeline Data Platform Data Processing Data Warehouse Data Warehousing ETL Integration Snowflake SQL
Apply Now

Job Description

Join the AMA Insurance Technology team as a Sr Data Engineer supporting data ingestion, transformation, automation, and file-based integration validation in a hybrid role based in Chicago, IL.

Responsibilities

  • Process and clean Excel, CSV, and other flat files for claims and administration-related data at high volumes
  • Detect and resolve duplicates, inconsistencies, and data quality issues within incoming files
  • Transform files into the required schemes and formats for downstream consumption
  • Load, stage, update, and extract data in Snowflake
  • Run Snowflake jobs through both manual and scheduled executions
  • Prepare and transform rate data across multiple processing stages
  • Generate outbound data files and upload CSV outputs to EXL
  • Apply best-practice patterns for ingestion, transformation, modeling, and orchestration in a modern lakehouse environment
  • Develop and maintain PowerShell scripts from scratch and improve existing scripts as needed
  • Automate file transfers, manage FTP interactions, maintain directories, and send email notifications
  • Build automation solutions to improve operational efficiency
  • Write and optimize SQL queries, including complex joins and transformations
  • Update backend tables and implement data corrections
  • Prepare reports and datasets; make recommendations for analytics and operational needs
  • Handle database troubleshooting and perform data validation activities
  • Develop Python scripts for file-based automation (movement, copying, editing, and integration tasks)
  • Own end-to-end automation of data and file workflows
  • Proactively profile queries, tune execution plans, establish efficient indexing strategies, and set appropriate partitioning layers to reduce latency in high-compute workloads

Requirements

  • Bachelor's degree (P1+/M1+)
  • 5+ years of experience in ETL/ELT pipeline development, data integration, and process automation
  • Proven ability to multi-task and manage multiple concurrent projects with minimal supervision

Tools & Technologies

  • Snowflake
  • PowerShell
  • SQL
  • Python
  • Excel, CSV
  • FTP
  • EXL

Location & Work Schedule

  • Chicago, IL (hybrid)
  • 3 days per week in-office

Compensation

  • USD 99,410 - 131,637 per year

Benefits

  • Eligible to participate in an incentive plan

Similar Jobs