Data Engineer

Data Engineer at the Palmer College Foundation in Davenport, IA (onsite), focused on governed data delivery and cloud data platform support.

Responsibilities

• Design, build, and support reliable ETL/ELT pipelines and data integrations that move information across enterprise applications, databases, cloud platforms, APIs, and external partners.
• Administer and enhance Snowflake data structures, including security, transformations, and automated processing for operational and analytical workloads.
• Prepare governed data to support reporting, analysis, and institutional decision-making.
• Support data migrations and system implementations using mapping, transformation, testing, reconciliation, and production deployment.
• Monitor and troubleshoot data processes; strengthen data quality and security controls.
• Maintain technical documentation and collaborate with College stakeholders and vendors during integrations and implementations.

Requirements

• Bachelor’s degree or an equivalent combination of relevant education and professional experience.
• Three years of professional experience in data engineering, data warehousing, data integration, database development, or a closely related field.
• Proven experience developing production SQL and Python solutions and supporting ETL/ELT pipelines in a cloud or enterprise setting.
• Experience with relational databases, APIs, structured data files, source control, testing, troubleshooting, and technical documentation.
• Excellent customer service and communication skills, including effective collaboration with individuals at all levels and with external vendors/support partners.
• Strong organization, accuracy, thoroughness, accountability, and commitment to work quality.
• Regular and reliable attendance; availability for scheduled evening or weekend work and response to critical production issues as required.

Technologies

• ETL/ELT, SQL, Python
• Azure Data Factory, Azure Blob Storage, Azure Batch, Azure DevOps
• Snowflake
• REST APIs, CSV, XML, JSON, SFTP

Required Technical Skills and Competencies

• ETL/ELT development, orchestration, data integration, transformation, staging, file processing, migration, and reconciliation.
• Advanced SQL and Python scripting for data processing, automation, validation, testing, and integration.
• Azure identity, monitoring, networking, and security services in support of Azure Data Factory, Azure Blob Storage, Azure Batch, and Azure DevOps.
• Snowflake administration and development, including dimensional and relational design, schemas, tables, views, stages, ingestion, transformations, workload management, and query optimization.
• Authentication methods and automated file transfers.
• Metadata management and cataloging, including lineage, data products, business glossaries, stewardship, and technical documentation.
• Pipeline monitoring, logging, alerting, incident diagnosis, data reconciliation, root-cause analysis, and data quality controls.
• Technical writing, source-to-target mapping, stakeholder communication, requirements analysis, estimation, and cross-functional problem-solving.
• Role-based access control, secrets management, secure data transfer, least privilege, and responsible handling of regulated and sensitive data.

Additional Skills and Qualifications

• Strong interest in institutional data and building practical solutions for complex data challenges.
• Ability to translate business requirements into supportable technical designs and explain technical concepts to nontechnical stakeholders.
• Strong analytical, troubleshooting, organizational, time-management, documentation, and communication skills.
• Ability to work independently, manage competing priorities, and collaborate effectively in a service-oriented, team-based environment.
• Commitment to accuracy, security, maintainability, continuous improvement, and customer service.
• Ability to quickly learn College goals, business processes, data domains, systems, and operating constraints.
• Experience designing, building, testing, deploying, monitoring, and maintaining data pipelines, platforms, applications, and warehouse objects that meet institutional standards.
• Ability to manage data storage and access, optimize schemas and queries, and protect data quality and integrity.
• Ability to prioritize and complete work under production deadlines, frequent interruptions, and multiple concurrent responsibilities.
• Participation in scheduled maintenance, production support, and after-hours incident response when required.
• Hands-on experience with Azure Data Factory, Azure Blob Storage, Azure Batch, Azure DevOps, and Azure monitoring or security services.
• Hands-on Snowflake administration and development experience, including role-based access, stages, tasks, stored procedures, query optimization, and warehouse cost management.
• Experience supporting enterprise data migrations, system implementations, data reconciliation, and production cutovers.
• Knowledge of higher-education data domains and privacy/security requirements, including FERPA, HIPAA, and PCI DSS.

Organizational Relationships

• Reports to the Director of Applications and has support responsibility to all other departments and College personnel as necessary.

Physical Requirements and Work Environment

• Sedentary to light work in a ventilated, lighted, and temperature-controlled office setting.
• Frequent need to stand, stoop, walk, sit, lift light objects up to 10 pounds, and perform similar actions during the workday.
• Frequent computer use, keyboard and telephone use, and extended focused screen work.

Other Duties

• Performs additional duties as assigned to support institutional data management, system integration, reporting, operational efficiency, and technology initiatives.
• Performs all responsibilities consistent with Palmer College of Chiropractic policies, including Equal Employment Opportunity and Affirmative Action requirements.