Data Engineer

TG Administration LLC is seeking a Data Engineer to design, build, and maintain scalable data integration pipelines and Azure data architectures. The role focuses on governed data flows using a medallion approach to support analytics and downstream applications.

Responsibilities

• Design, develop, and maintain end-to-end data pipelines to ingest data from internal and external systems into Azure data platforms
• Build and manage data integration processes using tools such as Azure Data Factory, Azure Synapse, and/or Azure Data Lake
• Implement and enforce medallion architecture (bronze, silver, gold) for structured refinement and consumption of data
• Transform raw data into clean, validated, and enriched datasets for analytics and business use
• Develop and optimize data models and transformation logic to support performance and scalability
• Integrate data from APIs, SaaS platforms, databases, and third-party systems
• Ensure data quality, consistency, and integrity across all pipeline stages
• Implement monitoring, alerting, and logging for pipeline performance and failures
• Collaborate with data analysts, data scientists, and product teams to support reporting and advanced analytics needs
• Maintain and optimize data storage solutions (for example, Azure Data Lake and Synapse) to improve cost and performance efficiency
• Establish and follow best practices for version control, CI/CD, and deployment of data pipelines
• Document data flows, transformations, and system dependencies

Requirements

• 3+ years of experience in data engineering, ETL/ELT development, or data integration
• Hands-on experience building and maintaining production-grade data pipelines
• Experience working within cloud-based data platforms (Azure preferred)
• Strong proficiency in SQL and data transformation techniques
• Experience with Azure data services including Azure Data Factory, Azure Data Lake, and Synapse Analytics
• Expertise in ETL/ELT pipeline design and orchestration
• Strong understanding of data modeling (relational and dimensional)
• Experience working with APIs, file-based ingestion, and streaming data sources
• Knowledge of data quality, validation, and error-handling techniques
• Strong problem-solving and troubleshooting skills
• Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field
• Equivalent combination of education and experience may be considered

Technologies

• Azure
• Azure Data Factory
• Azure Synapse
• Azure Data Lake
• Synapse Analytics
• SQL
• ETL/ELT
• APIs
• SaaS
• PySpark
• Spark
• Databricks
• Delta Lake
• CI/CD
• DevOps

Preferred Qualifications

• Experience implementing medallion architecture (bronze/silver/gold layers)
• Experience integrating multiple enterprise systems (CRM, ERP, SaaS platforms)
• Experience supporting analytics or BI environments

Preferred Knowledge and Skills

• Experience with PySpark, Spark, or Databricks
• Familiarity with Delta Lake and lakehouse architectures
• Experience with CI/CD pipelines and DevOps practices in Azure
• Knowledge of data governance, lineage, and cataloging tools
• Experience optimizing performance and cost in cloud environments

Benefits

• Healthcare Benefits – Medical, Dental, and Vision coverage
• Retirement Benefits – 401(k) with employer match (19 years of age and older)
• Time Off – Paid time off (PTO) and leaves of absence, in accordance with applicable law and eligibility criteria