Senior Data Engineer

Senior Data Engineer role, remote W2, USD 50-55 per hour, with Sgn Global Technologies, focusing on SQL databases, ELT/ETL pipelines, and data processing using Python, PySpark/Polars, Azure Synapse Analytics, and Azure Machine Learning.

Responsibilities

• Maintain and optimize SQL databases, executing advanced SQL and T-SQL queries.
• Design, build, and sustain ELT/ETL pipelines in cloud-based analytics environments.
• Collaborate with Azure Synapse Analytics and Azure Machine Learning within the modern data stack; DP-203 (or equivalent) certification is preferred.
• Data manipulation using Python, with Pandas required.
• Experience with PySpark or Polars is preferred.
• Develop reusable, modular, and maintainable code.

Requirements

• Bachelor's degree in Data Engineering, Computer Science, Data Science, Machine Learning, Mathematics, or a related field
• Minimum 6 years of relevant hands-on experience
• 5+ years of hands-on experience in maintaining SQL databases and performing advanced SQL and T-SQL operations
• 5+ years of hands-on experience in designing, implementing, and maintaining ELT/ETL pipelines in cloud-based data analytics environments
• 3+ years of hands-on experience with Azure Synapse Analytics and Azure Machine Learning within the modern data stack; DP-203 (or equivalent) certification is preferred
• Data manipulation using Python, with Pandas required
• Experience with PySpark and/or Polars is preferred

Technologies

• SQL
• T-SQL
• Azure Synapse Analytics
• Azure Machine Learning
• Python
• Pandas
• PySpark
• Polars