Data Engineer -3

Realign LLC is hiring a Data Engineer for an onsite production support role in Charlotte, NC. In this position, you will help implement and maintain data flows while enforcing data management standards, improving data quality, and addressing production issues across a range of technology stacks. The work includes root cause analysis, troubleshooting, and performance tuning for ETL/ELT and distributed processing workloads.

The role supports multiple environments and teams, with responsibilities spanning secure data handling, monitoring, and operational readiness. You will also contribute development work related to application governance and other mandates, while aligning with enterprise data governance, compliance, and operational risk frameworks.

Responsibilities

• Apply 5 to 10 years of experience in data engineering, software engineering, or a related technical discipline.
• Use Python and SQL to perform advanced data transformations.
• Design and build ETL/ELT pipelines, including data ingestion processes and distributed data processing jobs.
• Work with distributed data technologies such as Apache Spark, Databricks, or Hadoop ecosystems.
• Build and manage datasets across relational and cloud-based platforms including Teradata, Snowflake, SQL Server, and Azure/AWS/GCP.
• Support data modeling and governance practices, including metadata, data quality controls, data lineage, and secure data management.
• Contribute to automated test suites by analyzing test failures and supporting test-driven development.
• Collaborate with CI/CD and version control workflows, including Git and automated deployment practices.
• Adhere to enterprise data governance, compliance, and operational risk frameworks.
• Troubleshoot pipeline issues, performance bottlenecks, and data discrepancies.
• Implement monitoring and observability for data pipelines using logs, metrics, and health checks.
• Perform advanced performance tuning across SQL, Spark, or distributed data workflows.
• Apply data security practices such as encryption, masking, and PII handling.
• Support analytical workloads, including BI tools and/or data science teams.
• Provide production support with production root cause analysis across tech stacks including Hadoop, Oracle, and MongoDB.
• Use Autosys knowledge to analyze and fix performance issues and support development work tied to App Gov and other mandates.
• Maintain strong communication and collaboration with engineering, product, and business stakeholders.
• Leverage prior experience in a financial institution or another regulated industry.

Qualifications

• Primary skills: PySpark, Hive, Python, SQL, Hadoop
• Secondary skills: Unix, Agile, Base support
• Experience: 5 to 10 years
• DevOps Engineer experience

Technologies

• PySpark, Hive, Python, SQL
• Hadoop, Apache Spark, Databricks
• Teradata, Snowflake, SQL Server
• Azure, AWS, GCP
• Git, CI/CD
• Autosys, Oracle, MongoDB
• App Gov
• Unix

Salary: USD 98,000 per year.