Senior Data Engineer (Azure Data Factory Databricks, PostgreSQL, Python)

Career Developers is seeking a Senior Data Engineer to design and maintain scalable production data pipelines in Azure based environments, including Data Factory and Databricks, leveraging PostgreSQL and Python. This onsite role in Reston, VA centers on collaborating with analytics, BI, and engineering teams to deliver reliable data products while contributing to data governance and long term platform strategy.

Responsibilities

• Design, implement, and sustain scalable production data pipelines that support enterprise data platforms
• Conduct exploratory data analysis, statistical analysis, and data validation to back analytics and reporting
• Develop and optimize ETL/ELT workflows, covering job design, orchestration, and performance tuning
• Create and maintain relational database schemas, queries, and stored procedures
• Operate within Azure based data environments including Data Factory, Databricks, and Data Lake Storage
• Collaborate with analytics, BI, and engineering teams to deliver dependable data products
• Implement monitoring, logging, and observability for data pipelines
• Maintain documentation, data lineage, and governance standards
• Participate in architecture discussions and contribute to the long term data platform strategy

Requirements

• Bachelor's degree in Computer Science, Statistics, Mathematics, Information Science, Data Engineering, Finance, or a related field; Master's preferred
• Five plus years of data engineering experience building and operating production data pipelines
• Five plus years of applied data analysis and statistics work
• Three plus years of ETL/ELT development experience
• Three plus years working with relational databases and performance tuning
• Experience with Azure data services such as Data Factory, Databricks, Data Lake, Synapse, or Delta Lake
• Proficiency in Python, PySpark, SQL, and Bash
• Experience with Kafka, SAP Data Services, or similar integration tools preferred
• Experience with PostgreSQL, SAP ASE, or comparable databases
• Power BI or BusinessObjects experience is a plus
• Experience with CI/CD pipelines, Git, Kubernetes, and infrastructure as code
• Knowledge of data governance, cataloging, and access control
• Experience with monitoring tools such as Datadog, Grafana, or Prometheus
• Ability to work independently while managing multiple priorities
• Strong communication and documentation skills
• Must be eligible to work in the United States

Technologies

• Azure Data Factory, Databricks, Data Lake Storage, Azure Synapse, Delta Lake, Spark
• PostgreSQL, SAP Data Services, SAP ASE
• Power BI, BusinessObjects
• Python, PySpark, SQL, Bash
• Kafka, Kubernetes, Git, CI/CD
• Datadog, Grafana, Prometheus