Data Engineer

A-dec, Inc. (USA) is seeking a Data Engineer to strengthen its data and data pipeline architecture in Newberg, Oregon. This onsite role focuses on expanding and optimizing how data is collected, integrated, and made usable for cross-functional teams across software developers, a data architect, and data analysts.

You will build and tune both real-time and batch integrations into the organization’s EDW, support production data pipelines, and help improve reliability, efficiency, and quality to support next-generation products and ongoing data initiatives.

What you will do

• Build real-time and batch data integrations from disparate source systems into the EDW.
• Collaborate with data and analytics experts to improve the functionality of data systems used by internal teams.
• Write complex SQL queries for reporting and application consumption.
• Assemble large, complex data sets aligned with functional and non-functional business requirements.
• Design and implement real-time ETL and batch processing to support modeling and reporting needs.
• Provide production support for data integration and transformation pipelines.
• Scale and tune data pipelines, databases, and SQL queries for performance and reliability.
• Build and maintain data reconciliation processes.
• Find trends in data sets and develop algorithms to make raw data more useful for the enterprise.
• Connect data to users in mixed cloud and on-prem environments.
• Partner with the data architect and analysts to support modeling and reporting, including internal data processing and visualization.
• Translate requests into replicable analytic reports using varying applications.
• Create tools to serve data, such as APIs and packages, as needed.
• Troubleshoot and conduct root cause analysis for database software and data integrity issues.

Requirements

• Bachelor’s degree in Computer Science or a related technical field (or equivalent practical experience).
• 2+ years of experience in Information Technology with a focus on Business Applications, Data Engineering, Data Architecture, Data Analytics, and Science.
• Good understanding of data warehousing and Business Intelligence environments.
• Excellent problem solving, critical thinking, and communication skills.
• Experience with distributed source code version control systems (for example, git).
• Experience with a ticketing system such as ServiceNow or JIRA.
• Expertise with Python, databases, and SQL.
• Strong analytic skills working with unstructured datasets.
• Experience with data pipeline and workflow management tools.

Tools and technologies

• Python, SQL, git
• ServiceNow, JIRA
• EDW, Azure, Synapse
• Azure SQL DB, Azure ML Pipeline, Azure Data Factory
• APIs

Preferred qualifications

• Experience with Azure services such as Synapse, Azure SQL DB, Azure ML Pipeline, and Azure Data Factory.
• Knowledge of machine learning and data science processes.
• Experience building reports and dashboards using BI tools.
• Basic knowledge of statistics.
• Stellar communication skills for requirements gathering.

Location: Newberg, OR (onsite)

Experience level: 2+ years