Data Engineer Sr (ETL) Advisor
Senior
Analytics
Azure Data Engineer
Big Data
Bigdata
Business Analytics
Business Intelligence
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Lake
Data Lakehouse
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Database
Databases
Databricks
Digital Marketing
ETL
Event Driven Architecture
Informatica
Integration
Microstrategy
Reporting and Analytics
SQL
Streaming Data
Teradata
Job Description
Senior Performance Data Engineering role supporting a Federal agency, with ETL lifecycle ownership, performance tuning, and delivery of a cloud Data Lakehouse platform.
Responsibilities
- Provide data modeling expertise and performance-tuning guidance to optimize ETL workloads and database queries.
- Support queries and workflows that enable MicroStrategy reporting within the EDS Application.
- Lead engineering for a scalable, cloud-based Data Lakehouse platform known as the Unified Analytics Platform (UAP).
- Deliver UAP using Databricks on Microsoft Azure to improve enterprise data governance, observability, and operational value.
- Perform application development and maintenance to provide direct technical assistance.
- Provide remote support on a 24x7 on-call basis for production server applications.
- Assist with installation and upkeep of ETL solutions.
- Deliver complementary services needed to meet customer and business requirements.
Requirements
- Bachelor’s degree in Computer Science (or related field) is highly preferred.
- 15+ years of hands-on experience in data modeling and querying.
- Experience supporting application development and maintenance that provide ETL services for the Postal Data Asset Services group.
- Significant Teradata optimizer experience is required.
- Ability to read SQL “explain” plans and take action to leverage the massively parallel nature of the database engine.
- Must have Teradata SQL knowledge, since business logic is embedded in queries.
- Thorough understanding of internal DBC Accounting information to measure application code performance.
- Ability to obtain and maintain a Public Trust clearance and successfully complete a Government background screening process requiring detailed forms and fingerprinting.
- U.S. residency requirement for USPS security clearance: U.S. Citizens cannot have left the U.S. (including territories) for longer than 6 months consecutively in the last 3 years (with exceptions). Non-U.S. Citizens cannot have left for longer than 90 days con…
Technologies
- Ab Initio
- Ab Initio ETL (Extract Transform Load) Tool
- Teradata SQL
- Teradata optimizer
- MicroStrategy
- Databricks
- Microsoft Azure
- SQL “explain” plans
- DBC Accounting
- GDE (Graphical Development Environment)
- Web API development
- Kafka
- MQSeries
- JMS
- JDBC
Key Skills for Success
- Ab Initio
- Ab Initio ETL Tool
- Teradata SQL
Desired Skills and Abilities
- Working knowledge of how MicroStrategy and other OLAP tools interact with Teradata.
- Knowledge of Ab Initio tools, architecture, process, and analytics.
- Working knowledge of major competing data warehouse modeling techniques, including Third-Normal-Form and Dimensional modeling, and how modeling decisions affect performance for ETL, structured report queries, and unstructured data analysis.
- Working knowledge of GDE (used by Ab Initio).
- Working knowledge of Web API development.
- Working knowledge of storing, reading, and analyzing streaming data (Kafka, MQSeries, or similar) such as JMS.
- Working knowledge of cloud technology, developing and architecting.
Location
- Raleigh, NC (Preferred)
- Remote considered
- Travel required: None
Salary
USD 129,813 - 166,750 per year.
Identity Verification Process
- Hiring process includes an identity verification step using advanced biometrics and AI to ensure authenticity and protect against identity fraud.
- During virtual interviews, you are expected to be on camera.
- The company may take a picture to verify identity and prevent fraud.
- Proceeding authorizes collection, processing, and use of biometric data for identity verification and security purposes.