Data Engineer Ab initio
Ab Initio
Automation
Big Data
Cloud Infrastructure
Cloud Native
Cloud Native Technologies
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Cloud Technology
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Integration Tools
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Database
Databases
DevOps
Devops Tools
DevSecOps
Docker
Engineering
Engineering Software
ETL
Event Driven Architecture
Informatica
Information Technology (IT)
Infrastructure
Infrastructure As Code
Integration
Kafka
Kubernetes
Platform Engineering
Programming
Programming Language
Programming Languages
Security Devops
Software Development
SQL
Stream Processing
Streaming Data
Unix Linux Shell
Job Description
Robotics Technologies is hiring a Data Engineer Ab initio for an onsite role in Houston, TX. This position focuses on building high-performance, event-driven Ab Initio data pipelines designed for low-latency processing and high availability, with 24/7 monitoring to keep production streams reliable.
The contract runs for 8 Months + Extension, offering an hourly rate of USD 78. Employment type options include W-2, 1099, and C2C.
What you will do
- Create complex Ab Initio continuous flow graphs, including stateful joins, sliding time windows, and aggregations.
- Implement event-driven pipelines using Kafka, MQ, and file streams for batch and real-time ingestion and transformation.
- Engineer resilience for continuous flows using checkpointing and recovery to support exactly-once processing.
- Use advanced Ab Initio components such as Reformat, Rollup, Join, and Partition to maintain low-latency performance.
- Provide proactive 24/7 monitoring of live production streams, including troubleshooting of data issues.
- Apply data validation and ensure data security, integrity, and compliance across big data platforms.
- Monitor and troubleshoot performance issues in large-scale clusters.
- Collaborate with data scientists, analysts, and application teams to deliver high-quality data solutions.
- Automate workflows and improve operational efficiency using scripting and orchestration tools.
What you bring
- Deep understanding of the credit card process system.
- Deep knowledge of GDE (Graphical Development Environment), EME (Enterprise Meta Environment), Conduct, and Continuous Flows.
- Understanding of Kafka, message queues, and real-time stateful services.
- Proficiency in Unix/Linux shell scripting, SQL, and database technologies such as Oracle and Teradata.
- Experience with Java, Scala, Python or Kafka is a plus.
- Familiarity with Linux/Unix environments and shell scripting.
- Understanding of data security, governance, and compliance standards.
- Experience with cloud-based big data platforms.
- Exposure to containerization for big data workloads, including Docker and Kubernetes.
- Knowledge of CI/CD pipelines for data engineering projects.
Technologies
Ab Initio, GDE, EME, Conduct, Continuous Flows, Kafka, MQ, Reformat, Rollup, Join, Partition, ETL, Unix/Linux shell scripting, SQL, Oracle, Teradata, Java, Scala, Python, Linux/Unix, Docker, Kubernetes, CI/CD, checkpointing, recovery
Job details
- Job ID: J54188
- Location: Houston, TX (onsite)
- Duration: 8 Months + Extension
- Domain Exposure: Material
- Client: To Be Discussed Later
- Employment Type: W-2, 1099, C2C
- Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other
Similar Jobs
