Robotics Technologies is hiring a Data Engineer Ab initio for an onsite role in Houston, TX. This position focuses on building high-performance, event-driven Ab Initio data pipelines designed for low-latency processing and high availability, with 24/7 monitoring to keep production streams reliable.
The contract runs for 8 Months + Extension, offering an hourly rate of USD 78. Employment type options include W-2, 1099, and C2C.
What you will do
- Create complex Ab Initio continuous flow graphs, including stateful joins, sliding time windows, and aggregations.
- Implement event-driven pipelines using Kafka, MQ, and file streams for batch and real-time ingestion and transformation.
- Engineer resilience for continuous flows using checkpointing and recovery to support exactly-once processing.
- Use advanced Ab Initio components such as Reformat, Rollup, Join, and Partition to maintain low-latency performance.
- Provide proactive 24/7 monitoring of live production streams, including troubleshooting of data issues.
- Apply data validation and ensure data security, integrity, and compliance across big data platforms.
- Monitor and troubleshoot performance issues in large-scale clusters.
- Collaborate with data scientists, analysts, and application teams to deliver high-quality data solutions.
- Automate workflows and improve operational efficiency using scripting and orchestration tools.
What you bring
- Deep understanding of the credit card process system.
- Deep knowledge of GDE (Graphical Development Environment), EME (Enterprise Meta Environment), Conduct, and Continuous Flows.
- Understanding of Kafka, message queues, and real-time stateful services.
- Proficiency in Unix/Linux shell scripting, SQL, and database technologies such as Oracle and Teradata.
- Experience with Java, Scala, Python or Kafka is a plus.
- Familiarity with Linux/Unix environments and shell scripting.
- Understanding of data security, governance, and compliance standards.
- Experience with cloud-based big data platforms.
- Exposure to containerization for big data workloads, including Docker and Kubernetes.
- Knowledge of CI/CD pipelines for data engineering projects.
Technologies
Ab Initio, GDE, EME, Conduct, Continuous Flows, Kafka, MQ, Reformat, Rollup, Join, Partition, ETL, Unix/Linux shell scripting, SQL, Oracle, Teradata, Java, Scala, Python, Linux/Unix, Docker, Kubernetes, CI/CD, checkpointing, recovery
Job details
- Job ID: J54188
- Location: Houston, TX (onsite)
- Duration: 8 Months + Extension
- Domain Exposure: Material
- Client: To Be Discussed Later
- Employment Type: W-2, 1099, C2C
- Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other
