Data Engineer IV
Job Description
Join Airlines Reporting Corporation in Arlington, VA on site. This Data Engineer IV position offers a salary range of USD 107,400 to 171,800 per year. ARC fosters a diverse, collaborative, and innovative culture that drives the travel industry forward. You will benefit from hands-on learning and professional development opportunities, plus a WorkFlex hybrid program that blends remote work with scheduled in-office days to keep teams connected. Our comprehensive benefits package supports your wellbeing, and you will collaborate with top data and technology professionals to shape how the world travels.
As a Data Engineer IV, you will be a central driver of technical excellence, strategy, and innovation. You will mentor a team of application and platform engineers focused on developing data products that leverage the world’s most comprehensive airline ticket dataset, using cloud-based solutions to power scalable data platforms and services.
Benefits
- Join a motivated, diverse, creative, collaborative team that leads the travel industry with innovative solutions
- Hands-on learning and professional development opportunities to grow your skills
- WorkFlex hybrid program offering flexible work-from-home options with in-office days
- Competitive, comprehensive benefits package
- Partner with leading minds in data and technology to innovate travel on a global scale
Responsibilities
- Technical leadership: provide expert guidance to development and platform engineering teams, act as a domain SME, demonstrate leadership through communication, influence, relationship building, directional coaching, review data structures and queries, and be on call for incident response and data breach forensics when needed
- Design: lead the design and software development of complex data systems, ensuring scalable, efficient, and robust solutions; collaborate with Ops to maintain performance, resiliency, and high availability across multi-region architectures (Aurora RDS, Redshift)
- Technology evaluation: explore and recommend innovative tools and platforms to enhance data infrastructure
- Data strategy: define and implement data strategies, standards, and best practices across the organization
- Data governance: develop and enforce governance and compliance policies
- Innovation: stay current with emerging technologies and best practices; propose and adopt new tools as appropriate
- Optimization: continuously optimize data platforms, processes, storage, codebase, and performance
Requirements
- Bachelor’s Degree or equivalent work experience; equivalent experience considered
- 7+ years designing and developing solutions for large-scale data systems, services, and platforms
- 7+ years of full SDLC experience
- 5+ years with Agile, Scrum, DevOps, and CI/CD
- 7+ years implementing modern data solutions using cloud-based technologies in AWS, including Lambda, API Gateway, Security Groups, IAM Roles, Aurora (MySQL/PostgreSQL), S3, CloudWatch, Secrets Manager
- Expert in modern data and infrastructure design patterns, stream processing, and building data pipelines
- Deep knowledge of databases and related technologies including S3, Aurora, Python, Postgres, RDS, RDS Proxy, Redshift, NoSQL databases, DynamoDB
- Experience with data warehousing platforms such as Redshift, Snowflake, and Teradata
- Strong SQL skills, data modeling, ETL/ELT patterns, and data mart design
- Experience with ETL tools such as Glue, Kenesis, Athena, Ab Initio (preferred), Informatica, or Talend
- Knowledge of data lake and data lakehouse concepts
- Experience in data profiling and analysis to validate data accuracy
- Experience with BI technologies such as AWS Quick, PowerBI, Tableau, Jasper, Cognos, Qlik, Looker, Metabase
- Experience with monitoring tools such as Datadog, CloudHealth, and Atlassian Suite
- Experience in data management and governance
- Demonstrated leadership and collaboration skills, with ability to guide projects and work with stakeholders at all levels
- Excellent communication skills, able to translate technical concepts for nontechnical audiences and document best practices
- Strong intellectual curiosity and a drive to improve processes to meet evolving business needs
Technologies
- AWS
- Lambda
- API Gateway
- Security Groups
- IAM Roles
- Aurora (MySQL/PostgreSQL)
- S3
- CloudWatch
- Secrets Manager
- Redshift
- RDS
- RDS Proxy
- NoSQL databases
- DynamoDB
- Python
- Postgres
- Snowflake
- Teradata
- SQL
- Glue
- Kenesis
- Athena
- Ab Initio
- Informatica
- Talend
- data lake
- data lakehouse
- Datadog
- CloudHealth
- Atlassian Suite
- AWS Quick
- PowerBI
- Tableau
- Jasper
- Cognos
- Qlik
- Looker
- Metabase
- RedShift
- Aurora