Full Stack Data Engineer

Pivotal is seeking a Full Stack Data Engineer to build internal applications that help engineering teams explore and interpret flight data.

Responsibilities

• Build and maintain internal web applications engineers use for flight data, including flight record browsers, query interfaces, and analysis tools over the warehouse.
• Develop Python services and HTTP APIs that query Athena and S3, returning results at interactive speed with pagination and caching over large result sets.
• Create data interfaces that make large telemetry datasets explorable using sortable tables, filters, and time-series plots, designed for engineers who do not write SQL.
• Build agent-based tooling that enables engineers to ask questions in plain language and trace symptoms to root cause without hand-writing queries.
• Design agent outputs to include underlying data and derivation details so engineers can verify before acting.
• Convert recurring one-off analyses from firmware, GNC, battery, and maintenance teams into supported self-serve tools rather than scripts only the original author can run.
• Generate an internal field guide and data catalog from the warehouse to prevent drift between documentation and tables.
• Keep catalog metadata machine-readable so tooling and agents interpret results correctly.
• Build review and triage surfaces for fleet health alerts, including acknowledgment, history, and trend views, alongside existing dashboards and Slack notifications.
• Package and distribute analysis tooling so it runs on an engineer laptop, including Windows, without environment setup guidance.
• Own delivery through deployment, including tests, code review, CI/CD, and monitoring to identify when something breaks.
• Partner with engineering teams to scope needs, ship with clear documentation, and support handoffs for ongoing maintenance.

Requirements

• 2+ years of professional experience building and shipping web applications, from backend through front end.
• Bachelor’s degree in Computer Science or related technical discipline, or equivalent practical experience.
• Proficient in Python and comfortable writing SQL against a real database.
• Experience with a modern JavaScript or TypeScript front-end framework (React, Vue, or similar).
• Built and consumed HTTP APIs, including authentication, pagination, and error handling.
• Comfortable with Git-based workflows, code review, and CI/CD.
• Can work with non-software engineers to define needs and ship solutions; many requirements come from conversation rather than a static spec.

Technologies

• Python, SQL, JavaScript, TypeScript
• React, Vue
• HTTP APIs
• AWS Athena, Amazon S3
• Git-based workflows, CI/CD
• Windows, Slack notifications

Benefits

• Comprehensive benefits package, including medical, dental, vision, and 401k plans.

Preferred Qualifications

• AWS experience, particularly S3, Athena, Lambda, or API Gateway.
• Experience working with large or time-series datasets and knowledge of keeping UIs responsive over millions of rows.
• Charting and data visualization libraries; Grafana dashboard development.
• Docker and infrastructure as code with Terraform.
• Experience building with LLM APIs or agent frameworks, including tool use, retrieval over structured data, and evaluating whether output can be trusted.
• Built internal tools where users are colleagues rather than customers.

Familiarity / Experience

• Aerospace, automotive, or robotics telemetry, and flight or vehicle test data.
• Packaging desktop or command-line tooling for non-developer users, including on Windows.
• Authentication and access control for internal applications (SSO, IAM, scoped credentials).
• Regulated or safety-critical environments with traceability and data retention requirements.
• Natural-language or conversational interfaces over structured, time-series, or diagnostic data.
• Interest in RC planes, quadcopters, or aviation.

Other Employment Details

• Applicants must be eligible for employment in the United States.
• Willingness to work onsite at the HQ office in Palo Alto, CA.

AI in the Hiring Process

• AI tools may be used to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals based on available information.
• AI tools assist the recruitment team but do not replace human judgment.
• Final hiring decisions are made by humans.

Core-Values Alignment

• Safety Above All
• Customer Focus
• Work Better Together
• Be the Pilot
• Embrace the Unknown
• Respect for People