Principal Software Engineer- Telemetry/Observability

This on site Principal Software Engineer role focuses on observability and telemetry platforms within JPMorganChase's Core Foundational Platforms. Based in Seattle, WA, this position involves designing end-to-end telemetry pipelines, building platform services, and guiding observability strategy across VPC and cloud networking environments.

Location

Seattle, WA (onsite)

Compensation

USD 204,250 - 285,000 per year

Responsibilities

• Develops scalable coding frameworks focused on observability and telemetry for Virtual Private Cloud environments.
• Produces secure, high-quality production code and reviews or debugs code across telemetry collection, enrichment, storage, and visualization services.
• Leads the design and implementation of end-to-end telemetry pipelines (metrics, logs, traces, events), establishing standards, schemas, and instrumentation patterns for platform and application teams.
• Enhances CI/CD pipelines to enable reliable delivery, automated testing, policy-as-code, and safe progressive rollouts for observability services.
• Designs solutions suited to software-defined networking and cloud networking contexts, including troubleshooting across layered network paths and dependencies.
• Builds and maintains monitoring, alerting, and SLO/SLI practices using tools such as Splunk, Grafana, and Prometheus, including dashboards, alert tuning, and operational runbooks.
• Advises cross-functional teams on telemetry strategy, platform integrations, and operational readiness within your domain of expertise.
• Serves as the function's subject matter expert for observability and telemetry across the VPC platform, shaping standards and best practices.
• Creates durable, reusable software frameworks leveraged across teams (SDKs, libraries, templates, reference architectures, golden paths).
• Influences leaders and senior stakeholders by communicating tradeoffs, risk, and roadmap decisions for platform reliability and resiliency.
• Champions the firm's culture of diversity, opportunity, inclusion, and respect.

Requirements

• 10+ years of software engineering experience, including building and operating platform services in production environments.
• Hands-on experience delivering system design, application development, testing, and operational stability, ideally for platform, infrastructure, or developer productivity products.
• Expert-level Python development experience, including building services, automation, tooling, and integrations for telemetry and operations workflows.
• Strong Linux systems and networking expertise (TCP/IP, DNS, TLS, routing, NAT, packet capture, troubleshooting) with the ability to diagnose cross-system issues in distributed environments.
• Practical experience with CI/CD and modern delivery practices (progressive delivery, automated quality gates, artifact/version management).
• Advanced knowledge of software development processes with deep expertise in one or more technical disciplines (cloud platforms, platform engineering, reliability engineering, networking, observability).
• Experience with observability tooling such as Splunk, Grafana, Prometheus (instrumentation, queries, dashboards, alerts, operationalization).
• Experience designing or operating telemetry data pipelines (collection agents, exporters, scraping, indexing, retention, cardinality management, performance/cost controls).
• Demonstrated ability to apply expertise to solve complex technology problems across technical disciplines.
• Working knowledge of software-defined networking concepts and environments, including integrations and operational considerations for VPC-like network platforms.

Technologies

• Python
• Splunk
• Grafana
• Prometheus
• OpenTelemetry
• Terraform

Benefits

• Base salary determined by role, experience, skill set and location
• Commission-based pay
• Discretionary incentive compensation (cash and/or forfeitable equity)
• Comprehensive health care coverage
• On-site health and wellness centers
• Retirement savings plan
• Backup childcare
• Tuition reimbursement
• Mental health support
• Financial coaching