JPMorgan Chase is seeking a Lead Software Engineer to help shape its data platform strategy within Corporate Technology. This onsite role in Jersey City focuses on leading data engineering efforts, maintaining pipelines and architectures across multiple teams to support the firm’s business objectives. The position carries a salary range of USD 152,000 to 215,000 per year and invites an experienced technologist to contribute as a core engineering leader driving secure, scalable data collection, storage, access, and analytics capabilities.
Responsibilities
- 7+ years in data engineering, including over 2 years guiding delivery and architecture for data platforms used by multiple teams.
- Hands-on work building and operating a Databricks Lakehouse hosted on AWS.
- Deep knowledge of Delta Lake with ACID tables and partitioning strategies.
- Proven experience with Spark on Databricks, including performance tuning, cluster sizing, skew mitigation, joins, caching, and file sizing.
- Experience with both streaming and batch pipelines (Structured Streaming, incremental processing, backfills, late-arriving data).
- Strong AWS fundamentals for data platforms, covering S3, IAM, KMS, networking basics (VPC and security groups), and logging/auditing.
- Experience implementing data governance and security controls in Databricks (Unity Catalog, table/column permissions, credential passthrough patterns where applicable).
- Demonstrated ownership of reliability through monitoring and alerting, incident response, root cause analysis, and SLO/SLA management.
Requirements
- Architect the lake house: design bronze, silver, and gold layers (or equivalent) and define domain data products.
- Deliver scalable ingestion from AWS sources into Databricks (batch and streaming), including change data capture where needed.
- Build maintainable pipelines using Delta Live Tables and/or standard Jobs with modular structure, testing, and documentation.
- Operational excellence: productionize workloads via Databricks Workflows/Jobs with robust retries, checkpointing, idempotency, and safe re-runs.
- Governance by design: enforce least privilege, data classification (PII), auditing, lineage/metadata, and controlled sharing/consumption.
- Performance and cost management: tune Spark/Delta workloads, right-size clusters, optimize storage layout, and manage spend for jobs and warehouses.
- Lead and mentor: establish engineering standards, run design reviews, drive code quality, and upskill engineers in Spark/Databricks best practices.
- Cross-functional delivery: translate stakeholder needs into technical plans, communicate tradeoffs, and align with security and platform teams.
- CI/CD and IaC: use Terraform for Databricks and AWS resources, promoting changes across environments.
- Testing: implement unit and integration tests for transformations, data quality checks, contract testing, and replay/backfill procedures.
- Version control and code review discipline; maintain clear documentation and runbooks.
Technologies
- Databricks
- Delta Lake
- Spark
- Delta Live Tables (DLT)
- Unity Catalog
- Databricks Workflows/Jobs
- Terraform
- Amazon S3
- AWS IAM
- AWS KMS
- VPC
Benefits
- Health care coverage
- On-site health and wellness centers
- Retirement savings plan
- Backup childcare
- Tuition reimbursement
- Mental health support
- Financial coaching
- Commission-based pay
- Discretionary incentive compensation (cash and/or forfeitable equity)
About JPMorgan Chase
JPMorgan Chase is among the oldest financial institutions, delivering innovative financial solutions to millions of consumers, small businesses, and a broad spectrum of corporate, institutional, and government clients under the J. P. Morgan and Chase brands. With a history spanning more than two centuries, the firm is a leader across investment banking, consumer and small business banking, commercial banking, financial transaction processing, and asset management. The company offers a competitive total rewards package, including base salary determined by role, experience, and location, with eligible roles potentially receiving commission-based pay and discretionary incentive compensation in cash or equity. JPMorgan Chase emphasizes diversity and inclusion as a core strength and is an equal opportunity employer.
About the Team
Our Corporate Functions encompass areas from finance and risk to human resources and marketing. These teams are essential to ensuring the firm sets its businesses, clients, customers, and employees up for success.
