Data Engineer 2
Analytics
Big Data
Bigdata
Business Intelligence
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Data Warehouse
Cloud Data Warehouse
Cloud Operations
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Lake
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Visualization
Data Warehouse
Data Warehousing
Database
Databases
Databricks
Databricks Dlt
Dataops
Dataops
Delta Lake
Digital Marketing
ETL
Informatica
Information Technology (IT)
Programming Language
Programming Languages
Pyspark
Reporting and Analytics
Snowflake
Spark
SQL
Visual Design
Job Description
Design and deliver scalable data platforms and pipelines for Comcast Advertising, enabling reliable data products and self-service analytics at scale.
Responsibilities
- Architect, design, and build high-performance, scalable data pipelines for large-scale data processing
- Develop complex Big Data ETL workflows using modern frameworks such as Databricks Delta Live Tables (DLT)
- Design and implement data lake architectures using open table formats including Delta Lake and Apache Iceberg
- Define, promote, and enforce data engineering best practices to support data quality, integrity, reliability, and performance
- Implement observability and monitoring across pipelines, including data cataloging, lineage, and metadata management
- Participate in peer reviews, knowledge sharing, production support, incident resolution, and change management
- Follow code management and version control practices across development workflows
- Create high-quality documentation, including data flows, lineage diagrams, and architecture details aligned to data engineering standards
- Ensure comprehensive code coverage by building unit and integration tests, using test-driven development (TDD) principles
- Own critical components of large-scale batch ETL systems; communicate data models and design decisions to Product, Engineering, and Leadership stakeholders
- Manage multiple priorities by balancing long-term architectural direction with immediate business needs
- Build advanced semantic layers and support creation of customer-facing self-service analytics
- Apply independent judgment and discretion for complex, high-impact technical decisions
- Maintain regular, consistent, and punctual attendance, with flexibility to work nights, weekends, or variable schedules as required
- Perform additional duties and responsibilities as assigned
Requirements
- Minimum 2 years of Data Engineering experience (relevant work experience: 2-5 years)
- Proficiency in Python and PySpark; solid grasp of SQL
- Hands-on experience with Databricks and/or Snowflake is preferred
- Data warehouse modeling paradigms
- Understanding of cloud-based architectures (AWS)
- Problem-solving skills
- Nice to have:
- AWS Certified Developer Associate
- Databricks Certified Data Engineer Associate
- SnowPro Advanced: Data Engineer
Technologies
- SQL
- Python
- PySpark
- Apache Spark
- AWS
- Databricks Delta Live Tables (DLT)
- Databricks
- Delta Lake
- Apache Iceberg
- Looker
- Tab
- Snowflake
Location
- Willow Grove, PA (onsite)
Salary
- USD 79,728 - 132,880 per year
- Comcast intends to offer base pay within this range, depending on job-related, non-discriminatory factors such as experience
- Pay Range noted for Illinois and Massachusetts: $79,728.27 - $132,880.46
- Application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later
Education
- Bachelor's Degree
- Comcast may also consider applicants with some combination of coursework and experience, or extensive related professional experience