Lineage & Metadata Engineer Jobs

1 job found

Today

Data Engineer - AI-Enabled Capacity Analytics

Comcast Corporation Philadelphia, PA

Philadelphia, PA

Today

$109k - $163k/yr Full time Ai Ml Artificial Intelligence Automation

Apply Now

Job Description

Comcast’s National Traffic and Capacity Management (NTCM) team is building trusted data solutions that help improve network capacity planning and optimization for next-generation products. As a Data Engineer III onsite in Philadelphia, you’ll design and deliver scalable pipelines and planning applications, with opportunities to apply machine learning and AI-assisted analysis in support of forecasting and operational decision-making.

This role focuses on engineering reliable data flows, adding automated quality controls, and operationalizing models and analytics workflows across batch and streaming datasets.

What you’ll do

Design, develop, test, deploy, and support scalable data applications, planning tools, APIs, and data pipelines for network capacity planning and analysis.
Build and optimize ELT and ETL processes across batch and streaming datasets.
Develop automated processes for data quality checks, anomaly detection, master data management, metadata management, lineage, and monitoring.
Develop, tune, and fine-tune machine learning and AI models; evaluate performance and integrate models into production data applications and workflows.
Implement automation for recurring workflows, including orchestration, validation, monitoring, and issue notification.
Perform ad hoc data analysis and support AI-assisted insight generation.
Optimize and monitor data-intensive processes and applications, identifying and resolving performance, scalability, and data-quality issues.
Create and maintain clear documentation for data pipelines, software specifications, system designs, processes, and support procedures.
Apply sound practices for versioning, testing, privacy protection, cybersecurity, regulation compliance, governance, responsible AI, and monitoring of data and AI solutions.
Collaborate with network engineering, product, operations, software development, and data science partners to translate requirements into reliable technical solutions.
Adapt to evolving business priorities while maintaining solution quality and delivery commitments.
Proactively identify risks, dependencies, and improvement opportunities, escalating issues early and driving resolutions independently.

What you bring

5-7 years of relevant work experience and 5+ years minimum experience for the role.
Strong proficiency in SQL and Python (or similar languages), with experience in data engineering, data quality, data product development, application development, or data analytics.
Hands-on experience building production data applications using AWS, Databricks, Spark, or comparable cloud and distributed-processing technologies.
Deep experience building, monitoring, and optimizing large-scale data pipelines and data-intensive applications.
Working knowledge of machine learning workflows, including model development, deployment, evaluation, and monitoring.
Familiarity with ML or data science models and AI-enabled analytics, including LLM, RAG applications, AI agents, or model tuning and fine-tuning workflows.
Experience with system design, data architecture design, integration, version control, CICD, testing, deployment, and production support.
Experience with BI tools such as Tableau or Power BI for reporting, visualization, EDA, and data analysis.
Knowledge of metadata management, lineage tracking, data-quality frameworks, anomaly detection, testing, and monitoring practices.
Familiarity with workflow orchestration tools such as Airflow is a plus.
Familiarity with networking, telecommunications, capacity management, or network deployment is preferred.
Strong analytical and problem-solving skills, including debugging complex data issues and performance bottlenecks.
Demonstrated ownership across design, development, testing, deployment, documentation, and ongoing support.
Ability to learn new technologies quickly and communicate effectively across technical and business teams.

Tools and technologies

SQL, Python
AWS, Databricks, Spark
ELT, ETL
Machine learning, AI models
LLM, RAG, AI agents
Tableau, Power BI
Metadata management, lineage tracking
Airflow
CICD

Compensation and location

Location: Philadelphia, PA (onsite)
Salary range: USD 108,578 - 162,868 per year
Note on pay range: Base pay offered within the range based on job-related, non-discriminatory factors including experience.

Additional details

Education: Bachelor’s Degree (preferred)
Visa sponsorship: Not eligible for visa sponsorship. Must be legally authorized to work in the United States and not require sponsorship now or in the future.
Application window: 30 days from the date the job is posted, unless the number of applicants requires it to close sooner.

Benefits

Best-in-class Benefits to eligible employees
An array of options, expert guidance, and always-on tools
Personalized support physically, financially, and emotionally

Comcast intends to assign this role to support network capacity planning and optimization for products including EOHFC, EPON vBNG, and FDX.

Disclaimer: This information is designed to indicate the general nature and level of work performed by employees in this role and is not intended to be a complete inventory of duties, responsibilities, or qualifications.

View full job page →

Get Lineage & Metadata Engineer Jobs alerts

New Lineage & Metadata Engineer Jobs, daily.