Data Engineer
3d Design Tools
Aurora
AWS
Aws Athena
Aws Data Engineer
Aws Data Warehouse
Azure Data Engineer
Big Data
Cloud
Cloud Data Engineering
Cloud Data Lakehouse
Cloud Data Warehouse
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Database
Databases
Dynamodb
ETL
Event Driven Architecture
Gxp
Industrial Iot
Informatica
Integration
Kafka
Rendering Engines
SQL
Stream Processing
Streaming Data
Job Description
Eli Lilly is seeking a Data Engineer to design and build data pipelines that connect IT and OT source systems into a cloud data lakehouse architecture across AWS and Azure. In this role, you will help deliver reliable, scalable data products for a GMP-regulated manufacturing environment, supporting analytics and AI/ML use cases.
How you’ll make an impact
- Design and build data pipelines for the site’s many systems.
- Partner with the Data Architect and Data Scientists to understand end-to-end data flow across the Foundry, from lab systems and process engineering to manufacturing execution and quality and process analytics.
- Integrate IT and OT source systems with cloud lakehouse architecture across AWS and Azure, enabling advanced analytics and AI/ML capabilities.
- Support the full data value chain, including capture, ingestion, integration, contextualization, harmonization, and delivery as reusable data domains and data-as-a-product.
- Use modern patterns such as medallion architecture, streaming ingestion, and API-based extraction.
- Write clean, maintainable code; optimize performance; and design with trustworthy, analytics-ready data in mind.
- Apply GxP data integrity requirements from the start, following relevant Quality and Good Manufacturing Practices.
- Participate in design reviews, maintain traceability, and contribute to governance frameworks supporting ongoing compliance.
- Collaborate with stakeholders across Operations, Quality, Lab, and Engineering to gather data needs, identify gaps, and translate operational realities into technical designs.
- Anticipate upstream and downstream dependencies, reuse existing services and integrations when possible, and align to the broader data architecture.
- Track tools and technologies across AWS and Azure ecosystems, share informed perspectives on adoption, and contribute to the team’s capabilities.
- Design, develop, and maintain data solutions for data capture, storage, integration, and analytics in partnership with Technology at Lilly teams.
- Review and provide practical recommendations on design patterns, performance optimization, database versions, and database deployment strategies.
- Analyze large, complex data domains and create practical solutions for subsequent data exploitation via analytics.
What you bring
- Bachelor’s degree in Computer Science, Data Science, Engineering, or a related technical field.
- 5+ years of experience across several disciplines including data modeling, ETL/ELT, ontology development, semantic graph construction and linked data, and relational schema design.
- 2+ years of data engineering experience in a relevant pharmaceutical GxP setting (CM&C, Discovery R&D, or Manufacturing).
- Experience with AWS and/or Azure.
- Experience with AI/ML/LLM concepts and tools, including building agentic AI solution sets.
- 1–3 years designing large-scale data models for functional, operational, and analytical environments (Conceptual, Logical, Physical & Dimensional).
- Demonstrated SQL and data modeling proficiency.
- Experience with data modeling tools such as ER*Studio, Erwin, or TOAD.
- Experience with data integration including streaming, Industrial IoT, and protocols such as MQTT, AQMP, and Kafka.
- Understanding of modern data architecture, data lakehouse, data warehousing, and/or big data concepts.
- Experience with security models and development on large data sets.
- Experience with multiple databases and formal database designs (e.g., 3NF, Dimensional Models).
- Experience with Agile development, CI/CD, GitHub, and automation platforms.
- Knowledgeable in data functions such as Data Governance, Master Data Management, and Business Intelligence.
- Prior work experience in pharma or another GMP setting.
- Solid knowledge of Computer System Validation process.
- Strong problem-solving skills, learning agility, and curiosity.
- Ability to communicate effectively using a variety of methods in diverse forums.
Key technologies
AWS, Azure, medallion architecture, streaming ingestion, API-based extraction, MQTT, AQMP, Kafka, Postgres, Redshift, Aurora, Athena, Neptune, DynamoDB, MongoDB, SQL, ER*Studio, Erwin, TOAD, Agile Development, CI/CD, GitHub, GxP, GMP, Computer System Validation.
Compensation and benefits
- Salary: USD 129,000 - 231,000 per year.
- Company bonus (depending, in part, on company and individual performance)
- Eligibility to participate in a company-sponsored 401(k)
- Pension
- Vacation benefits
- Eligibility for medical, dental, vision, and prescription drug benefits
- Flexible benefits (e.g., healthcare and/or dependent day care flexible spending accounts)
- Life insurance and death benefits
- Certain time off and leave of absence benefits
- Well-being benefits (e.g., employee assistance program, fitness benefits, and employee clubs and activities)
Location
Onsite: Indianapolis, IN 46260. This position will be onsite in Lebanon, IN beginning late 2027-2028; until then, the work location is Indianapolis, IN.
Similar Jobs
G