Senior Data Engineer
Senior
Analytics
Artificial Intelligence
Azure
Big Data
Business Intelligence
CI/CD
Cloud
Cloud Platform
Cloud Platforms
Data
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Engineering Lead
Data Integration
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Science
Databricks
Lead Data Engineering
Microsoft Azure
Microsoft Fabric
Programming
Reporting and Analytics
Spark
SQL
Streaming Data
Job Description
American Homes 4 Rent, L.P. seeks a Senior Data Engineer to design and run data platform capabilities supporting large-scale processing, analytics, and machine learning.
Responsibilities
- Design, develop, and maintain real-time or batch data pipelines for processing and analyzing large data volumes.
- Build programs and tools for ingestion, curation, and provisioning of complex first-party and third-party data to enable analytics, reporting, and data science.
- Design and develop Advanced Data Products and Intelligent APIs.
- Monitor system performance via regular tests, troubleshoot issues, and integrate new features.
- Lead analysis of data and the design of data architecture supporting BI, AI/ML, and data products.
- Design and implement data platform architecture aligned with organizational analytical requirements.
- Ensure solution designs meet operational needs including scalability, maintainability, extensibility, flexibility, and integrity.
- Provide technical leadership and mentorship to team members.
- Lead peer development and code reviews with emphasis on test-driven development and CI/CD.
- Deploy machine learning models to production as part of analytics and ML enablement.
- Manage data quality through established quality frameworks and ongoing validation.
Requirements
- Bachelor’s degree in computer science, information systems, data science, management information systems, mathematics, physics, engineering, statistics, economics, and/or a related field (required).
- Master’s degree in a related field (preferred).
- Minimum of 8 years of experience as a data engineer with full-stack capabilities.
- Minimum of 10 years of programming experience.
- Minimum of 5 years experience with cloud technologies such as Azure, AWS, or Google.
- Strong SQL knowledge.
- Python proficiency and experience with CI/CD practices.
- Strong background in IaaS platforms and infrastructure.
- Hands-on experience with Databricks, Spark, Fabric, or similar technologies.
- Hands-on experience designing and developing data pipelines and data products.
- Experience developing data ingestion, data processing, and analytical pipelines for big data, NoSQL, and data warehouse solutions.
- Hands-on experience implementing data migration and data processing using Azure services, including: ADLS, Azure Data Factory, Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks Azure Data Catalog, Cosmo Db, ML Studio, AI/ML, etc.
- Extensive experience with Apache Spark and streaming technologies such as Kafka and EventHub.
- Extensive experience designing data applications in a cloud environment.
- Intermediate experience in RESTful APIs, messaging systems, and AWS or Microsoft Azure.
- Extensive experience in data architecture and data modeling.
- Expertise in data analysis and data quality frameworks.
- Knowledge of BI tools such as Power BI and Tableau.
- Experience with Agile methodologies.
- May occasionally work evenings and/or weekends.
Technologies
- Cloud: Azure, AWS, Google
- Programming/Query: Python, SQL
- Data/Processing: Databricks, Spark, Fabric, Apache Spark, NoSQL
- Streaming/Messaging: Kafka, EventHub, Event Hub
- APIs: RESTful APIs
- CI/CD: CI/CD
- Azure services: ADLS, Azure Data Factory, Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks Azure Data Catalog, Cosmo Db, ML Studio, AI/ML
- BI: Power BI, Tableau
- Messaging ecosystems: messaging systems
- Platforms mentioned: AWS, Microsoft Azure
Compensation
- Anticipated pay range: $121,116 - $151,395 per year (annual).
- Discretionary annual bonus eligibility.
Benefits
- Medical, dental, and vision insurance.
- Flexible spending accounts and/or health savings accounts.
- Dependent savings accounts.
- 401(k) with company matching contributions.
- Employee stock purchase plan.
- Tuition reimbursement program.
- 9 paid holidays per year.
- PTO accrual: 0.0577 hours of PTO per hour worked, up to a maximum of 120 hours per year.
Location & Work Model
- Las Vegas, NV (onsite).
CA Job Applicant Privacy Notice: https://www.amh.com/ca-privacy-notice.