Data Engineer II
Job Description
ASU Enterprise Partners is hiring a Data Engineer II to support the integrity, augmentation, integration, security, and stewardship of ASUEP data assets across cloud and hybrid environments.
Responsibilities
- Develop and manage data solutions using Microsoft Fabric, Microsoft Azure Cloud, AWS, Google Cloud Platform, Alteryx, Fivetran, and related technologies
- Build and maintain integrations between multiple data sources and environments across ASU Enterprise Partners and ASU data ecosystems
- Implement data ingestion into bronze and silver medallion layers within ASUEP’s data ecosystems
- Perform advanced configuration in Microsoft Fabric, Microsoft Azure, AWS, Google Cloud Platform, Fivetran, and other related systems to meet evolving business and technical needs
- Provide cross-training to team members
- Migrate systems, code, data sources, and processes to Microsoft Fabric as part of ASUEP’s digital transformation
- Monitor pipelines, jobs, and scheduled events in organization data warehouses, lakehouses, and cloud environments to support uptime, performance, and data integrity
- Respond to and resolve system incidents, job failures, and operational disruptions, which may include nights and weekends
- Load new data sources into Salesforce to augment existing constituent records (including non-degreed alumni records, student organization data, study abroad data, alumni stories data, etc.)
- Partner with data and technology leadership to implement Fabric workspace hierarchy, RBAC, and CI/CD for pipelines
- Migrate on-premises SQL Server data systems and processes to Microsoft Fabric
- Migrate ETL packages from SSIS to Microsoft Fabric Pipelines in the cloud
- Create processes to manage cloud capacity and performance for data solutions
- Develop SQL stored procedures, tables, and views, including complex queries to support end-user investigations
- Validate and clean existing data using SQL; debug complex database processes and implement fixes in a timely manner
- Coordinate with data and technology leadership to classify, tag, and manage data stored throughout the data ecosystem
- Manage multiple projects and assignments concurrently
- Participate in agile project management, including documentation of progress and sprint ceremonies
- Complete tasks on schedule by identifying, communicating, and resolving barriers
- Collaborate with institutional parties to ensure consistency, accuracy, and data availability
- Maintain effective communication with team members
- Document system architecture, troubleshooting steps, system changes, and process improvements
- Perform other duties and projects as required
Requirements
- 5+ years delivering information technology services, including 2+ years with Microsoft Fabric and/or Microsoft Azure cloud technologies, with demonstrated critical thinking and problem-solving skills
- Expertise designing, managing, and troubleshooting pipelines, jobs, services, and solutions in Microsoft Fabric and Microsoft Azure
- Expertise integrating data from various sources into data warehouses, lakehouses, and other environments
- Experience with database technologies in a hybrid multi-cloud/on-premises model
- Experience working within an agile team, or willingness to do so
- Competency with ETL tools including Alteryx, Microsoft Azure Data Factory, Microsoft Fabric Pipelines, and SSIS
- Strong interest in data, data warehouses, data integrity, and moving data to support business users
- Proficiency in Microsoft Windows and Office applications
- Capacity to quickly learn new tools and technologies as needed
- Knowledge of best practice industry data security principles, methods, and techniques
- Ability to maintain a high degree of confidentiality regarding information related to ASUEP, its subsidiaries, university business, and confidential prospect information
- Ability to create technical documentation
- Drive to optimize current processes and improve quality
- Ability to communicate effectively in person, in writing, and by phone
- Ability to work independently and as part of a team; foster trust through interpersonal interactions
- Attention to detail with thorough follow-through on assigned duties
- Ability to articulate deliverables, objectives, results, and outcomes
- Highly organized; able to work efficiently on multiple tasks with deadlines, including establishing milestones and timetables
- Knowledge of applicable regulatory requirements associated with PII, FERPA, and PCI-DSS
- Certification, or willingness to complete certification, for Azure Fundamentals or equivalent
- Bachelor’s degree in Information Technology or related field
- An advocate’s belief in the vision of ASU as the New American University
Preferred Skills and Abilities
- Experience with Salesforce CRM, Salesforce Marketing Cloud, Salesforce Commerce Cloud, Fivetran, and related technologies
Technology Stack
- Microsoft Fabric
- Microsoft Azure Cloud
- AWS
- Google Cloud Platform
- Alteryx
- Fivetran
- Microsoft Azure Data Factory
- Microsoft Fabric Pipelines
- SSIS
- Salesforce
- SQL Server
- SQL
- Azure Fundamentals
- CI/CD
- RBAC
Benefits
- Hybrid work schedule (work from home two days per week)
- Comprehensive benefits package including medical, dental, and vision insurance
- 401(k) plan with matching employer contribution
- 22 days of vacation time
- 11 holidays, including your birthday
- Parental leave
- Significant tuition reductions
- Professional development encouraged across the organization
- $30 bi-weekly cell phone reimbursement
Location: Scottsdale, AZ (hybrid)