Cloud Data Platform

Cloud Data Platform Engineer Jobs

259 jobs found

Today

Data Engineer

First Dakota National Bank Sioux Falls, SD

Sioux Falls, SD

Today

Full time Analytics Automation Developer Azure Data Engineer

Apply Now

Job Description

First Dakota National Bank is seeking a Data Engineer (any First Dakota location) to help develop, run, and continuously improve the Bank’s enterprise data platform. In this onsite role, you will design and maintain scalable ETL/ELT pipelines and data products using Microsoft Fabric and related technologies to support analytics, reporting, and data governance.

What you’ll do

Design, develop, test, and maintain data pipelines that extract, transform, and load data into Microsoft Fabric.
Connect and integrate data from core banking systems, third-party applications, APIs, files, and cloud-based platforms.
Build batch and near real-time processing solutions using SQL, Python, Spark, and related technologies.
Create reusable frameworks for ingestion, transformation, orchestration, and monitoring.
Transform and enrich data using business rules, auditing, validation, and data quality controls.
Develop fact, dimension, and analytical models to support Power BI and enterprise reporting.
Implement monitoring, alerting, error handling, and operational documentation for data platform processes.
Support workflow automation and orchestration initiatives using Fabric, SharePoint, Power Apps, Power Automate, and related technologies as appropriate.
Collaborate with data analysts, business stakeholders, and technology teams to deliver reliable, scalable data products.
Participate in data governance, security, metadata management, and documentation efforts.
Troubleshoot production issues and optimize for performance, reliability, and maintainability.
Perform other duties as assigned.

Requirements

Bachelor’s degree in computer science, Information Systems, Data Engineering, or a related field (or equivalent work experience).
3+ years of experience as a Data Engineer, ETL Developer, Data Warehouse Developer, or similar role.
Expert proficiency in SQL, ETL/ELT processes, and data integration.
Expert proficiency in dimensional modeling (Kimball / Star Schema).
Deep experience with one or more of: Microsoft Fabric, Databricks, Snowflake, Azure Data Services.
Professional experience in Python and Spark or other distributed data processing platforms.
Professional experience with Git and source control concepts, plus CI/CD and DevOps practices.
Experience with one or more of: dbt, Azure Data Factory, Kafka or streaming technologies, and REST APIs and application integrations.
Strong understanding of data quality and testing practices, enterprise data governance, security and access controls, and data lineage and documentation.
Experience with financial institutions, banking systems, or Jack Henry platforms is preferred.
Demonstrated positive attitude and good work ethic, with strong attention to detail and ability to maintain strict confidentiality.
Ability to process tasks accurately and efficiently, comply with Bank policies and procedures, and communicate effectively with clientele, coworkers, and departments.
Strong organizational skills and ability to work well in a team environment; punctuality is a must.

Location and work environment

Location: Sioux Falls, SD (onsite)
Office environment: moderate noise level and interaction with others in an office setting

Technologies you’ll work with

Microsoft Fabric
Python, SQL, Spark
Power BI
dbt
Azure services
SharePoint, Power Apps, Power Automate
Databricks, Snowflake
Git, CI/CD, DevOps
Azure Data Factory, Kafka
REST APIs, Jack Henry

Physical demands

Light physical demands, including bending and sitting; occasionally lifting up to 10 pounds with or without reasonable accommodation.

Requirements of all employees

Adaptability
Attendance and punctuality
Career apparel compliance
Customer service
Dependability
Design and attention to detail
Initiative, innovation, and interpersonal respect
Judgment, motivation, communication, and organization support
Planning and problem solving
Professionalism, quality, and safety/security procedures
Team work
Technical skills and ongoing knowledge building

View full job page →

Today

Data Engineer

Wipro Limited Redmond, WA

Redmond, WA

Today

$60k - $140k/yr Full time Backend Developer API APIs

Apply Now

Job Description

Data Engineer (AI Platform) role in Redmond, WA focused on Azure data platforms, ETL/ELT pipelines, and secure backend services.

Responsibilities

Design and build scalable Azure data platforms, including ETL/ELT pipelines and analytical solutions.
Develop REST APIs and backend services using C#, .NET, and ASP.NET Core.
Create data and integration services with Azure SQL, Cosmos DB, Kusto, Azure Functions, Event Hubs, and Service Bus.
Modernize legacy data pipelines, services, APIs, storage platforms, and related application components.
Build and maintain CI/CD pipelines using Azure DevOps and Git.
Apply secure cloud practices using Azure Key Vault, including identity, authentication, and access controls.

Requirements

Azure Cloud Data Platform Engineering experience.
3-5 years of relevant experience.

Technologies

Azure, Azure Data, ETL, ELT
SQL, REST APIs
C#, .NET, ASP.NET Core
Azure SQL, Cosmos DB, Kusto
Azure Functions, Event Hubs, Service Bus
Azure DevOps, Git
Azure Key Vault

Primary Skills

Data Platform
Azure Data
Backend service integration
Modernization & reliability
Cloud & DevOps
ETL and SQL

Compensation

$60,000 to $140,000 per year

Benefits

Full range of medical and dental benefits options
Disability insurance
Paid time off (inclusive of sick leave)
Other paid and unpaid leave options

Location

Redmond, Washington (onsite)

Posting Details

Job role: Data Engineer (AI Platform)
Start date: 10/21/26

View full job page →

Today

Financial Management Data Engineer

Guidehouse Inc. McLean, VA

McLean, VA

Today

$113k - $188k/yr Full time Analytics Automation Developer Big Data

Apply Now

Job Description

Guidehouse is seeking a Financial Management Data Engineer to build data ingestion, integration, and analytics capabilities that support DHS financial management mission goals and decision-making.

Responsibilities

Access data sources and establish data connections
Develop data ingestion and integration solutions using APIs, databases, file-based interfaces, and enterprise platforms for data acquisition and pre-processing
Aggregate, clean, and organize datasets from disparate sources
Perform quality assurance on data preparation activities
Design and implement data integration, mapping, and standardization frameworks
Create configurable business rules and data crosswalks to support interoperability, reconciliation, and reporting across financial and operational systems
Work with large datasets for data mining and structuring of raw data
Use open-source tooling such as SQL, Python, and PySpark to identify patterns and generate new information
Design data modeling processes and build algorithms and predictive models
Conduct ad hoc and exploratory data analysis to support data-driven decision-making
Apply advanced analytics techniques including predictive modeling and machine learning
Ensure compliance with data governance and quality assurance standards
Define data quality metrics associated with the quality of data ingested into Databricks
Organize and lead client meetings, including scheduling, drafting/delivering agendas and meeting minutes, and archiving documentation
Document, track, and follow up on action items from client engagements
Deliver client services while supporting business development, internal firm initiatives, and ongoing professional development

Requirements

Ability to OBTAIN and MAINTAIN a Federal or DoD “PUBLIC TRUST” (ACTIVE PUBLIC TRUST or SUITABILITY preferred)
Bachelor’s degree
3+ years of data experience
Experience performing data analytics to address management and operational challenges
Proficiency with data analytics tools including SQL, Python, R, and Databricks
Proficiency with Microsoft Suite, especially PowerPoint, Word, and Excel
Prior experience with statistical analysis, predictive modeling, machine learning, and artificial intelligence

Technologies

SQL, Python, PySpark, Databricks, R
Microsoft PowerPoint, Microsoft Word, Microsoft Excel
MicrosoftAzure, AWS
Power BI, Power Apps, Power Automate, SharePoint
Microsoft Power Platform, Microsoft Suite
APIs, databases, file-based interfaces, enterprise platforms

Travel Required

Up to 10%

Clearance Required

Ability to Obtain Public Trust

Salary

USD 113,000 - 188,000 per year

Benefits

Medical, Rx, Dental & Vision Insurance
Personal and Family Sick Time & Company Paid Holidays
Potential for a discretionary variable incentive bonus
Parental Leave and Adoption Assistance
401(k) Retirement Plan
Basic Life & Supplemental Life
Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
Short-Term & Long-Term Disability
Student Loan PayDown
Tuition Reimbursement, Personal Development & Learning Opportunities
Skills Development & Certifications
Employee Referral Program
Corporate Sponsored Events & Community Outreach
Emergency Back-Up Childcare Program
Mobility Stipend

What Would Be Nice to Have

Collaborate in a team environment and work independently
Identify and address client needs, build client relationships, and manage priorities
Communicate potential conflicts to a supervisor
Communicate professionally with various audiences, including management and external clients
Facilitate meetings and present topics to technical and functional staff
Experience in commercial or public sector consulting firms
Prior experience supporting federal finance organizations
Experience with cloud-based platforms and services, including MicrosoftAzure or AWS
Experience with Microsoft Power Platform (Power BI, Power Apps, Power Automate) and SharePoint

View full job page →

Today

Senior Associate - Analytics Engineer

New York Life New York, NY

New York, NY

Today

$100k - $143k/yr Full time Analytics Analytics Engineer Aws Cloud

Apply Now

Job Description

New York Life is hiring an Analytics Engineer to strengthen the Data Services team within NYL Enterprise Intelligence. In this hybrid role based in New York, you will help build reliable analytics foundations that support enterprise-scale intelligence and actionable decisioning. This position offers a salary range of $100,000 to $143,000 per year, with discretionary bonus eligibility and overtime eligible: Exempt.

What you’ll do

As a Senior Associate in Tech Data AI Ventures, you will contribute to the development and upkeep of analytics-ready data assets. Your work will combine data transformation, modeling, testing, and reporting to ensure metrics are accurate, accessible, and dependable for enterprise use.

Develop data transformation logic and maintain existing data models using dbt and SQL.
Write and optimize SQL queries for transformation and analysis to support accurate, actionable data.
Assist with implementing and maintaining data quality checks and testing procedures.
Contribute to documentation of data models, transformations, and business logic to improve consistency, reliability, and maintainability.
Build and maintain reports and dashboards using visualization tools to surface insights.
Support delivery of business and operational metrics in partnership with Analytics and senior team members.
Collaborate with team members and stakeholders to achieve shared outcomes.
Participate in cross-functional meetings to understand business requirements and translate them into data needs.
Build strong relationships across engineering and analytics teams, supporting the continued development of enterprise intelligence capabilities.

What you bring

1–3 years of experience in analytics engineering, data engineering, or a related field.
Proficiency in SQL, including writing and optimizing queries for data transformation and analysis.
Familiarity with data warehousing concepts and analytics best practices.
Strong attention to detail and commitment to data quality, accuracy, and reliability.
Ability to work collaboratively in a fast-paced, team-oriented environment across engineering, analytics, and business teams.

Tools and technologies

dbt, SQL
GCP, AWS
Databricks, BigQuery
Looker, Tableau

Requisition ID: 95191
Department / Job Function: Tech Data AI Ventures
Location: New York, NY (Hybrid, 3 days per week)
Job Level: LEVELPF3
Overtime eligible: Exempt
Discretionary bonus eligible: Yes
Sales bonus eligible: No

View full job page →

Today

Azure Data Engineer

Logic Arlington, VA

Arlington, VA

Today

$38 - $48/hr Full time Backend Developer Azure Azure Data Engineer

Apply Now

Job Description

Logic is seeking an Azure Data Engineer to support the design, development, and ongoing maintenance of data solutions for data generation, collection, and processing. This onsite role in Arlington, VA focuses on building reliable data pipelines, implementing ETL for migrating and deploying data across systems, and owning outcomes as a subject matter expert while working closely with the broader team.

You will contribute to problem-solving both within your immediate team and across multiple teams, provide technical guidance and mentorship to junior engineers, and help drive key team decisions through collaboration and SME-level expertise. The position also emphasizes continual improvement by staying current with industry trends and technologies.

Responsibilities

Design, develop, and maintain data solutions for data generation, collection, and processing.
Create and maintain data pipelines.
Ensure data quality through cross-functional collaboration to identify and address data quality issues.
Implement ETL (extract, transform, and load) processes to migrate and deploy data across systems.
Develop innovative data solutions to optimize data generation, collection, and processing.
Implement advanced ETL processes to support efficient data migration and deployment.
Provide solutions to problems for your immediate team and across multiple teams.
Stay updated with the latest industry trends and technologies to continuously improve data solutions.
Provide technical guidance and mentorship to junior team members.
Be responsible for team decisions and engage with multiple teams to contribute to key decisions.
Collaborate with and manage the team to perform expected work as an SME.

Requirements

Minimum 3+ years of work experience with one or more of the following: Databricks, Pyspark, Azure Data Factory, Azure Synapse, Delta live tables, Azure Function Apps.

Technologies

Databricks
Pyspark
Azure Data Factory
Azure Synapse
Delta live tables
Azure Function Apps

Benefits

Medical
Dental
Vision
Long-term disability coverage
401(k) plan
Paid time off
Access to benefits programs
World-class learning resources

Location: Arlington, VA (onsite)
Compensation: USD 38 - 48 per hour

View full job page →

Today

Software Engineer

Rivian Palo Alto, CA

Palo Alto, CA

Today

Full time Backend Developer Application Security Automation

Apply Now

Job Description

Rivian is working to revolutionize the future of electric vehicle charging by creating software that is scalable, secure, and built to solve real customer problems. In this onsite role in Palo Alto, CA, you will implement and ship solutions that integrate with many other services while partnering with both technical and non-technical stakeholders.

What you’ll do

Code and implement software solutions for critical customer needs, with an emphasis on scalability, security, and maintainability across systems that interact with numerous other services
Capture requirements and use cases to translate customer problems into implementable outcomes
Work as a team player using strong analytical, problem solving, and communication skills
Influence and communicate effectively with technical and non-technical stakeholders
Operate in a fast paced, complex technical environment with high adaptability and flexibility
Bring a self-starter mindset with the ability to make decisions independently

What you bring

1+ years of experience in software development
Experience developing microservices using container technologies and container management systems such as Kubernetes
Experience with Nodejs and TypeScript/JavaScript software development
Experience with database design (SQL, NoSQL) and analytics
Experience building and deploying applications and services into cloud environments including AWS, Azure, and GCP

Core technologies

microservices
container technologies
Kubernetes
Nodejs
TypeScript, JavaScript
SQL, NoSQL
AWS, Azure, GCP

How AI supports Rivian’s hiring process

Rivian uses iCIMS Talent Cloud Artificial Intelligence (TCAI) and AI-enabled tools to assist with screening, reviewing, organizing, and highlighting profiles and applications that match key requirements for each role.

AI does not make hiring decisions: qualified candidate applications are reviewed by a member of Rivian’s team, and all decisions are made by humans.
AI is used to support efficiency and consistency, not to replace human judgment.
AI profile matching is voluntary.
You can opt out at any time if you prefer that your profile not be used in this process.

View full job page →

1d ago

Data Engineer

General Dynamics Information Technology Fort Bragg, NC; Coronado, CA

Fort Bragg, NC; Coronado, CA

1d ago

$84k - $114k/yr Full time Analytics Artificial Intelligence Automation Developer

Apply Now

Job Description

General Dynamics Information Technology is seeking a Data Engineer to build and sustain the POTFF Enterprise Data and Analytics foundation. This role will acquire, integrate, and prepare data, design scalable ETL/ELT pipelines, and apply data quality, lineage, and governance controls while supporting data science teams with analysis-ready datasets.

Role Responsibilities

Design, implement, and maintain scalable ETL/ELT pipelines for batch and scheduled processing on Government-furnished technology stacks such as SQL Server, Databricks, and Apache Spark (PySpark).
Integrate structured, semi-structured, and unstructured data sources across the POTFF enterprise, including Government-designated systems such as the Human Performance System of Record (e.g., HPDMS), along with assessment and wearable data, into curated analysis-ready datasets.
Implement data quality controls, validation rules, lineage documentation, and performance tuning to support reliable, reproducible, and secure pipelines; monitor scheduled and orchestrated workloads and address pipeline failures.
Develop and maintain data models, data dictionaries, metadata, and transformation logic under version control; document data sources, assumptions, and processing steps to support transparency and continuity.
Prepare and curate text and other unstructured data to support NLP and LLM use cases executed by the data science team in Government-approved tools.
Support integration of curated data products into Government-furnished visualization and low-code tools, and support deployment of analytic products into operational workflows, including basic MLOps practices where directed by the Government.
Apply Government data governance, security, and privacy requirements, including DoW Impact Level 5 (IL5), HIPAA, and Privacy Act protocols; implement data access controls as directed.
Partner with Government personnel, clinicians, program staff, and the data science team to identify new data sources, improve data quality in Government systems, and translate analytical needs into data requirements.
Provide data engineering expertise and technical guidance to Data Scientists and Senior Data Scientists.

Required Qualifications

Bachelor’s degree in a quantitative or computing discipline, including but not limited to computer science, computer engineering, software engineering, information systems, data science, data engineering, mathematics, statistics, or geospatial science or geoinformatics, with documented coursework or professional application in programming, databases, and quantitative analysis. Candidates without the degree may qualify with the experience stated under Required Minimum Experience/Skills.
Minimum of three (3) years of professional experience in data engineering, database development, or data pipeline development. Without the bachelor’s degree, a minimum of five (5) years of such experience is required.
Demonstrated proficiency in SQL and Python or a comparable data engineering language through professional work experience.
Demonstrated experience building and operating data pipelines, including ETL/ELT design, data modeling, data quality checks, reproducible pipeline design, and Git version control.
Ability to communicate clearly with analysts and non-technical stakeholders and to document technical work for continuity.

Preferred Experience

Experience with Palantir Foundry (including ontology development) or a comparable data-integration platform.
Experience with distributed processing frameworks such as Databricks and Apache Spark (PySpark).
Familiarity with Power BI semantic modeling and the Microsoft Power Platform (Power Apps and Power Automate).
Experience deploying analytics or machine-learning models into applications and familiarity with MLOps concepts.
Experience working in a DoW-authorized cloud environment.
Experience with human performance, health, clinical, or biomedical data.

Technologies

SQL Server
Databricks
Apache Spark (PySpark)
SQL
Python
Git
Natural Language Processing (NLP)
Large Language Model (LLM)
Power BI semantic modeling
Microsoft Power Platform (Power Apps and Power Automate)
MLOps
HIPAA
Privacy Act
DoW Impact Level 5 (IL5)

Location and Work Arrangement

Onsite in Fort Bragg, North Carolina; Joint Base Lewis-McChord, Washington; and Coronado, California.

Additional listed location context includes Various CONUS Sites.

Clearance, Citizenship, and Travel

Clearance Level: Top Secret
Public Trust: None
Citizenship: U.S. Citizenship Required
Travel Required: Less than 10%
Clearance note: Secret or Top-Secret clearance, or ability to obtain clearance.

Salary and Benefits

Salary Range: USD 83,927 - 113,549 per yearly.

401K with company match
Comprehensive health and wellness packages
Internal mobility team dedicated to helping you own your career
Professional growth opportunities including paid education and certifications
Cutting-edge technology you can learn from
Paid vacation and holidays to rest and recharge

Requisition Information

Requisition Type: Regular

Identity Verification Process

You are expected to be on camera during virtual interviews.
The company reserves the right to take your picture to verify identity and prevent fraud.
Proceeding authorizes collection, processing, and use of biometric data for identity verification and security purposes.