Data Engineer, Finance
Ai/ml Data Engineering
Artificial Intelligence
Big Data
Bigdata
Business Analytics
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Data
Data & Ai
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
Databricks
Databricks Delta
Databricks Dlt
Databricks Genie
Databricks Lakehouse
Databricks Pyspark
Databricks Sql
ETL
Finance
Finance Analytics
Finance Data
Informatica
Information Technology (IT)
Reporting and Analytics
Software Development
Spark
SQL
Job Description
Shield AI is hiring a Data Engineer, Finance to create a dependable, governed data foundation that supports Finance planning, analytics, and AI-enabled decision workflows. This onsite role in San Diego focuses on reusable Databricks integrations, semantic-layer infrastructure, and production-grade data services for enterprise stakeholders.
Responsibilities
- Build and operate scalable pipelines and integrations that connect enterprise data to Finance products.
- Develop semantic-layer infrastructure and governed data access for analytics, planning, and AI applications.
- Implement end-to-end pipeline observability, data-quality controls, and resilient operational practices.
- Engineer the services and integrations that power Databricks Genie and other AI-enabled Finance workflows.
- Use AI coding assistants to accelerate development while validating correctness, security, and performance.
- Apply FinOps practices to manage platform spend and optimize cost without reducing service quality.
- Partner with analytics engineers and enterprise teams on architecture decisions, data contracts, and sustainable ownership.
Requirements
- Hands-on production data engineering experience using SQL and Python or PySpark.
- Experience with cloud data platforms, orchestration, data modeling, and governed serving patterns.
- Ability to design systems with observability, recoverability, security, and maintainability in mind.
- Proficiency with AI coding assistants, including independent validation of generated work.
- Practical experience enabling AI capabilities on enterprise data, ideally in Databricks; experience with Snowflake Cortex or comparable platforms is welcome.
- Strong cross-functional collaboration skills and demonstrated production ownership.
Technologies
- Databricks
- SQL
- Python
- PySpark
- Snowflake Cortex
- Databricks Genie
- Delta Lake
Location and Salary
Location: San Diego, CA (onsite)
Compensation: USD 97,000 - 140,000 per year
Benefits
- Bonus + Benefits + Equity
- Pay within range listed + Bonus + Benefits + Equity
- Pay within range listed above + temporary benefits package (applicable after 60 days of employment)
Preferred Qualifications
- Experience with Databricks, Delta Lake, cloud infrastructure, and deployment automation.
- Experience developing AI application backends, model integrations, or LLM-based workflows.
- Experience with FinOps, financial data, or enterprise-system integrations.