AI Engineer

Amalgamated Bank of NY is building enterprise AI capabilities to support its Data & AI strategy, with a focus on practical, governed AI deployments. In this role, you will develop, test, deploy, and support AI applications and agent-based solutions, partnering across engineering and governance teams to ensure reliable performance and trusted data usage.

Location: New York, NY (hybrid). Salary: USD 105,000 - 120,000 per yearly. Experience: 1+ years required. Education: Bachelor’s degree.

What You’ll Do

• Design, develop, test, and support AI-powered applications, copilots, and agent-based solutions using Python, Databricks, and approved enterprise AI platforms.
• Help build retrieval-augmented generation (RAG) solutions, workflow automations, and multi-agent architectures aligned to business objectives.
• Develop and maintain integrations between AI solutions and enterprise systems, including databases, APIs, and business applications.
• Participate in prompt engineering, context management, tool integration, and agent orchestration.
• Create and maintain evaluation frameworks, test datasets, and benchmarking methodologies to measure AI performance.
• Support monitoring of model quality, accuracy, safety, latency, and cost efficiency through dashboards and operational metrics.
• Troubleshoot AI application issues, contribute to performance tuning, and support continuous improvement efforts.
• Participate in validation activities to help ensure AI solutions meet business, regulatory, and governance requirements.
• Prepare, transform, and validate structured and unstructured data for AI and analytical applications.
• Collaborate with Data Engineering and Data Governance teams to ensure AI solutions use trusted, certified, and well-governed data sources.
• Support development and maintenance of vectorized knowledge repositories and retrieval services.
• Contribute to data lineage, metadata, and documentation efforts supporting audit and governance requirements.
• Adhere to established standards for Responsible AI, information security, privacy, model governance, and change management.
• Assist with documentation and evidence collection required for model reviews, audits, and regulatory examinations.
• Help monitor guardrails related to AI safety, accuracy, traceability, observability, and operational effectiveness.
• Follow enterprise policies for access controls, data handling, and model lifecycle management.
• Partner with data engineers, BI engineers, analysts, and business stakeholders to deliver AI solutions that meet real needs.
• Support dashboards and operational reporting that measure AI adoption, effectiveness, and business value.
• Research emerging AI technologies, tools, and engineering practices and share findings with the Data & AI team.
• Participate in peer reviews, technical discussions, and knowledge-sharing activities.
• Perform other duties as directed.

What You Bring

• Bachelor’s degree in Computer Science, Data Science, Engineering, Mathematics, Information Systems, or a related field.
• 1-3 years of professional experience in software engineering, data engineering, machine learning, artificial intelligence, or a related technical discipline.
• Proficiency in Python and SQL.
• Experience with cloud-based data platforms, preferably Databricks or similar technologies.
• Foundational knowledge of large language models (LLMs), prompt engineering, RAG, and AI application development.
• Strong analytical, problem-solving, and troubleshooting abilities.
• Effective verbal and written communication skills, including clear technical documentation.

Technologies You’ll Work With

• Python, SQL, Databricks
• LLMs, retrieval-augmented generation (RAG)
• LangGraph, LlamaIndex, Semantic Kernel
• Azure
• Git, CI/CD pipelines, API development

Hybrid Work Model

Effective February 18, 2025, employees in office-based roles will follow a hybrid schedule of three days or more on-site per week (Monday through Thursday, with specific days varying by site), and Friday designated as remote, unless business-critical tasks require on-site presence. This model does not apply to roles designated as remote, nor to contact center, branch service, and general services where daily in-person attendance is required, or positions covered by a collective-bargaining agreement unless that agreement allows hybrid work.

Search Firm Notice

• Amalgamated Bank does not accept unsolicited assistance from search firms for employment opportunities.
• CVs/resumes submitted by search firms without a valid written search agreement will be considered the sole property of the company.
• No fee will be paid if a candidate is hired due to an agency referral where no pre-existing agreement exists.
• Where agency agreements are in place, introductions are position-specific.
• Please do not call or email.