Staff Security Engineer
Job Description
fal is seeking a Staff Security Engineer to set the technical direction for security across fal.ai. This role focuses on designing security architecture and implementing controls spanning GPU compute, multi-cloud and Kubernetes environments, inference APIs, and AI systems, with strong day-to-day fluency in LLMs and AI-driven security workflows.
Key Responsibilities
- Design isolation mechanisms for multi-tenant GPU workloads, including customer code and model execution.
- Secure model weights, customer data, and inference endpoints using identity, encryption, and access control practices.
- Harden cloud platforms, Kubernetes deployments, CI/CD pipelines, and the software supply chain.
- Threat model inference, agentic workflows, and internal AI tools, including prompt injection, data leakage, and model supply chain risks.
- Implement guardrails for agents and AI tools, including scoped permissions, sandboxing, and audit logging.
- Use LLMs and agents to automate security reviews, vulnerability triage, and remediation workflows.
- Own the security architecture and roadmap for the highest-risk areas within the product and infrastructure.
- Conduct design reviews and publish secure patterns that engineering teams can adopt without waiting for security feedback cycles.
- Run vulnerability management end-to-end, from discovery through prioritization and fixes.
- Mentor engineers and help raise the overall security baseline across the company.
Required Qualifications
- AI fluency: experience using LLMs, agents, and AI coding tools daily to build, review, and automate security work.
- Experience: 8+ years of engineering experience, including 5+ years in hands-on security engineering.
- Deep knowledge of cloud security (AWS/GCP), Kubernetes, Linux, and identity and access systems.
- Strong ability in Python or Rust, with production code ownership.
- A track record of security improvements that engineering teams adopted, including leading without formal authority.
- Ability to communicate security risk in business terms to both engineers and executives.
- Experience with GPU infrastructure, ML platforms, or multi-tenant compute.
- Experience securing LLM-based systems or agent frameworks, including AI red teaming.
- Hands-on experience with sandboxing and isolation technologies such as gVisor, Firecracker, or Kata.
- Experience supporting SOC 2 or ISO 27001 audits.
Technologies
- AWS, GCP, Kubernetes, Linux
- Python, Rust
- LLMs, agents
- CI/CD
- gVisor, Firecracker, Kata
- SOC 2, ISO 27001
Location and Employment
- Location: San Francisco, CA (onsite)
- Employment type: Full time
- Department: Engineering
Compensation
- $180,000 - $250,000 per year
- Offers equity
Benefits
- Offers equity
- Health, dental, and vision insurance (US)
- Regular team events and offsites
- Visa sponsorship and relocation support to San Francisco
What We Offer at fal
- Interesting and challenging work
- Learning and growth opportunities
- Visa sponsorship and help relocating to San Francisco
- Health, dental, and vision insurance (US)
- Regular team events and offsites