LLM Infrastructure & Backend Engineer (4518)

Job Title: LLM Infrastructure & Backend Engineer

Role Overview
Join a mission-driven AI company focused on building secure, scalable platforms for enterprise-grade machine learning products. Backed by one of the world’s most powerful large language models, this organization is transforming conversational AI into real-world business applications. You’ll be part of a collaborative, fast-paced environment that values kindness, innovation, and impact.

This role is ideal for backend engineers who are passionate about ML systems and excited to shape the technical foundation of a cutting-edge enterprise AI product.

Key Responsibilities

• Design and build backend services to support LLM integration, inference orchestration, and data flow.

• Develop clean, production-grade Python code for experimentation, model serving, and system integration.

• Partner closely with ML researchers to rapidly prototype and deploy new product features.

• Build infrastructure capable of handling scalable inference workloads and complex enterprise use cases.

• Take ownership of backend components—ensuring reliability, observability, and maintainability.

Education & Qualifications

• Proficient in backend development using Python, TypeScript, or Node.js.

• Experienced in building and deploying production PyTorch models, including inference pipelines and checkpoint handling.

• Strong foundation in developing scalable, secure APIs and backend services.

• Familiar with FastAPI, Postgres, Redis, Kubernetes, and React.

• Comfortable working in a high-velocity startup environment with evolving goals and systems.

Preferred Experience

• Experience bridging ML systems and backend engineering at the infrastructure level.

• Hands-on work in real-time inference orchestration or ML platform tooling.

• Familiarity with startup or early-stage product development environments.

Why Us

• Impact: Directly influence the next generation of ML-powered enterprise applications.

• Team: Join a kind, experienced, and collaborative team of engineers and researchers.

• Innovation: Help shape infrastructure for one of the most advanced LLMs in the world.

• Career Growth: Opportunity to take on leadership roles as the company scales.

Benefits

• Competitive salary ($200k-350k depending on experience).
• Diverse medical, dental and vision options 
• 401k matching program 
• Unlimited paid time off 
• Parental leave and flexibility for all parents and caregivers
• Support of country-specific visa needs for international employees living in the Bay Area
•  

Applicants must be currently authorized to work in the United States on a full-time basis now and in the future. This position does not offer sponsorship.

#LI-KB1