Software Engineer, LLM Infrastructure

Fireworks AI · San Mateo

Fireworks AI is hiring a Software Engineer, LLM Infrastructure in San Mateo. The role focuses on databases & storage, networking, graphics, gpu & compute, low-latency & performance.

Key responsibilities

• You will partner closely with our cloud infrastructure team, product team, and performance team to deliver infrastructure that bridges the gap between our customer and the ultra-performant proprietary Fireworks inference engine.
• Contribute to the design and development of scalable backend infrastructure that supports distributed training, inference, and data pipelines.
• Build and maintain core backend services such as LLM CI/CD pipeline, control plane, and model serving systems.

Source and corrections

NearMetal classified and summarized this role from an official company source.