Senior Software Engineer, Inference

CoreWeave · Sunnyvale, CA / Bellevue, WA

CoreWeave is hiring a Senior Software Engineer, Inference in Sunnyvale, CA / Bellevue, WA. The role focuses on databases & storage, networking, virtualization & containers, graphics, gpu & compute.

Key responsibilities

• You’ll partner with product, orchestration, and hardware teams to evolve our Kubernetes-native inference platform and meet strict P99 SLAs at scale.
• Own an area spanning multiple services and teams (e.g., request routing & adaptive scheduling, cost-per-token analytics, GPU resource isolation).
• Optimize end-to-end ML system performance by developing and tuning CUDA kernels, reducing model latency, maximizing compute and memory bandwidth utilization, and leveraging custom accelerators for high-efficiency workloads.

Source and corrections

NearMetal classified and summarized this role from an official company source.