Lead Member of Technical Staff, Inference Infrastructure

Cohere · San Francisco, United States, New York, Toronto, Montreal

Cohere is hiring a Lead Member of Technical Staff, Inference Infrastructure in San Francisco. The role focuses on operating systems & kernel, databases & storage, networking, graphics, gpu & compute, low-latency & performance.

Key responsibilities

• Demonstrated experience leading the architecture and design of large, highly available distributed systems with Kubernetes and GPU workloads on those clusters.
• Proven ability to lead the design, deployment, support, and troubleshooting of complex Linux-based computing environments at scale.
• Strong expertise in the computational characteristics of accelerators (GPUs, TPUs, and/or custom accelerators), and how to leverage them to drive latency and throughput improvements at scale.

Source and corrections

NearMetal classified and summarized this role from an official company source.