Tensormesh logo
Tensormesh
Posted 96 days agoVerified live 2d ago

Kubernetes Engineer

Brief overview

Foster City, CAIn-person
$100k–$200k/yrStated range

About the company

Tensormesh logo
Tensormeshtensormesh.ai

Building infrastructure to optimize AI inference and GPU utilization.

Job description

Summary

Tensormesh is building the next generation of AI inference infrastructure, aiming to optimize GPU utilization and scale inference workloads. They are seeking a Kubernetes Engineer to develop core orchestration logic, extending Kubernetes capabilities for complex AI inference workloads.

Responsibilities

  • Develop Custom Operators: Design and implement Kubernetes Custom Resource Definitions (CRDs) and Controllers (using Golang/Kubebuilder) to manage the lifecycle of Tensormesh products
  • Traffic Management: Architect and build high-performance ingress and load-balancing systems capable of handling high-throughput inference requests
  • Resilience & Scaling: Develop logic for intelligent auto-scaling (HPA/VPA) based on GPU metrics and ensure High Availability (HA) for critical components
  • K8s Optimization: Tune the scheduler and resource management configurations to maximize GPU utilization for inference tasks

Skills

  • 0-3 years of software engineering experience, with a focus on distributed systems or container orchestration
  • Strong proficiency in Go (Golang); experience with the Kubernetes client-go library and Kubebuilder/Operator SDK is highly preferred
  • Deep understanding of Kubernetes internals (API machinery, Controller runtime, Networking, CNI)
  • Understanding of distributed consensus and state management
  • Experience with service meshes (Istio, Linkerd) or ingress controllers (Nginx, Traefik) is a plus

Qualifications

Must Haves

  • 0-3 years of software engineering experience, with a focus on distributed systems or container orchestration
  • Strong proficiency in Go (Golang); experience with the Kubernetes client-go library and Kubebuilder/Operator SDK is highly preferred
  • Deep understanding of Kubernetes internals (API machinery, Controller runtime, Networking, CNI)
  • Understanding of distributed consensus and state management

Nice to Haves

  • Experience with service meshes (Istio, Linkerd) or ingress controllers (Nginx, Traefik) is a plus

Benefits

  • Competitive base salary
  • Performance-based bonus
  • Equity options
  • Medical, dental, and vision insurance
  • 401(k) retirement plan
  • Paid time off

More jobs like this