Summary
Tensormesh is building the next generation of AI inference infrastructure, aiming to optimize GPU utilization and scale inference workloads. They are seeking a Kubernetes Engineer to develop core orchestration logic, extending Kubernetes capabilities for complex AI inference workloads.
Responsibilities
- Develop Custom Operators: Design and implement Kubernetes Custom Resource Definitions (CRDs) and Controllers (using Golang/Kubebuilder) to manage the lifecycle of Tensormesh products
- Traffic Management: Architect and build high-performance ingress and load-balancing systems capable of handling high-throughput inference requests
- Resilience & Scaling: Develop logic for intelligent auto-scaling (HPA/VPA) based on GPU metrics and ensure High Availability (HA) for critical components
- K8s Optimization: Tune the scheduler and resource management configurations to maximize GPU utilization for inference tasks
Skills
- 0-3 years of software engineering experience, with a focus on distributed systems or container orchestration
- Strong proficiency in Go (Golang); experience with the Kubernetes client-go library and Kubebuilder/Operator SDK is highly preferred
- Deep understanding of Kubernetes internals (API machinery, Controller runtime, Networking, CNI)
- Understanding of distributed consensus and state management
- Experience with service meshes (Istio, Linkerd) or ingress controllers (Nginx, Traefik) is a plus
Qualifications
Must Haves
- 0-3 years of software engineering experience, with a focus on distributed systems or container orchestration
- Strong proficiency in Go (Golang); experience with the Kubernetes client-go library and Kubebuilder/Operator SDK is highly preferred
- Deep understanding of Kubernetes internals (API machinery, Controller runtime, Networking, CNI)
- Understanding of distributed consensus and state management
Nice to Haves
- Experience with service meshes (Istio, Linkerd) or ingress controllers (Nginx, Traefik) is a plus
Benefits
- Competitive base salary
- Performance-based bonus
- Equity options
- Medical, dental, and vision insurance
- 401(k) retirement plan
- Paid time off