Summary
Scaled Cognition is the world’s only model lab dedicated exclusively to customer experience and pioneering agentic models purpose-built for reliable action-taking enterprise applications. As a Software Engineer, Infrastructure, you will design and improve inference infrastructure for AI models and collaborate with research scientists and product engineers to enhance the end-to-end process from model development to production deployment.
Responsibilities
- Design and improve inference infrastructure that powers our AI models
- Benchmark, profile, monitor and analyze latency and throughput and drive improvements throughout the stack
- Collaborate with research scientists and product engineers to streamline the end-to-end process from model development to production deployment
Skills
- Experience deploying systems on major cloud platforms (AWS, GCP, Azure)
- Prior experience designing and implementing GPU infrastructure / tooling
- A strong sense for scalability and developing secure, highly reliable environments
- Are a continuous learner and are eager to explore new tools and technologies
- Thrive in a dynamic environment and are comfortable adapting to changing priorities while maintaining a focus on delivering high-quality solutions
- Have successfully navigated projects with significant product and technical ambiguity, and you excel at the intersection of complex technical challenges and user-focused solutions
Qualifications
Must Haves
- Experience deploying systems on major cloud platforms (AWS, GCP, Azure)
- Prior experience designing and implementing GPU infrastructure / tooling
- A strong sense for scalability and developing secure, highly reliable environments
Nice to Haves
- Are a continuous learner and are eager to explore new tools and technologies
- Thrive in a dynamic environment and are comfortable adapting to changing priorities while maintaining a focus on delivering high-quality solutions
- Have successfully navigated projects with significant product and technical ambiguity, and you excel at the intersection of complex technical challenges and user-focused solutions