Full-Time Engineer: AI Software Engineer

Summary

OpenInfer is a company focused on cutting-edge local AI inference, and they are seeking a Rust Software Developer to join their team. The role involves developing and maintaining an LLM inference engine while contributing to the API front-end and core systems.

Responsibilities

• Develop and maintain LLM inference engine written in Rust
• Deploy Rust to all major client platforms (Windows, Linux, MacOS, Android, iOS)
• Maintain GitHub actions to build & release software
• Maintain end-to-end integrations with Rust across major customer development platforms (React.Native, Java/Kotlin, Swift, C/C++, Python)
• Debug and troubleshoot issues in our API and related infrastructure
• Collaborate with product and AI teams to integrate new features

Skills

• Ideally at least 1-3 years of experience with Rust (personal projects, coursework, or previous work)
• Proficiency in async Rust and concurrent programming
• Strong generalist comfortable with learning and growth attained by tackling out-of-expertise problems
• Strong problem-solving skills and attention to detail
• Familiarity with Axum, Actix, or other Rust web frameworks
• Understanding of containerization (Docker) and cloud services
• Familiarity with GitHub Actions and CI/CD
• 3 years experience in C++
• Experience with Android NDK and integrating Rust into mobile applications
• Working with LLMs and local inference engines like llama.cpp or Ollama
• Familiarity with REST design and FFI integration into C, Python, etc

Qualifications

Must Haves

• Ideally at least 1-3 years of experience with Rust (personal projects, coursework, or previous work)
• Proficiency in async Rust and concurrent programming
• Strong generalist comfortable with learning and growth attained by tackling out-of-expertise problems
• Strong problem-solving skills and attention to detail

Nice to Haves

• Familiarity with Axum, Actix, or other Rust web frameworks
• Understanding of containerization (Docker) and cloud services
• Familiarity with GitHub Actions and CI/CD
• 3 years experience in C++
• Experience with Android NDK and integrating Rust into mobile applications
• Working with LLMs and local inference engines like llama.cpp or Ollama
• Familiarity with REST design and FFI integration into C, Python, etc

Benefits

• Medical, Dental, and Vision benefits
• Flexible Paid Time Off, 10 days
• Parental Leave
• 401(k) Plan with company matching
• Snacks and coffee to keep you energized