Software Engineer, Infrastructure Performance

Summary

OpenReq is a company focused on building AI chips tailored for specific model architectures. They are seeking a Software Engineer for Infrastructure Performance to design and write software for new ASICs, ensuring CI tests run efficiently and contributing to the development of internal tools and server provisioning.

Responsibilities

• Make sure our CI tests run quickly, and if not, will decide what hardware to purchase/what tooling to use to speed them up
• Help us scope out and build internal tools to ship this chip, as well as subsequent chips, as fast as possible
• Help us set up and provision new servers and hardware, working with an IT team if necessary
• Spec out a server using a 6 GHz desktop CPU to speed up single-threaded workloads
• Decide if moving our servers to the cloud/a colo facility makes sense to improve uptime
• Work with IT to connect our hypervisor to our CI
• Set up networking infrastructure to allow Jupyter notebook users to connect to our servers, without waiting for them to be restarted
• Automate the process of setting up accounts for new hires

Skills

• Are highly technical
• Possess expert-level scripting skills, and a deep understanding of datacenter IT work
• Would rather automate the IT team's work than do it yourself
• Have 1+ years of software engineering experience
• Pick up slack, even if it goes outside your job description
• Want to learn more about machine learning research
• GPU kernel profiling and low-level programming
• Transformer optimizations, such as FlashAttention
• Ongoing research in machine learning
• Palladium emulation

Qualifications

Must Haves

• Are highly technical
• Possess expert-level scripting skills, and a deep understanding of datacenter IT work
• Would rather automate the IT team's work than do it yourself
• Have 1+ years of software engineering experience
• Pick up slack, even if it goes outside your job description
• Want to learn more about machine learning research

Nice to Haves

• GPU kernel profiling and low-level programming
• Transformer optimizations, such as FlashAttention
• Ongoing research in machine learning
• Palladium emulation

Benefits

• Full medical, dental, and vision packages, with 100% of premium covered, 90% for dependents
• Housing subsidy of $2,000/month for those living within walking distance of the office
• Daily lunch and dinner in our office
• Relocation support for those moving to Cupertino