NVIDIA
Posted 74 days agoVerified live 1d ago
Deep Learning Software Engineer, Inference - New College Grad 2026
Brief overview
Remote
MastersOr in progress
$124k–$196k/yrStated range
4,626 H-1B approvalsDept. of Labor
1,242 green cardsCertified filings
Deep Learning InferenceGPU ProgrammingCUDAC++ ProgrammingC ProgrammingPythonPerformance OptimizationProfilingDebuggingMulti GPU CommunicationsNCCLOAI TritonCUTLASS
About the company
NVIDIAnvidia.com
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.
Visa sponsorship history
4 years sponsoring, last filed FY2026H-1B dependent
Data powered by U.S. Department of Labor. This does not guarantee sponsorship for this specific role.4,626H-1B approved
99%approval rate
1,238new H-1B hires
1,242PERM certified
$190,000median wage / yr
H-1B Petition ApprovalsVisas USCIS actually granted: the strongest sign the company sponsors.
2023997
20241,519
20251,767
2026343
LCA Certified ApplicationsAn early filing step, not a visa approval: it signals intent, not confirmed sponsorship.
2023203
2024276
2025466
2026436
Green Card (PERM) FilingsCertified green card filings: a long-term commitment to international hires.
2023362
2024279
2025573
202628
Top sponsored roles
Software EngineerHardware Engineer, ElectronicsEngineer Senior Systems SoftwareArchitectEngineer Senior ASIC
Sponsored employees from
IndiaChinaCanadaTaiwanSouth Korea
Job description
Summary
NVIDIA is a leader in AI technology, seeking a Software Engineer specializing in Deep Learning Inference. The role involves designing, building, and optimizing GPU-accelerated software for advanced AI applications, as well as contributing to high-performance open-source frameworks.
Responsibilities
- Performance optimization, analysis, and tuning of DL models in various domains like LLM, Multimodal and Generative AI
- Scale performance of DL models across different architectures and types of NVIDIA accelerators
- Contribute features and code to NVIDIA’s inference libraries, vLLM and SGLang, FlashInfer and LLM software solutions
- Work with cross-collaborative teams across frameworks, NVIDIA libraries and inference optimization innovative solutions
Skills
- Pursuing or recently completed a MS or PhD Computer Engineering, Computer Science, EECS, AI or related field or equivalent experience
- Software development experience
- Excellent C/C++ programming and software design skills
- SW Agile skills are helpful and Python experience is a plus
- Prior experience with training, deploying or optimizing the inference of DL models in production is a plus
- Prior background with performance modeling, profiling, debug, and code optimization or architectural knowledge of CPU and GPU is a plus
- GPU programming experience (CUDA, OAI TRITON or CUTLASS) is a plus
- Experience with Multi GPU Communications (NCCL, NVSHMEM)
Qualifications
Must Haves
- Pursuing or recently completed a MS or PhD Computer Engineering, Computer Science, EECS, AI or related field or equivalent experience
- Software development experience
- Excellent C/C++ programming and software design skills
- SW Agile skills are helpful and Python experience is a plus
Nice to Haves
- Prior experience with training, deploying or optimizing the inference of DL models in production is a plus
- Prior background with performance modeling, profiling, debug, and code optimization or architectural knowledge of CPU and GPU is a plus
- GPU programming experience (CUDA, OAI TRITON or CUTLASS) is a plus
- Experience with Multi GPU Communications (NCCL, NVSHMEM)
More jobs like this
