Product Manager, AI Platform Kernels and Communication Libraries
NVIDIA - Santa Clara, CA, US, 95053
Work at NVIDIA
Overview
- View job
Overview
Product Manager, AI Platform Kernels and Communication Libraries
Join to apply for the Product Manager, AI Platform Kernels and Communication Libraries role at NVIDIA
Product Manager, AI Platform Kernels and Communication Libraries
Join to apply for the Product Manager, AI Platform Kernels and Communication Libraries role at NVIDIA
Direct message the job poster from NVIDIA
Sr. Technical Recruiter @ NVIDIA | Hyperscale and HPC
NVIDIA's AI Software Platforms team seeks a technical product manager to accelerate next-generation inference deployments through innovative libraries, communication runtimes, and kernel optimization frameworks. This role bridges low-level GPU programming with ecosystem-wide developer enablement for products including CUTLASS, cuDNN, NCCL, NVSHMEM, and open-source contributions to Triton/FlashInfer.
As NVIDIA Product Managers, our goal is to enable developers to be successful on the NVIDIA Platform, and push the boundaries of what is possible with their AI deployments! For Inference, we are the champions inside NVIDIA for AI developers looking to accelerate their deployments on GPUs. We work directly with developers inside and outside of the company to identify key improvements, create roadmaps, and stay alert on the inference landscape. We also work with NVIDIA leaders to define clear product strategy, and marketing team teams to build go-to-market plans. The Product Management organization at NVIDIA is a small, strong, and impactful group. We focus on enabling deep learning across all GPU use cases and providing extraordinary solutions for developers. We are seeking a rare blend of product skills, technical depth, and drive to make NVIDIA great for developers. Does that sounds familiar? If so, we would love to hear from you!
What You'll Be Doing
- Architect developer-focused products that simplify high-performance inference and training deployment across diverse GPU architectures.
- Define the multi-year strategy for kernel and communication libraries by analyzing performance bottlenecks in emerging AI workloads.
- Collaborate with CUDA kernel engineers to design intuitive, high-level abstractions for memory and distributed execution.
- Partner with open-source communities like Triton and FlashInfer to shape and drive ecosystem-wide roadmaps.
- 5+ years of technical PM experience shipping developer products for GPU acceleration, with expertise in HPC optimization stacks.
- Expert-level understanding of CUDA execution models and multi-GPU protocols, with a proven track record to translate hardware capabilities into software roadmaps.
- BS or MS or equivalent experience in Computer Engineering or demonstrated expertise in parallel computing architectures.
- Strong technical interpersonal skills with experience communicating complex optimizations to developers and researchers.
- PhD or equivalent experience in Computer Engineering or a related technical field.
- Contributed to performance-critical open-source projects like Triton, FlashAttention, or TVM with measurable adoption impact
- Crafted GitHub-first developer tools with >1k stars or similar community engagement metrics
- Published research on GPU kernel optimization, collective communication algorithms, or ML model serving architectures
- Experience building cost-per-inference models incorporating hardware utilization, energy efficiency, and cluster scaling factors
You will also be eligible for equity and benefits . NVIDIA accepts applications on an ongoing basis.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
JR1998788
Seniority level
Seniority level
Not Applicable
Employment type
Employment type
Full-time
Job function
Job function
Product Management and Marketing-
Industries
Computer Hardware Manufacturing, Software Development, and Computers and Electronics Manufacturing
Referrals increase your chances of interviewing at NVIDIA by 2x
Get notified about new Product Manager jobs in Santa Clara, CA.
Sunnyvale, CA $114,000.00-$167,000.00 2 weeks ago
Menlo Park, CA $114,000.00-$167,000.00 2 weeks ago
Menlo Park, CA $142,000.00-$201,000.00 2 weeks ago
Sunnyvale, CA $142,000.00-$201,000.00 2 weeks ago
Product Manager, Content Promotion and Distribution, Publishing & Fan Engagement
San Jose, CA $100,500.00-$173,250.00 1 week ago
Sunnyvale, CA $202,000.00-$277,000.00 2 weeks ago
Sunnyvale, CA $171,000.00-$238,000.00 2 weeks ago
Menlo Park, CA $171,000.00-$238,000.00 2 weeks ago
Sunnyvale, CA $171,000.00-$238,000.00 2 weeks ago
Menlo Park, CA $202,000.00-$277,000.00 2 weeks ago
Menlo Park, CA $171,000.00-$238,000.00 2 weeks ago
Menlo Park, CA $249,000.00-$323,000.00 2 weeks ago
Product Operations Manager - TikTok Search Recommendation
San Jose, CA $88,000.00-$202,667.00 1 week ago
Fremont, CA $142,000.00-$201,000.00 1 day ago
Fremont, CA $171,000.00-$238,000.00 6 days ago
Sunnyvale, CA $161,000.00-$179,000.00 1 week ago
Fremont, CA $202,000.00-$277,000.00 1 week ago
Product Manager Intern (TikTok-Product-Social and Creation)- 2025 Summer (BS/MS)
San Jose, CA $149,040.00-$311,600.00 2 days ago
San Jose, CA $165,120.00-$414,000.00 3 weeks ago
Growth Product Manager - $250-300k base - $200M+ (Series B) AI startup
Palo Alto, CA $250,000.00-$300,000.00 4 weeks ago
Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr