• FAQ
  • Docs
  • Jobs
  • Contact
  • FAQ
  • Docs
  • Jobs
  • Contact
Get Started

Copyright © 2026 SpeedyApply. All rights reserved.

GitHubLinkedInDiscordDiscordTikTok

Resources

ContactFAQBlogAffiliate

Legal

Privacy PolicyTerms of Service

Chrome Web StoreEdge Add-onsAdd-ons for Firefox
  • FAQ
  • Docs
  • Jobs
  • Contact
  • FAQ
  • Docs
  • Jobs
  • Contact
Get Started

Compute System Arch Engineer - AI Infra - New College Grad 2027

NVIDIA • Shanghai, China

N
NVIDIA

Compute System Arch Engineer - AI Infra - New College Grad 2027

AI / MLNew GradShanghai, China17 days ago

We are building reusable, reliable AI infrastructure for engineering teams, transforming technical documents, source code, and engineering data into accessible knowledge and enabling AI agents to perform complex engineering tasks. In this role, you will design and develop knowledge platforms, LLM service integrations, and agent execution frameworks, taking AI capabilities from prototypes to maintainable production systems for knowledge retrieval, test development, code review, and failure analysis.

What you’ll be doing:

  • Design and develop reusable AI platform components and services that provide consistent interfaces for model access, knowledge retrieval, tool calling, and workflow execution.
  • Build data ingestion and processing pipelines for heterogeneous sources, including documents, code, and tables, supporting parsing, structured extraction, incremental updates, versioning, and provenance.
  • Develop retrieval-augmented generation (RAG) and knowledge infrastructure, combining vector search, keyword search, reranking, and structured knowledge to improve retrieval quality and context relevance.
  • Develop agentic and multi-agent workflows with tool integration, context and state management, task scheduling, failure recovery, and human review.
  • Build evaluation and observability systems using datasets, automated tests, regression benchmarks, and execution traces to measure and improve correctness, reliability, latency, and cost.
  • Own platform deployment and maintenance, including access controls, data isolation, recovery mechanisms, and release processes, supporting reliable use across multiple users and applications.
  • Collaborate with domain experts and application developers to translate engineering needs into platform capabilities and continuously improve them through user feedback.

What we need to see:

  • Bachelor’s degree in Computer Science, Software Engineering, Electrical Engineering, or a related field, or equivalent experience. An MS or PhD is a plus.
  • Hands on experience in software engineering, infrastructure, data platforms, machine learning engineering, or related areas.
  • Strong Python programming skills and software engineering fundamentals, with familiarity with Linux, version control, automated testing, and CI/CD.
  • Hands-on development and deployment experience in at least one of the following: LLM application infrastructure, RAG systems, agent platforms, or model-serving systems.
  • Understanding of the core mechanisms and limitations of LLM applications, including model APIs, embeddings, context management, structured outputs, tool calling, and evaluation.
  • Experience with backend services, databases, and data processing, including concurrency, caching, task state management, failure recovery, and API design.
  • Strong debugging, testing, and analytical skills, with the ability to diagnose issues through logs, metrics, and experiments and independently validate AI-generated code and results.
  • Good communication, collaboration, and ownership, with the ability to learn new domains and drive solutions from requirements through delivery and maintenance.

Ways to stand out from the crowd:

  • Experience with enterprise knowledge bases, complex document parsing, knowledge graphs, ontology modeling, or data quality management.
  • Experience developing or integrating agent frameworks, multi-agent systems, MCP, or other tool protocols, with the ability to understand and extend their underlying mechanisms.
  • Experience with AI evaluation, security testing, permission isolation, prompt-injection defenses, or reliability engineering for nondeterministic systems.
  • Experience optimizing model deployment, inference services, batching, caching, or resource scheduling, with an understanding of quality, throughput, latency, and cost tradeoffs.
  • Demonstrated ownership of production AI systems or meaningful contributions to relevant open-source projects and C++ development experience, or a background in computer architecture, GPUs, compilers, hardware verification, or engineering developer tools.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you’re creative, autonomous, and love a challenge, we want to hear from you

144 results

  • N
    NVIDIADeveloper Technology Engineer Intern
    Tokyo, Japan
    Software EngineeringInternship
    4 days ago
  • N
    NVIDIASystem Software Engineering Intern - 2027
    Helsinki, Finland• €39K–€67.6K/yr
    Software EngineeringInternship
    4 days ago
  • N
    NVIDIAAI Computing Software Developer - New College Graduate 2027
    Taipei, Taiwan
    Software EngineeringNew Grad
    5 days ago
  • N
    NVIDIAAI Operations Intern - AI Clouds - Summer 2027
    Santa Clara, CA• $20–$71/hr
    Software EngineeringInternship
    5 days ago
  • N
    NVIDIASystem Software Engineer Intern - Autonomous Vehicles - 2027
    Shenzhen, China +1
    Software EngineeringInternship
    8 days ago
  • N
    NVIDIAReinforcement Learning Intern - 2027
    Shanghai, China +2
    AI / MLInternship
    8 days ago
  • N
    NVIDIAAI Infrastructure and Frameworks Intern - Cosmos Lab - 2027
    Shanghai, China
    AI / MLInternship
    8 days ago
  • N
    NVIDIAAI Developer Technology Engineering Intern - 2027
    Shenzhen, China +2
    Software EngineeringInternship
    9 days ago
  • N
    NVIDIASystem Software Engineer Intern - Autonomous Vehicles - 2027
    Shanghai, China
    Software EngineeringInternship
    9 days ago
  • N
    NVIDIAResearch Scientist - AI and Systems Security - PhD New College Grad 2026
    Westford, MA +1• $168K–$264.5K/yr
    AI / MLNew Grad
    9 days ago
  • N
    NVIDIASystem Software Intern - Embedded Power Management - 2027
    Taipei, Taiwan
    Software EngineeringInternship
    9 days ago
  • N
    NVIDIAPhD Research Scientist - Fundamental Generative AI - New College Grad 2026
    Santa Clara, CA• $168K–$264.5K/yr
    AI / MLNew Grad
    9 days ago
  • N
    NVIDIATechnical Learning Content Development Intern - Physical AI — Summer 2027
    Santa Clara, CA• $20–$71/hr
    AI / MLInternship
    10 days ago
  • N
    NVIDIASoftware Engineering Intern - Physics Simulation - 2027
    Zürich, Switzerland
    Software EngineeringInternship
    10 days ago
  • N
    NVIDIADeep Learning Scientist Intern - LLM - Multimodal and Agentic AI - Summer 2027
    Santa Clara, CA
    AI / MLInternship
    11 days ago
  • N
    NVIDIAAI Compiler Intern - CUDA Tile IR - Summer 2027
    Zürich, Switzerland
    AI / MLInternship
    12 days ago
  • N
    NVIDIALLM Reinforcement Learning Framework Intern - 2027
    Shanghai, China
    AI / MLInternship
    12 days ago
  • N
    NVIDIAAI Compiler and Kernel Intern - Summer 2027
    Austin, TX
    AI / MLInternship
    13 days ago
  • N
    NVIDIASoftware Engineer - Hardware Tools and Methodology - New College Grad 2026
    Santa Clara, CA• $116K–$218.5K/yr
    Software EngineeringNew Grad
    16 days ago
  • N
    NVIDIAResearch Scientist - ML Systems - PhD New College Grad 2026
    Santa Clara, CA +3• $168K–$264.5K/yr
    AI / MLNew Grad
    16 days ago
1 / 8Next

Logos provided by Logo.dev