Loom / Guides / NVIDIA NIM

Cloud · NVIDIA

NVIDIA NIM

Use hosted models from NVIDIA’s API catalog.

Overview

build.nvidia.com hosts many models you can call with one key. It is meant for trying and prototyping.

Get a key

  1. 1
    Go to build.nvidia.com and sign in or create an NVIDIA Developer account (email verification only).
  2. 2
    Open Settings → API Keys and choose Generate Key. You can also open any model and choose Get API Key.
  3. 3
    Copy the key (it starts with nvapi-). It is shown once.

Cost. Free trial access is rate limited, and the amount and rules have changed over time. Check your account page for your current limits.

Add it to Loom

  1. 1
    Open Loom, then Providers in the menu, and choose Add provider.
  2. 2
    Pick NVIDIA NIM (the search box finds it).
  3. 3
    Fill in the fields in the table below.
  4. 4
    Choose Connect. Loom checks the key and says how many models it found. If it cannot check, it says so, and you can Save anyway and try a message.
  5. 5
    Open the model chip below the message box and pick a model.
Field in LoomWhat to putNeeded
API keyPaste the key you copied. Create a key (starts with nvapi-) at build.nvidia.com.Yes
Endpointhttps://integrate.api.nvidia.com/v1Pre-filled
NameAnything you like. It is shown in the model pickerOptional

At a glance

Appears in Loom asNVIDIA NIM
Sign-inYour key, sent as Authorization: Bearer
ModelsLoom fetches the list from your account
Tools (connectors, search)Depends on the model
PhotosDepends on the model
PDFsNo

Good to know

Loom sets a sensible output limit for NVIDIA, which otherwise cuts replies short.

If something goes wrong

What you seeWhat to do
429You hit a trial rate limit. Wait a minute, or try a lighter model.
404 for a modelModel names look like meta/llama-3.3-70b-instruct. Copy one from the catalog.

Official documentation