Getting started with NVIDIA ChatRTX: a beginner's guide

Create an NVIDIA account

Your first step is to visit the official NVIDIA website and create a free account. Open your web browser (like Chrome, Edge, or Firefox) and go to nvidia.com. Look for a button or link labelled "Account" or "Sign Up," usually located in the top-right corner of the page. Click on it to start the registration process.

You'll see a form asking for your personal details. Fill in your name, email address, and choose a strong password. This account acts like your personal pass to access NVIDIA's tools and downloads. After submitting, you'll usually get an email to confirm your address; click the link in that email to activate your account.

Name: Jane Doe Email: [email protected] Password: (choose a strong and unique one)

You'll know it worked when you receive an email confirmation and can successfully log into your new NVIDIA account.

Download the ChatRTX server package

Now that you have an NVIDIA account, you can download the ChatRTX software. Log into your NVIDIA account on nvidia.com. Once logged in, navigate to the "AI Tools" or "Developer" section of the website. You might need to use the website's search bar to find "ChatRTX" if it's not immediately visible.

When you find the ChatRTX product page, look for a prominent "Download" button. Click this button, and your browser will begin downloading a large compressed folder (often called a "zip file," which is a collection of files bundled together to save space). This file usually lands in your computer's "Downloads" folder by default.

You'll know it worked when you see a chatrtx_server_xxx.zip file (where 'xxx' are version numbers) appear in your computer's Downloads folder.

Install the ChatRTX server software

Before you can run the AI, you need to install its core software. First, locate the chatrtx_server_xxx.zip file you downloaded in your Downloads folder. Double-click it to open the compressed folder, then drag its entire contents to a simple location on your C: drive, like C:\ChatRTX.

Inside this new C:\ChatRTX folder, you'll find a file named install.bat. Right-click on install.bat and select "Run as administrator." This launches a command prompt (a text-based window where your computer shows what it's doing) and automatically checks your system. It also sets up necessary "libraries" (extra pieces of software the AI needs to function). If it looks different or you see an error, ensure you extracted all files and are running install.bat as an administrator.

C:\ChatRTX> install.bat Checking GPU driver... OK Setting up runtime... OK

You'll know it worked when the command prompt window shows messages confirming that your GPU (graphics card) driver and the AI's "runtime" (the background program that makes the AI model run) are ready, and then closes itself.

Download the AI model

Now it's time to get the "brain" of your chatbot. The brain is called an "AI model," specifically a Large Language Model (LLM), which is like the powerful engine behind tools such as ChatGPT. To get this model, you need to open your computer's Command Prompt. Search for "cmd" in your Windows search bar and click "Command Prompt" to open it.

In the Command Prompt window, type cd C:\ChatRTX and press Enter to navigate to the ChatRTX folder. Then, type the command chatrtx pull --model default and press Enter again. The tool will begin downloading the AI model files, which are about 3-4 gigabytes (GB – a unit of digital information, like a large movie file) onto your PC. This process only happens once. If it looks different, or you see a "command not found" error, ensure you are in the C:\ChatRTX directory in the Command Prompt.

C:> cd C:\ChatRTX C:\ChatRTX> chatrtx pull --model default Downloading model... [===============================>] 100% (3.2 GB)

You'll know it worked when the Command Prompt shows a progress bar reaching 100% and then confirms the model download is complete.

Start the chatbot locally

With the model downloaded, you can now launch your private AI assistant. In the same Command Prompt window (or open a new one and cd C:\ChatRTX again), type the command chatrtx run --port 8080 and press Enter. This command starts the ChatRTX "server" (a program that quietly runs in the background, waiting for requests) on your computer.

The server will begin "listening" on "port 8080" (think of a port as a specific "door" on your computer that programs use to communicate). You’ll see a line appear that says something like "ChatRTX ready at http://localhost:8080." "Localhost" simply means "this computer," indicating the AI is running directly on your machine. If it looks different and you get an error about "port in use," try chatrtx run --port 8081 instead.

C:\ChatRTX> chatrtx run --port 8080 ChatRTX is now running at http://localhost:8080

You'll know it worked when the Command Prompt displays the `ChatRTX is now running at http://localhost:8080` message. Keep this window open; closing it will stop the AI.

Talk to your new AI assistant

Your private AI is now ready to chat! Open any web browser on your computer (like Chrome, Microsoft Edge, or Firefox). In the address bar at the top of the browser window, type http://localhost:8080 and press Enter.

You'll see a simple chat interface appear, much like popular online chatbots. This is your private ChatRTX assistant! Click into the text box at the bottom of the screen and type a question, like "What's a quick recipe for banana bread?" then hit Enter. The AI will process your request using its local model and reply directly in the chat window.

You: What's a quick recipe for banana bread? ChatRTX: Here's a simple 3-ingredient recipe using overripe bananas...

You'll know it worked when ChatRTX responds to your question with a helpful answer in the browser window.