Connect a model
REX needs a model to answer. Connect one with a plan you already pay for, with an API key, or with a model that runs on your PC.
What you are connecting
A model is the service that reads your request and writes the answer. A provider is the company that runs the model. REX sends what you ask a model to the provider that runs it.
The provider sets the price and the limits, and bills you. Your key or sign-in is kept on this PC. REX uses it only to talk to that provider.
Choose a way to connect
- A ChatGPT plan. You sign in with your OpenAI account. You need no API key, and your use counts against your plan.
- An API key. You create a key on the provider's website and paste it into REX. The provider charges your account with them for what you use.
- A local model. REX finds models served on this PC by Ollama, LM Studio, llama.cpp, vLLM or RAI. Requests to a local model stay on this PC.
You can connect more than one. You pick the model for each chat.
Connect with a ChatGPT plan
- In REX, open Settings, then Providers.
- Under Popular providers, select OpenAI Subscription. The connect window asks how you want to connect.
- Select ChatGPT Pro/Plus (browser). Your browser opens the OpenAI sign-in page.
- Sign in and approve the request in the browser.
- Go back to REX. It says OpenAI Subscription connected, and the plan's models are in the model list.
If the browser sign-in does not finish, open the connect window again and select ChatGPT Pro/Plus (headless). REX shows a link and a Confirmation code. Open the link, enter the code, and sign in.
If your plan does not serve a model you picked, REX says so in the chat. Pick another model.
Connect with an API key
First create a key on the provider's own website. The name after each address is the provider's name in REX.
- Google Gemini:
aistudio.google.com/apikey. In REX: Google. - OpenAI:
platform.openai.com/api-keys. In REX: OpenAI API. - Anthropic:
console.anthropic.com/settings/keys. In REX: Anthropic. - NVIDIA NIM:
build.nvidia.com. In REX: Nvidia. - OpenRouter:
openrouter.ai/keys. In REX: OpenRouter.
- Copy the key from the provider's website.
- In REX, open Settings, then Providers.
- Select the provider. If it is not under Popular providers, find it under All providers. The connect window opens.
- If REX asks how you want to connect, select API key.
- Paste the key and select Connect. REX says the provider is connected, and its models are in the model list.
Treat a key like a password. Anyone who has it can use your account with that provider.
Use a model on your own PC
- Start your model program, for example Ollama or LM Studio, and load a model in it.
- In REX, open Settings, then Local models.
- Turn on Use local models. REX lists the models it finds on this PC, and they appear in the model list.
Pick the model for a chat
- In the message box, select the model button. It shows the model's name, or Select model when none is chosen. The list of models opens, joined to the message box. Type to search it.
- Select a model. REX uses it for your next message.
REX never picks a model for you. To choose which models the list shows, open Settings, then Models.
Disconnect a provider
- In REX, open Settings, then Providers.
- Under Connected providers, find the provider and select Disconnect. REX says the provider is disconnected, and its models leave the model list.