All guides

Guide

Hermes Agent + Ollama Cloud: Hosted Open Models Without a GPU

Ollama Cloud is now a first-class Hermes Agent provider. Use the live picker to discover available models, then validate context length and tool calling before a long autonomous run.

The recommended setup

Current Hermes releases treat Ollama Cloud as a built-in provider and fetch the model catalog dynamically. Run hermes model, select Ollama Cloud, enter the API key when prompted, and choose from the models actually returned for your account. This replaces older guides that configured https://ollama.com/v1 as a generic custom endpoint.

hermes model
# Select: Ollama Cloud
# Authenticate with your Ollama Cloud API key
# Choose a model from the live list

Hermes' implementation uses Ollama's OpenAI-compatible /v1 endpoint so streaming, credential resolution, model switching, and tool calls share the standard provider path. The completed upstream provider issue documents the first-class integration and dynamic discovery work.

Step-by-step validation

  1. Create an API key in your Ollama account and keep it out of source control.
  2. Update Hermes if the Ollama Cloud provider is missing from hermes model.
  3. Select a model from the live list; catalog names can change, so do not rely on an old blog's tag.
  4. Ask one short question to validate authentication and billing.
  5. Run a read-only tool call and a multi-turn follow-up before starting autonomous work.

Ollama Cloud versus local Ollama

ChoiceInferenceBest forMain tradeoff
Ollama CloudHosted GPUsLarge models without hardwarePrompts leave your network; metered service
Local OllamaYour machinePrivacy, offline use, predictable hardware costLimited by local RAM and GPU

For a local endpoint, follow the Hermes + Ollama guide instead.

Context length matters

Large catalog claims do not guarantee your selected serving profile uses the maximum context. Test the model with a controlled long prompt and confirm the effective context in provider documentation. Hermes' official FAQ makes the same distinction for local Ollama: the advertised maximum and configured runtime context can differ.

Common problems

  • Provider missing: update Hermes; first-class support landed after early custom-endpoint tutorials.
  • Empty model list: verify the key, account access, and outbound connectivity, then rerun the picker.
  • Tool-call errors: try another model from the live catalog; not every model has equal function-calling behavior.
  • Unexpected latency: shorten context and compare a smaller hosted model before blaming Hermes.

Frequently asked questions

Does Hermes Agent support Ollama Cloud directly?

Yes. Ollama Cloud is a first-class Hermes provider with live model discovery. Use the current hermes model flow rather than copying an old custom-provider workaround.

Is Ollama Cloud the same as local Ollama?

No. Local Ollama runs inference on your own hardware. Ollama Cloud sends prompts to Ollama-hosted GPUs and requires an account and API key.

Related guides

Run Hermes without server setup

Deploy a managed Hermes Agent, then connect your preferred supported model provider.

Deploy Hermes