Guide
Hermes Agent + Ollama Cloud: Hosted Open Models Without a GPU
Ollama Cloud is now a first-class Hermes Agent provider. Use the live picker to discover available models, then validate context length and tool calling before a long autonomous run.
The recommended setup
Current Hermes releases treat Ollama Cloud as a built-in provider and fetch the model catalog dynamically. Run hermes model, select Ollama Cloud, enter the API key when prompted, and choose from the models actually returned for your account. This replaces older guides that configured https://ollama.com/v1 as a generic custom endpoint.
hermes model
# Select: Ollama Cloud
# Authenticate with your Ollama Cloud API key
# Choose a model from the live listHermes' implementation uses Ollama's OpenAI-compatible /v1 endpoint so streaming, credential resolution, model switching, and tool calls share the standard provider path. The completed upstream provider issue documents the first-class integration and dynamic discovery work.
Step-by-step validation
- Create an API key in your Ollama account and keep it out of source control.
- Update Hermes if the Ollama Cloud provider is missing from
hermes model. - Select a model from the live list; catalog names can change, so do not rely on an old blog's tag.
- Ask one short question to validate authentication and billing.
- Run a read-only tool call and a multi-turn follow-up before starting autonomous work.
Ollama Cloud versus local Ollama
| Choice | Inference | Best for | Main tradeoff |
|---|---|---|---|
| Ollama Cloud | Hosted GPUs | Large models without hardware | Prompts leave your network; metered service |
| Local Ollama | Your machine | Privacy, offline use, predictable hardware cost | Limited by local RAM and GPU |
For a local endpoint, follow the Hermes + Ollama guide instead.
Context length matters
Large catalog claims do not guarantee your selected serving profile uses the maximum context. Test the model with a controlled long prompt and confirm the effective context in provider documentation. Hermes' official FAQ makes the same distinction for local Ollama: the advertised maximum and configured runtime context can differ.
Common problems
- Provider missing: update Hermes; first-class support landed after early custom-endpoint tutorials.
- Empty model list: verify the key, account access, and outbound connectivity, then rerun the picker.
- Tool-call errors: try another model from the live catalog; not every model has equal function-calling behavior.
- Unexpected latency: shorten context and compare a smaller hosted model before blaming Hermes.
Frequently asked questions
Does Hermes Agent support Ollama Cloud directly?
Yes. Ollama Cloud is a first-class Hermes provider with live model discovery. Use the current hermes model flow rather than copying an old custom-provider workaround.
Is Ollama Cloud the same as local Ollama?
No. Local Ollama runs inference on your own hardware. Ollama Cloud sends prompts to Ollama-hosted GPUs and requires an account and API key.