> For the complete documentation index, see [llms.txt](https://www.techwithtyler.dev/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://www.techwithtyler.dev/ai/running-llms-locally/ollama.md).
# Ollama
How to run LLMs locally with Ollama
## Installation
{% code overflow="wrap" %}
```bash
brew install ollama
```
{% endcode %}
## Uninstallation
{% hint style="danger" %}
Uninstalling ollama does not remove downloaded models!
{% endhint %}
{% code overflow="wrap" %}
```zsh
brew uninstall ollama
```
{% endcode %}
{% code overflow="wrap" %}
```zsh
rm -rf ~/.ollama
```
{% endcode %}
***
## Running Ollama Server
* Once up and running, we can download and run models.
{% code overflow="wrap" %}
```bash
ollama serve
```
{% endcode %}
* Stop the server by hitting `CTRL + C` or by closing the Terminal session
***
## Discovering and Downloading Models
* Models are [viewable here](https://ollama.com/search)
* Models are downloaded here `~/.ollama/models/manifests/registry.ollama.ai/library/`
***
## Command Cheat Sheet
### List downloaded models
{% code overflow="wrap" %}
```bash
ollama list
```
{% endcode %}
### View running models
{% code overflow="wrap" %}
```bash
ollama ps
```
{% endcode %}
### Running models
If the model isn't installed already, it will be downloaded
{% code overflow="wrap" %}
```bash
ollama run gemma3:27b
```
{% endcode %}
***
## Integrating with VS Code
{% hint style="warning" %}
Ollama must be running for this to work — `ollama serve`
{% endhint %}
