> For the complete documentation index, see [llms.txt](https://docs.predictor.sh/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.predictor.sh/readme.md).

# Welcome

**predictor.sh** is a CLI that turns local AI models into secure, internet-accessible API endpoints in seconds.

## What is predictor.sh?

With predictor.sh, you can expose local ML inference to the internet with a single command. Get a stable HTTPS URL, authentication, and observability without any cloud deployment complexity.

```bash
# Local model
predictor up ./llama-7b.gguf

# Or a HuggingFace model
predictor up TheBloke/Llama-2-7B-GGUF

# Your model is now live at https://abc123.predictor.sh
```

## Key Features

| Feature               | Description                                         |
| --------------------- | --------------------------------------------------- |
| **One Command**       | Go from local model to public API in seconds        |
| **Stable URLs**       | Your endpoint URL survives disconnects and restarts |
| **OpenAI Compatible** | Drop-in replacement for OpenAI APIs                 |
| **Multi-Modal**       | Text, speech-to-text (Whisper), and text-to-speech  |
| **GPU Accelerated**   | Native Metal (macOS) and CUDA (NVIDIA) support      |
| **Built-in Auth**     | Bearer token authentication out of the box          |

## Supported Modalities

| Modality           | Formats                 | APIs                    |
| ------------------ | ----------------------- | ----------------------- |
| **Text (LLM)**     | GGUF, SafeTensors, ONNX | OpenAI-compatible       |
| **Speech-to-Text** | Whisper (16 variants)   | OpenAI Whisper API      |
| **Text-to-Speech** | Parler-TTS, Kokoro      | OpenAI + ElevenLabs API |

## Quick Links

<table data-view="cards"><thead><tr><th></th><th></th><th data-hidden data-card-target data-type="content-ref"></th></tr></thead><tbody><tr><td><strong>Installation</strong></td><td>Get predictor.sh installed</td><td><a href="/getting-started/installation.md">Installation</a></td></tr><tr><td><strong>Quickstart</strong></td><td>Your first endpoint in 5 minutes</td><td><a href="/getting-started/quickstart.md">Quickstart</a></td></tr><tr><td><strong>API Reference</strong></td><td>OpenAI-compatible endpoints</td><td><a href="/api-reference/overview.md">Overview</a></td></tr></tbody></table>