Together AI embedder
Embeds through Together AI over its OpenAI-compatible /embeddings endpoint. Selected via EMBEDDING_PROVIDER=together.
Enable it
bash
EMBEDDING_PROVIDER=together
TOGETHER_API_KEY=...
EMBEDDING_DIMS=768Configuration
| Variable | Default | Description |
|---|---|---|
EMBEDDING_PROVIDER | openai | Set to together. |
TOGETHER_API_KEY | none | Bearer token for Together AI. Calls fail at runtime if unset. |
EMBEDDING_DIMS | 768 | Vector dimension; must match the embedding model. |
Notes
- Talks to the OpenAI-compatible base URL
https://api.together.xyz/v1. - The default model is
togethercomputer/m2-bert-80M-8k-retrieval. - Shares the OpenAI-compatible request loop: 429 and 5xx and network errors retry with backoff, other 4xx fail fast, and a final failure raises for a clean 503.