mirror of
https://github.com/kennethreitz/instructor.git
synced 2026-06-05 22:50:18 +00:00
Brandon Phillips
12 lines
600 B
Markdown
12 lines
600 B
Markdown
# Instructor with open source models
|
|
Instructor works with Open source model providers that support the [OpenAI API chat endpoint](https://platform.openai.com/docs/api-reference/chat)
|
|
|
|
See examples README [here](https://github.com/jxnl/instructor/tree/main/examples/open_source_examples)
|
|
|
|
# Currently tested open source model providers
|
|
- [OpenRouter](https://openrouter.ai/)
|
|
- [Perplexity](https://www.perplexity.ai/)
|
|
- [RunPod TheBloke LLMs](https://github.com/TheBlokeAI/dockerLLM/blob/main/README_Runpod_LocalLLMsUI.md) **
|
|
|
|
|
|
** This utilizes text-generation-webui w/ Openai plugin under the hood. |