kennethreitz/instructor
1
0
Fork 0
mirror of https://github.com/kennethreitz/instructor.git synced 2026-06-05 22:50:18 +00:00
Code Issues Packages Projects Releases Wiki Activity

Opensource examples - Runpod w/Text-Generation-WebUI API Endpoint (#247)

Browse Source 
Co-authored-by: Jason Liu <jason@jxnl.co>
This commit is contained in:
Brandon Phillips
2023-12-04 21:28:50 -07:00
committed by GitHub
parent 8d3c255240
commit cb96010bba
5 changed files with 90 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/examples/open_source.md
+12
View File
@@ -0,0 +1,12 @@
# Instructor with open source models
Instructor works with Open source model providers that support the [OpenAI API chat endpoint](https://platform.openai.com/docs/api-reference/chat)
See examples README [here](https://github.com/jxnl/instructor/tree/main/examples/open_source_examples)
# Currently tested open source model providers
- [OpenRouter](https://openrouter.ai/)
- [Perplexity](https://www.perplexity.ai/)
- [RunPod TheBloke LLMs](https://github.com/TheBlokeAI/dockerLLM/blob/main/README_Runpod_LocalLLMsUI.md) **
** This utilizes text-generation-webui w/ Openai plugin under the hood.