kennethreitz/langchain
1
0
Fork 0
mirror of https://github.com/kennethreitz/langchain.git synced 2026-06-05 23:00:18 +00:00
Code Issues Packages Projects Releases Wiki Activity
572 Commits 1 Branch 0 Tags
bac676c8e71d46bf503102d5e997272d6b2ab58f
Commit Graph

127 Commits

Author SHA1 Message Date
Ankush Gola d8ac274fc2 add to async chain notebook (#1056) 2023-02-14 18:20:38 -08:00
Ankush Gola caa8e4742e Enable streaming for OpenAI LLM (#986) 
* Support a callback `on_llm_new_token` that users can implement when
`OpenAI.streaming` is set to `True`
 2023-02-14 15:06:14 -08:00
Sasmitha Manathunga c67c5383fd docs: fix typo in notebook (#1046) 2023-02-14 07:06:08 -08:00
Harrison Chase 88bebb4caa Harrison/llm integrations (#1039) 
Co-authored-by: jped <jonathanped@gmail.com>
Co-authored-by: Justin Torre <justintorre75@gmail.com>
Co-authored-by: Ivan Vendrov <ivan@anthropic.com>
 2023-02-13 22:06:25 -08:00
Harrison Chase ec727bf166 Align table info (#999) (#1034) 
Currently the chain is getting the column names and types on the one
side and the example rows on the other. It is easier for the llm to read
the table information if the column name and examples are shown together
so that it can easily understand to which columns do the examples refer
to. For an instantiation of this, please refer to the changes in the
`sqlite.ipynb` notebook.

Also changed `eval` for `ast.literal_eval` when interpreting the results
from the sample row query since it is a better practice.

---------

Co-authored-by: Francisco Ingham <>

---------

Co-authored-by: Francisco Ingham <fpingham@gmail.com>
 2023-02-13 21:48:41 -08:00
Enrico Shippole f30dcc6359 Add GooseAI, CerebriumAI, Petals, ForefrontAI (#981) 
Add GooseAI, CerebriumAI, Petals, ForefrontAI
 2023-02-13 21:20:19 -08:00
Harrison Chase 6a31a59400 add links (#1027) 2023-02-13 16:33:30 -08:00
Harrison Chase 7fb33fca47 chroma docs (#1012) 2023-02-12 23:02:01 -08:00
Harrison Chase 0c553d2064 Harrion/kg (#1016) 
Co-authored-by: William FH <13333726+hinthornw@users.noreply.github.com>
 2023-02-12 23:01:26 -08:00
cragwolfe 05d8969c79 Unstructured example notebook: add a pdf, related deps (#1011) 
Updates the Unstructured example notebook with a PDF example. Includes
additional dependencies for PDF processing (and images, etc).
 2023-02-12 14:56:48 -08:00
Dhruv Anand 03e5794978 typo fix on chat vector db docs (#1007) 
simple typo fix: because --> between
 2023-02-12 12:09:21 -08:00
Harrison Chase 0998577dfe Harrison/unstructured structured (#1004) 2023-02-12 07:36:11 -08:00
Harrison Chase bbb06ca4cf pdfminer (#1003) 2023-02-12 07:29:26 -08:00
Francisco Ingham 0b6aa6a024 Added initial capital letter to bullet points that had it missing (#1000) 
Co-authored-by: Francisco Ingham <>
 2023-02-11 20:31:34 -08:00
Harrison Chase 10e7297306 Harrison/fake llm (#990) 
Co-authored-by: Stefan Keselj <skeselj@princeton.edu>
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
 2023-02-11 15:12:35 -08:00
Harrison Chase e51fad1488 Harrison/0083 (#996) 
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
 2023-02-11 08:29:28 -08:00
Harrison Chase 2e96704d59 Harrison/airbyte (#989) 
Co-authored-by: zanderchase <zanderchase@gmail.com>
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MacBook-Pro.local>
 2023-02-10 18:08:00 -08:00
Charles Frye e9799d6821 improves huggingface_hub example (#988) 
The provided example uses the default `max_length` of `20` tokens, which
leads to the example generation getting cut off. 20 tokens is way too
short to show CoT reasoning, so I boosted it to `64`.

Without knowing HF's API well, it can be hard to figure out just where
those `model_kwargs` come from, and `max_length` is a super critical
one.
 2023-02-10 17:56:15 -08:00
zanderchase c2d1d903fa Zander/online pdf loader (#984) 2023-02-10 15:42:30 -08:00
Harrison Chase 055a53c27f add texts example (#985) 
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MacBook-Pro.local>
 2023-02-10 12:32:44 -08:00
jeff 6ab432d62e docs: update spelling typos (#982) 
Wonder why "with" is spelled "wiht" so many times by human
 2023-02-10 11:37:59 -08:00
Matt Robinson 07a407d89a feat: adds UnstructuredURLLoader for loading data from urls (#979) 
### Summary

Adds a `UnstructuredURLLoader` that supports loading data from a list of
URLs.


### Testing

```python
from langchain.document_loaders import UnstructuredURLLoader

urls = [
    "https://www.understandingwar.org/backgrounder/russian-offensive-campaign-assessment-february-8-2023",
    "https://www.understandingwar.org/backgrounder/russian-offensive-campaign-assessment-february-9-2023"
]
loader = UnstructuredURLLoader(urls=urls)
raw_documents = loader.load()
```
 2023-02-10 10:18:38 -08:00
Harrison Chase c64f98e2bb Harrison/format agent instructions (#973) 
Co-authored-by: Andrew White <white.d.andrew@gmail.com>
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
Co-authored-by: Peng Qu <82029664+pengqu123@users.noreply.github.com>
 2023-02-10 10:07:26 -08:00
Harrison Chase 5469d898a9 Harrison/everynote (#974) 
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
 2023-02-10 08:02:35 -08:00
Harrison Chase 3d639d1539 update lint (#975) 
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
 2023-02-10 08:01:13 -08:00
Harrison Chase 01fa2d8117 Harrison/youtube fixes (#955) 
Co-authored-by: Ji <jizhang.work@gmail.com>
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
 2023-02-09 08:12:22 -08:00
zanderchase 8e126bc9bd adding webpage loading logic (#942) 2023-02-09 07:52:50 -08:00
Harrison Chase 3e1901e1aa gutenberg books (#946) 
Co-authored-by: zanderchase <zander@unfold.ag>
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
 2023-02-08 12:00:47 -08:00
Ikko Eltociear Ashimine 6023d5be09 Update huggingface_hub.ipynb (#944) 
HuggingFace -> Hugging Face
 2023-02-08 11:05:28 -08:00
Harrison Chase 44ecec3896 Harrison/add roam loader (#939) 2023-02-08 00:35:33 -08:00
Ankush Gola bc7e56e8df Add asyncio support for LLM (OpenAI), Chain (LLMChain, LLMMathChain), and Agent (#841) 
Supporting asyncio in langchain primitives allows for users to run them
concurrently and creates more seamless integration with
asyncio-supported frameworks (FastAPI, etc.)

Summary of changes:

**LLM**
* Add `agenerate` and `_agenerate`
* Implement in OpenAI by leveraging `client.Completions.acreate`

**Chain**
* Add `arun`, `acall`, `_acall`
* Implement them in `LLMChain` and `LLMMathChain` for now

**Agent**
* Refactor and leverage async chain and llm methods
* Add ability for `Tools` to contain async coroutine
* Implement async SerpaPI `arun`

Create demo notebook.

Open questions:
* Should all the async stuff go in separate classes? I've seen both
patterns (keeping the same class and having async and sync methods vs.
having class separation)
 2023-02-07 21:21:57 -08:00
Vincent Elster afc7f1b892 Fix typos (#929) 
accomplisehd -> accomplished
 2023-02-07 14:39:45 -08:00
Harrison Chase 637c0d6508 Harrison/obsidian (#920) 2023-02-06 22:21:16 -08:00
Harrison Chase 1e56879d38 Harrison/save faiss (#916) 
Co-authored-by: Shrey Joshi <shreyjoshi2004@gmail.com>
 2023-02-06 21:44:50 -08:00
Ankush Gola 6bd1529cb7 add GoogleDriveLoader (#914) 
only deal with docs files for now
 2023-02-06 21:44:35 -08:00
Harrison Chase cea380174f fix docs custom prompt template (#917) 2023-02-06 20:29:48 -08:00
Harrison Chase 87fad8fc00 analyze document (#731) 
add analyze document chain, which does text splitting and then analysis
 2023-02-06 20:02:19 -08:00
Harrison Chase e2b834e427 Harrison/prompt template prefix (#888) 
Co-authored-by: Gabriel Simmons <simmons.gabe@gmail.com>
 2023-02-06 19:09:28 -08:00
Harrison Chase f95cedc443 Harrison/sql rows (#915) 
Co-authored-by: Jon Luo <20971593+jzluo@users.noreply.github.com>
 2023-02-06 18:56:18 -08:00
Harrison Chase 2ec25ddd4c add unstructured examples (#913) 2023-02-06 18:13:46 -08:00
Harrison Chase 71e662e88d update docs (#905) 2023-02-06 00:26:20 -08:00
Harrison Chase 53d56d7650 Harrison/unstructured support (#903) 2023-02-05 23:02:07 -08:00
Harrison Chase 2a68be3e8d chat vector db chain (#902) 2023-02-05 21:38:47 -08:00
James Briggs 8217a2f26c Update pinecone init details in docs (#898) 
PR to fix outdated environment details in the docs, see issue #897 

I added code comments as pointers to where users go to get API keys, and
where they can find the relevant environment variable.
 2023-02-05 15:21:56 -08:00
Harrison Chase a2b699dcd2 prompt template from string (#884) 2023-02-04 17:04:58 -08:00
Harrison Chase 0b9f086d36 Harrison/docs splitter (#879) 2023-02-03 15:09:13 -08:00
Zach Schillaci 4c79100b15 Correct prompt typo + update example for SQLDatabaseChain (#868) 
See https://github.com/hwchase17/langchain/issues/821
 2023-02-03 08:34:41 -08:00
Harrison Chase 3f48eed5bd Harrison/milvus (#856) 
Signed-off-by: Filip Haltmayer <filip.haltmayer@zilliz.com>
Signed-off-by: Frank Liu <frank.liu@zilliz.com>
Co-authored-by: Filip Haltmayer <81822489+filip-halt@users.noreply.github.com>
Co-authored-by: Frank Liu <frank@frankzliu.com>
 2023-02-02 22:05:47 -08:00
Harrison Chase fc0cfd7d1f docs (#848) 2023-02-02 11:35:36 -08:00
Harrison Chase 23d5f64bda Harrison/ngram example (#846) 
Co-authored-by: Sean Spriggens <ssprigge@syr.edu>
 2023-02-02 09:44:42 -08:00