kennethreitz/langchain
1
0
Fork 0
mirror of https://github.com/kennethreitz/langchain.git synced 2026-06-05 23:00:18 +00:00
Code Issues Packages Projects Releases Wiki Activity
550 Commits 1 Branch 0 Tags
bbb06ca4cf697d9bec0bb13a80043b5ea1c3b3ec
Commit Graph

115 Commits

Author SHA1 Message Date
Harrison Chase bbb06ca4cf pdfminer (#1003) 2023-02-12 07:29:26 -08:00
Francisco Ingham 0b6aa6a024 Added initial capital letter to bullet points that had it missing (#1000) 
Co-authored-by: Francisco Ingham <>
 2023-02-11 20:31:34 -08:00
Harrison Chase 10e7297306 Harrison/fake llm (#990) 
Co-authored-by: Stefan Keselj <skeselj@princeton.edu>
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
 2023-02-11 15:12:35 -08:00
Harrison Chase e51fad1488 Harrison/0083 (#996) 
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
 2023-02-11 08:29:28 -08:00
Harrison Chase 2e96704d59 Harrison/airbyte (#989) 
Co-authored-by: zanderchase <zanderchase@gmail.com>
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MacBook-Pro.local>
 2023-02-10 18:08:00 -08:00
Charles Frye e9799d6821 improves huggingface_hub example (#988) 
The provided example uses the default `max_length` of `20` tokens, which
leads to the example generation getting cut off. 20 tokens is way too
short to show CoT reasoning, so I boosted it to `64`.

Without knowing HF's API well, it can be hard to figure out just where
those `model_kwargs` come from, and `max_length` is a super critical
one.
 2023-02-10 17:56:15 -08:00
zanderchase c2d1d903fa Zander/online pdf loader (#984) 2023-02-10 15:42:30 -08:00
Harrison Chase 055a53c27f add texts example (#985) 
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MacBook-Pro.local>
 2023-02-10 12:32:44 -08:00
jeff 6ab432d62e docs: update spelling typos (#982) 
Wonder why "with" is spelled "wiht" so many times by human
 2023-02-10 11:37:59 -08:00
Matt Robinson 07a407d89a feat: adds UnstructuredURLLoader for loading data from urls (#979) 
### Summary

Adds a `UnstructuredURLLoader` that supports loading data from a list of
URLs.


### Testing

```python
from langchain.document_loaders import UnstructuredURLLoader

urls = [
    "https://www.understandingwar.org/backgrounder/russian-offensive-campaign-assessment-february-8-2023",
    "https://www.understandingwar.org/backgrounder/russian-offensive-campaign-assessment-february-9-2023"
]
loader = UnstructuredURLLoader(urls=urls)
raw_documents = loader.load()
```
 2023-02-10 10:18:38 -08:00
Harrison Chase c64f98e2bb Harrison/format agent instructions (#973) 
Co-authored-by: Andrew White <white.d.andrew@gmail.com>
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
Co-authored-by: Peng Qu <82029664+pengqu123@users.noreply.github.com>
 2023-02-10 10:07:26 -08:00
Harrison Chase 5469d898a9 Harrison/everynote (#974) 
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
 2023-02-10 08:02:35 -08:00
Harrison Chase 3d639d1539 update lint (#975) 
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
 2023-02-10 08:01:13 -08:00
Harrison Chase 01fa2d8117 Harrison/youtube fixes (#955) 
Co-authored-by: Ji <jizhang.work@gmail.com>
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
 2023-02-09 08:12:22 -08:00
zanderchase 8e126bc9bd adding webpage loading logic (#942) 2023-02-09 07:52:50 -08:00
Harrison Chase 3e1901e1aa gutenberg books (#946) 
Co-authored-by: zanderchase <zander@unfold.ag>
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
 2023-02-08 12:00:47 -08:00
Ikko Eltociear Ashimine 6023d5be09 Update huggingface_hub.ipynb (#944) 
HuggingFace -> Hugging Face
 2023-02-08 11:05:28 -08:00
Harrison Chase 44ecec3896 Harrison/add roam loader (#939) 2023-02-08 00:35:33 -08:00
Ankush Gola bc7e56e8df Add asyncio support for LLM (OpenAI), Chain (LLMChain, LLMMathChain), and Agent (#841) 
Supporting asyncio in langchain primitives allows for users to run them
concurrently and creates more seamless integration with
asyncio-supported frameworks (FastAPI, etc.)

Summary of changes:

**LLM**
* Add `agenerate` and `_agenerate`
* Implement in OpenAI by leveraging `client.Completions.acreate`

**Chain**
* Add `arun`, `acall`, `_acall`
* Implement them in `LLMChain` and `LLMMathChain` for now

**Agent**
* Refactor and leverage async chain and llm methods
* Add ability for `Tools` to contain async coroutine
* Implement async SerpaPI `arun`

Create demo notebook.

Open questions:
* Should all the async stuff go in separate classes? I've seen both
patterns (keeping the same class and having async and sync methods vs.
having class separation)
 2023-02-07 21:21:57 -08:00
Vincent Elster afc7f1b892 Fix typos (#929) 
accomplisehd -> accomplished
 2023-02-07 14:39:45 -08:00
Harrison Chase 637c0d6508 Harrison/obsidian (#920) 2023-02-06 22:21:16 -08:00
Harrison Chase 1e56879d38 Harrison/save faiss (#916) 
Co-authored-by: Shrey Joshi <shreyjoshi2004@gmail.com>
 2023-02-06 21:44:50 -08:00
Ankush Gola 6bd1529cb7 add GoogleDriveLoader (#914) 
only deal with docs files for now
 2023-02-06 21:44:35 -08:00
Harrison Chase cea380174f fix docs custom prompt template (#917) 2023-02-06 20:29:48 -08:00
Harrison Chase 87fad8fc00 analyze document (#731) 
add analyze document chain, which does text splitting and then analysis
 2023-02-06 20:02:19 -08:00
Harrison Chase e2b834e427 Harrison/prompt template prefix (#888) 
Co-authored-by: Gabriel Simmons <simmons.gabe@gmail.com>
 2023-02-06 19:09:28 -08:00
Harrison Chase f95cedc443 Harrison/sql rows (#915) 
Co-authored-by: Jon Luo <20971593+jzluo@users.noreply.github.com>
 2023-02-06 18:56:18 -08:00
Harrison Chase 2ec25ddd4c add unstructured examples (#913) 2023-02-06 18:13:46 -08:00
Harrison Chase 71e662e88d update docs (#905) 2023-02-06 00:26:20 -08:00
Harrison Chase 53d56d7650 Harrison/unstructured support (#903) 2023-02-05 23:02:07 -08:00
Harrison Chase 2a68be3e8d chat vector db chain (#902) 2023-02-05 21:38:47 -08:00
James Briggs 8217a2f26c Update pinecone init details in docs (#898) 
PR to fix outdated environment details in the docs, see issue #897 

I added code comments as pointers to where users go to get API keys, and
where they can find the relevant environment variable.
 2023-02-05 15:21:56 -08:00
Harrison Chase a2b699dcd2 prompt template from string (#884) 2023-02-04 17:04:58 -08:00
Harrison Chase 0b9f086d36 Harrison/docs splitter (#879) 2023-02-03 15:09:13 -08:00
Zach Schillaci 4c79100b15 Correct prompt typo + update example for SQLDatabaseChain (#868) 
See https://github.com/hwchase17/langchain/issues/821
 2023-02-03 08:34:41 -08:00
Harrison Chase 3f48eed5bd Harrison/milvus (#856) 
Signed-off-by: Filip Haltmayer <filip.haltmayer@zilliz.com>
Signed-off-by: Frank Liu <frank.liu@zilliz.com>
Co-authored-by: Filip Haltmayer <81822489+filip-halt@users.noreply.github.com>
Co-authored-by: Frank Liu <frank@frankzliu.com>
 2023-02-02 22:05:47 -08:00
Harrison Chase fc0cfd7d1f docs (#848) 2023-02-02 11:35:36 -08:00
Harrison Chase 23d5f64bda Harrison/ngram example (#846) 
Co-authored-by: Sean Spriggens <ssprigge@syr.edu>
 2023-02-02 09:44:42 -08:00
Harrison Chase 0de55048b7 return code for pal (#844) 2023-02-02 08:47:20 -08:00
Harrison Chase d564308e0f rfc: instruct embeddings (#811) 
Co-authored-by: seanaedmiston <seane999@gmail.com>
 2023-02-02 08:44:02 -08:00
Istora Mandiri 06438794e1 Fix typo in textsplitter docs (#825) 2023-02-01 23:32:35 -08:00
Harrison Chase 7b4882a2f4 Harrison/tf embeddings (#817) 
Co-authored-by: Ryohei Kuroki <10434946+yakigac@users.noreply.github.com>
 2023-01-31 00:00:08 -08:00
Harrison Chase 94ae126747 return sql intermediate steps (#792) 2023-01-30 15:10:48 -08:00
Roy Williams 6086292252 Centralize logic for loading from LangChainHub, add ability to pin dependencies (#805) 
It's generally considered to be a good practice to pin dependencies to
prevent surprise breakages when a new version of a dependency is
released. This commit adds the ability to pin dependencies when loading
from LangChainHub.

Centralizing this logic and using urllib fixes an issue identified by
some windows users highlighted in this video -
https://youtu.be/aJ6IQUh8MLQ?t=537
 2023-01-30 14:52:17 -08:00
Harrison Chase 1ad7973cc6 Harrison/tool decorator (#790) 
Co-authored-by: Jason Liu <jxnl@users.noreply.github.com>
Co-authored-by: Jason Liu <jason@jxnl.coA>
 2023-01-28 18:26:24 -08:00
Harrison Chase 248c297f1b Sample row in table info for SQLDatabase (#769) (#782) 
The agents usually benefit from understanding what the data looks like
to be able to filter effectively. Sending just one row in the table info
allows the agent to understand the data before querying and get better
results.

---------

Co-authored-by: Francisco Ingham <>

---------

Co-authored-by: Francisco Ingham <fpingham@gmail.com>
 2023-01-28 13:37:07 -08:00
Harrison Chase c658f0aed3 Harrison/add to search (#778) 
Co-authored-by: Enrico Shippole <enricoship@gmail.com>
 2023-01-28 08:06:00 -08:00
Harrison Chase a5d003f0c9 update notebook and make backwards compatible (#772) 2023-01-28 07:23:04 -08:00
Harrison Chase b9ad214801 add docs for loading from hub (#763) 2023-01-27 07:10:26 -08:00
Harrison Chase 1b89a438cf (wip) Harrison/serialize agents (#725) 2023-01-26 19:48:47 -08:00