mirror of
https://github.com/kennethreitz/langchain.git
synced 2026-06-05 23:00:18 +00:00
ddd07001f3
- Description: Adding language as parameter to NLTK, by default it is only using English. This will help using NLTK splitter for other languages. Change is simple, via adding language as parameter to NLTKTextSplitter and then passing it to nltk "sent_tokenize". - Issue: N/A - Dependencies: N/A --------- Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com>