Vashisht Madhavan aa439ac2ff Adding an in-context QA evaluation chain + chain of thought reasoning chain for improved accuracy (#2444) ...

Right now, eval chains require an answer for every question. It's
cumbersome to collect this ground truth so getting around this issue
with 2 things:

* Adding a context param in `ContextQAEvalChain` and simply evaluating
if the question is answered accurately from context
* Adding chain of though explanation prompting to improve the accuracy
of this w/o GT.

This also gets to feature parity with openai/evals which has the same
contextual eval w/o GT.

TODO in follow-up:
* Better prompt inheritance. No need for seperate prompt for CoT
reasoning. How can we merge them together

---------

Co-authored-by: Vashisht Madhavan <vashishtmadhavan@Vashs-MacBook-Pro.local>

2023-04-06 22:32:41 -07:00

..

_static

Harrison/apify (#2215)

2023-03-30 20:58:14 -07:00

ecosystem

Add support for rwkv (#2422)

2023-04-06 14:41:06 -07:00

getting_started

bump version to 131 (#2391)

2023-04-04 07:21:50 -07:00

modules

Harrison/weaviate retriever (#2524)

2023-04-06 22:27:37 -07:00

reference

Harrison/llama (#2314)

2023-04-02 14:57:45 -07:00

tracing

bump version to 131 (#2391)

2023-04-04 07:21:50 -07:00

use_cases

Adding an in-context QA evaluation chain + chain of thought reasoning chain for improved accuracy (#2444)

2023-04-06 22:32:41 -07:00

conf.py

Corrects copyright year (#1762)

2023-03-18 19:55:05 -07:00

deployments.md

docs(deployment): add langchain-serve (#2006)

2023-03-27 23:32:04 -07:00

ecosystem.rst

Docs refactor (#480)

2023-01-02 08:24:09 -08:00

gallery.rst

docs: update gpt index references to LlamaIndex (#1856)

2023-03-21 22:01:05 -07:00

glossary.md

big docs refactor (#1978)

2023-03-26 19:49:46 -07:00

index.rst

small nit on index page (#2018)

2023-03-27 00:15:24 -04:00

make.bat

initial commit

2022-10-24 14:51:15 -07:00

Makefile

Feature: linkcheck-action (#534) (#542)

2023-01-04 21:39:50 -08:00

model_laboratory.ipynb

big docs refactor (#1978)

2023-03-26 19:49:46 -07:00

reference.rst

Feature: linkcheck-action (#534) (#542)

2023-01-04 21:39:50 -08:00

requirements.txt

Harrison/docs reqs (#2199)

2023-03-30 08:20:30 -07:00

tracing.md

Harrison/tracing docs (#806)

2023-01-29 20:49:35 -08:00