Piyush Jain
8eea46ed0e
Bedrock embeddings async methods ( #9024 )
...
## Description
This PR adds the `aembed_query` and `aembed_documents` async methods for
improving the embeddings generation for large documents. The
implementation uses asyncio tasks and gather to achieve concurrency as
there is no bedrock async API in boto3.
### Maintainers
@agola11
@aarora79
### Open questions
To avoid throttling from the Bedrock API, should there be an option to
limit the concurrency of the calls?
2023-08-10 14:21:03 -07:00
..
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-24 21:20:32 -07:00
2023-07-31 16:26:25 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-08-10 14:21:03 -07:00
2023-07-23 23:23:16 -07:00
2023-07-24 15:46:02 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-08-03 10:24:51 -07:00
2023-08-04 10:32:22 -07:00
2023-07-23 23:23:16 -07:00
2023-07-31 17:15:04 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-29 08:44:32 -07:00
2023-07-23 23:23:16 -07:00
2023-08-04 14:19:43 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-27 22:53:23 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-26 12:38:58 -07:00
2023-08-07 21:19:22 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-27 18:01:04 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-29 08:44:32 -07:00
2023-07-24 17:34:13 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-07-23 23:23:16 -07:00
2023-08-08 10:04:43 -07:00
2023-07-23 23:23:16 -07:00
2023-08-10 10:56:06 -07:00
2023-07-23 23:23:16 -07:00
2023-08-07 07:32:02 -07:00
2023-07-23 23:23:16 -07:00
2023-07-27 21:23:19 -07:00