Ettore Di Giacinto ae28568e2a Add embeddings for LocalAI (#8134) ... Description: This PR adds embeddings for LocalAI ( https://github.com/go-skynet/LocalAI ), a self-hosted OpenAI drop-in replacement. As LocalAI can re-use OpenAI clients it is mostly following the lines of the OpenAI embeddings, however when embedding documents, it just uses string instead of sending tokens as sending tokens is best-effort depending on the model being used in LocalAI. Sending tokens is also tricky as token id's can mismatch with the model - so it's safer to just send strings in this case. Partly related to: https://github.com/hwchase17/langchain/issues/5256 Dependencies: No new dependencies Twitter: @mudler_it --------- Signed-off-by: mudler <mudler@localai.io> Co-authored-by: Bagatur <baskaryan@gmail.com>		2023-07-24 12:16:49 -07:00
..
experimental	bump lc241 exp3 (#8193)	2023-07-24 11:52:44 -07:00
langchain	Add embeddings for LocalAI (#8134)	2023-07-24 12:16:49 -07:00