Commit Graph

15 Commits

Author SHA1 Message Date
Adam Treat
69f92d8ea8 Load models from filepath only. 2023-04-28 20:15:10 -04:00
Adam Treat
d982dc0529 Update to latest llama.cpp 2023-04-28 11:03:16 -04:00
Adam Treat
5a7d40f604 Move the saving of the tokens to the impl and not the callbacks responsibility. 2023-04-27 11:16:51 -04:00
Adam Treat
ba4b28fcd5 Move the promptCallback to own function. 2023-04-27 11:08:15 -04:00
Adam Treat
0e9f85bcda Provide an initial impl. of the C interface. NOTE: has not been tested. 2023-04-27 09:43:24 -04:00
Adam Treat
b19d2f2c21 Add this and unbreak the build. 2023-04-26 22:45:10 -04:00
Adam Treat
ee5c58c26c Initial support for opt-in telemetry. 2023-04-26 22:05:56 -04:00
Adam Treat
a3d97fa009 Don't crash when prompt is too large. 2023-04-26 19:08:37 -04:00
Adam Treat
7da3bc07cc Update llama.cpp submodule to latest. 2023-04-26 11:50:05 -04:00
Adam Treat
fd0f92a94e Clean up the docs a bit more still. 2023-04-26 08:22:38 -04:00
Adam Treat
c89096ccb4 Clean up the docs a bit more. 2023-04-26 08:22:38 -04:00
Adam Treat
ac7ecd2cef Clean up the docs a bit. 2023-04-26 08:22:38 -04:00
Adam Treat
832b5d1a96 Only need one opaque pointer. 2023-04-26 08:22:38 -04:00
Adam Treat
102f68b18c Fixup the api a bit. 2023-04-26 08:22:38 -04:00
Adam Treat
3c9139b5d2 Move the backend code into own subdirectory and make it a shared library. Begin fleshing out the C api wrapper that bindings can use. 2023-04-26 08:22:38 -04:00