Adam Treat
cf4eb530ce
Sync to a newer version of llama.cpp with bugfix for vulkan.
2023-09-13 21:01:44 -04:00
Adam Treat
21a3244645
Fix a bug where we're not properly falling back to CPU.
2023-09-13 19:30:27 -04:00
Adam Treat
0458c9b4e6
Add version 2.4.15 and bump the version number.
2023-09-13 17:55:50 -04:00
Adam Treat
4b9a345aee
Update the submodule.
2023-09-13 17:05:46 -04:00
Aaron Miller
6f038c136b
init at most one vulkan device, submodule update
...
fixes issues w/ multiple of the same gpu
2023-09-13 12:49:53 -07:00
Adam Treat
86e862df7e
Fix up the name and formatting.
2023-09-13 15:48:55 -04:00
Adam Treat
358ff2a477
Show the device we're currently using.
2023-09-13 15:24:33 -04:00
Adam Treat
891ddafc33
When device is Auto (the default) then we will only consider discrete GPU's otherwise fallback to CPU.
2023-09-13 11:59:36 -04:00
Adam Treat
8f99dca70f
Bring the vulkan backend to the GUI.
2023-09-13 11:26:10 -04:00
Aaron Miller
f0735efa7d
vulkan python bindings on windows fixes
2023-09-12 14:16:02 -07:00
Adam Treat
c953b321b7
Don't link against libvulkan.
2023-09-12 14:26:56 -04:00
Aaron Miller
0ad1472b62
bump python version (library linking fix)
2023-09-11 09:42:06 -07:00
Aaron Miller
c4d23512e4
remove extra dynamic linker deps when building with vulkan
2023-09-11 08:44:39 -07:00
Andriy Mulyar
b6e38d69ed
Python version bump
...
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-09-01 13:21:41 -04:00
Andriy Mulyar
707b91a24f
Update Python bindings README.md ( #1389 )
...
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-09-01 13:01:40 -04:00
Adam Treat
a69d23ecc4
Fix for windows circleci
2023-08-31 15:29:54 -04:00
Adam Treat
b9fd0c25b2
Try and fix the rest of circleci for vulkan.
2023-08-31 15:29:54 -04:00
Adam Treat
85e34598f9
more circleci
2023-08-31 15:29:54 -04:00
Adam Treat
9f1cbad4f1
more Circleci
2023-08-31 15:29:54 -04:00
Adam Treat
202805637b
More circleci
2023-08-31 15:29:54 -04:00
Adam Treat
2832fad965
More circleci
2023-08-31 15:29:54 -04:00
Adam Treat
6a309e2ac8
More circleci
2023-08-31 15:29:54 -04:00
Adam Treat
94969a4199
More circleci
2023-08-31 15:29:54 -04:00
Adam Treat
1a2a9791bd
More circleci
2023-08-31 15:29:54 -04:00
Adam Treat
8d80f7963e
More circleci
2023-08-31 15:29:54 -04:00
Adam Treat
1723f82aaa
More circleci
2023-08-31 15:29:54 -04:00
Adam Treat
3bdc87ff4a
More circleci
2023-08-31 15:29:54 -04:00
Adam Treat
5e5a235639
More circleci
2023-08-31 15:29:54 -04:00
Adam Treat
4521c71b4e
More circleci
2023-08-31 15:29:54 -04:00
Adam Treat
2f1c995739
More circleci
2023-08-31 15:29:54 -04:00
Adam Treat
84e08858a8
Fix missing run in circleci
2023-08-31 15:29:54 -04:00
Adam Treat
6fd6369ab3
Fix yaml parsing
2023-08-31 15:29:54 -04:00
Adam Treat
54bc61e280
Make it work on gpt4all-backend linux circleci too.
2023-08-31 15:29:54 -04:00
Adam Treat
320eda9685
Get VulkanSDK installed on linux circleci.
2023-08-31 15:29:54 -04:00
Adam Treat
f578fa6cdf
Fix for windows.
2023-08-31 15:29:54 -04:00
Adam Treat
17d3e4976c
Add a comment indicating future work.
2023-08-31 15:29:54 -04:00
Adam Treat
7ec522dfb0
Lower case the som.
2023-08-31 15:29:54 -04:00
Adam Treat
7ae6bfc928
Add SOM to codespell ignore list.
2023-08-31 15:29:54 -04:00
Adam Treat
987546c63b
Nomic vulkan backend licensed under the Software for Open Models License (SOM), version 1.0.
2023-08-31 15:29:54 -04:00
Adam Treat
d55cbbee32
Update to newer llama.cpp and disable older forks.
2023-08-31 15:29:54 -04:00
Aaron Miller
0bc2274869
bump llama.cpp version + needed fixes for that
2023-08-31 15:29:54 -04:00
aaron miller
33c22be2aa
starcoder: use ggml_graph_plan
2023-08-31 15:29:54 -04:00
Bob van Luijt
27a8b020c3
Add Weaviate integration ( #1368 )
...
* Add Weaviate integration
Signed-off-by: Bob van Luijt <bob@weaviate.io>
* Created integrations section
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
---------
Signed-off-by: Bob van Luijt <bob@weaviate.io>
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
Co-authored-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-08-23 16:53:30 -04:00
Andriy Mulyar
36f7fb5848
Update README.md with download statistics
...
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-08-17 16:56:28 -04:00
Jacob Nguyen
b43eec0e2c
fix ts tests on windows ( #1342 )
...
* fix ts tests on windows
* fix cleanup
* fix tests
* hold on c sharp workflows
* fix: downloadModel doesnt not mkdirp
2023-08-17 10:32:08 -04:00
Adam Treat
a63093554f
Remove older models that rely upon soon to be no longer supported quantization formats.
2023-08-15 13:19:41 -04:00
Andriy Mulyar
a9668eb2e4
Added optional top_p and top_k
2023-08-15 12:06:49 -04:00
Adam Treat
2c0ee50dce
Add starcoder 7b.
2023-08-15 09:27:55 -04:00
Jacob Nguyen
4e55940edf
feat(typescript)/dynamic template ( #1287 ) ( #1326 )
...
* feat(typescript)/dynamic template (#1287 )
* remove packaged yarn
* prompt templates update wip
* prompt template update
* system prompt template, update types, remove embed promises, cleanup
* support both snakecased and camelcased prompt context
* fix #1277 libbert, libfalcon and libreplit libs not being moved into the right folder after build
* added support for modelConfigFile param, allowing the user to specify a local file instead of downloading the remote models.json. added a warning message if code fails to load a model config. included prompt context docs by amogus.
* snakecase warning, put logic for loading local models.json into listModels, added constant for the default remote model list url, test improvements, simpler hasOwnProperty call
* add DEFAULT_PROMPT_CONTEXT, export new constants
* add md5sum testcase and fix constants export
* update types
* throw if attempting to list models without a source
* rebuild docs
* fix download logging undefined url, toFixed typo, pass config filesize in for future progress report
* added overload with union types
* bump to 2.2.0, remove alpha
* code speling
---------
Co-authored-by: Andreas Obersteiner <8959303+iimez@users.noreply.github.com>
2023-08-14 12:45:45 -04:00
Elin Angelov
4d855afe97
Update README.md ( #1260 )
...
* Update README.md
Signed-off-by: Elin Angelov <me@zetxx.eu>
* Update README.md
Signed-off-by: Elin Angelov <me@zetxx.eu>
* Update README.md
Signed-off-by: Elin Angelov <me@zetxx.eu>
* Changed wording a tiny bit again
Signed-off-by: niansa/tuxifan <tuxifan@posteo.de>
* Added missing space
Signed-off-by: niansa/tuxifan <tuxifan@posteo.de>
---------
Signed-off-by: Elin Angelov <me@zetxx.eu>
Signed-off-by: niansa/tuxifan <tuxifan@posteo.de>
Co-authored-by: niansa/tuxifan <tuxifan@posteo.de>
2023-08-11 14:14:53 -04:00
