Adam Treat
|
3076e0bf26
|
Only show GPU when we're actually using it.
|
2023-09-14 09:59:19 -04:00 |
|
Adam Treat
|
1fa67a585c
|
Report the actual device we're using.
|
2023-09-14 08:25:37 -04:00 |
|
Adam Treat
|
cf4eb530ce
|
Sync to a newer version of llama.cpp with bugfix for vulkan.
|
2023-09-13 21:01:44 -04:00 |
|
Adam Treat
|
21a3244645
|
Fix a bug where we're not properly falling back to CPU.
|
2023-09-13 19:30:27 -04:00 |
|
Adam Treat
|
0458c9b4e6
|
Add version 2.4.15 and bump the version number.
|
2023-09-13 17:55:50 -04:00 |
|
Adam Treat
|
4b9a345aee
|
Update the submodule.
|
2023-09-13 17:05:46 -04:00 |
|
Aaron Miller
|
6f038c136b
|
init at most one vulkan device, submodule update
fixes issues w/ multiple of the same gpu
|
2023-09-13 12:49:53 -07:00 |
|
Adam Treat
|
86e862df7e
|
Fix up the name and formatting.
|
2023-09-13 15:48:55 -04:00 |
|
Adam Treat
|
358ff2a477
|
Show the device we're currently using.
|
2023-09-13 15:24:33 -04:00 |
|
Adam Treat
|
891ddafc33
|
When device is Auto (the default) then we will only consider discrete GPU's otherwise fallback to CPU.
|
2023-09-13 11:59:36 -04:00 |
|
Adam Treat
|
8f99dca70f
|
Bring the vulkan backend to the GUI.
|
2023-09-13 11:26:10 -04:00 |
|
Aaron Miller
|
f0735efa7d
|
vulkan python bindings on windows fixes
|
2023-09-12 14:16:02 -07:00 |
|
Adam Treat
|
c953b321b7
|
Don't link against libvulkan.
|
2023-09-12 14:26:56 -04:00 |
|
Aaron Miller
|
0ad1472b62
|
bump python version (library linking fix)
|
2023-09-11 09:42:06 -07:00 |
|
Aaron Miller
|
c4d23512e4
|
remove extra dynamic linker deps when building with vulkan
|
2023-09-11 08:44:39 -07:00 |
|
Andriy Mulyar
|
b6e38d69ed
|
Python version bump
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
|
2023-09-01 13:21:41 -04:00 |
|
Andriy Mulyar
|
707b91a24f
|
Update Python bindings README.md (#1389)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
|
2023-09-01 13:01:40 -04:00 |
|
Adam Treat
|
a69d23ecc4
|
Fix for windows circleci
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
b9fd0c25b2
|
Try and fix the rest of circleci for vulkan.
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
85e34598f9
|
more circleci
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
9f1cbad4f1
|
more Circleci
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
202805637b
|
More circleci
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
2832fad965
|
More circleci
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
6a309e2ac8
|
More circleci
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
94969a4199
|
More circleci
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
1a2a9791bd
|
More circleci
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
8d80f7963e
|
More circleci
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
1723f82aaa
|
More circleci
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
3bdc87ff4a
|
More circleci
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
5e5a235639
|
More circleci
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
4521c71b4e
|
More circleci
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
2f1c995739
|
More circleci
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
84e08858a8
|
Fix missing run in circleci
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
6fd6369ab3
|
Fix yaml parsing
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
54bc61e280
|
Make it work on gpt4all-backend linux circleci too.
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
320eda9685
|
Get VulkanSDK installed on linux circleci.
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
f578fa6cdf
|
Fix for windows.
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
17d3e4976c
|
Add a comment indicating future work.
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
7ec522dfb0
|
Lower case the som.
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
7ae6bfc928
|
Add SOM to codespell ignore list.
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
987546c63b
|
Nomic vulkan backend licensed under the Software for Open Models License (SOM), version 1.0.
|
2023-08-31 15:29:54 -04:00 |
|
Adam Treat
|
d55cbbee32
|
Update to newer llama.cpp and disable older forks.
|
2023-08-31 15:29:54 -04:00 |
|
Aaron Miller
|
0bc2274869
|
bump llama.cpp version + needed fixes for that
|
2023-08-31 15:29:54 -04:00 |
|
aaron miller
|
33c22be2aa
|
starcoder: use ggml_graph_plan
|
2023-08-31 15:29:54 -04:00 |
|
Bob van Luijt
|
27a8b020c3
|
Add Weaviate integration (#1368)
* Add Weaviate integration
Signed-off-by: Bob van Luijt <bob@weaviate.io>
* Created integrations section
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
---------
Signed-off-by: Bob van Luijt <bob@weaviate.io>
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
Co-authored-by: Andriy Mulyar <andriy.mulyar@gmail.com>
|
2023-08-23 16:53:30 -04:00 |
|
Andriy Mulyar
|
36f7fb5848
|
Update README.md with download statistics
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
|
2023-08-17 16:56:28 -04:00 |
|
Jacob Nguyen
|
b43eec0e2c
|
fix ts tests on windows (#1342)
* fix ts tests on windows
* fix cleanup
* fix tests
* hold on c sharp workflows
* fix: downloadModel doesnt not mkdirp
|
2023-08-17 10:32:08 -04:00 |
|
Adam Treat
|
a63093554f
|
Remove older models that rely upon soon to be no longer supported quantization formats.
|
2023-08-15 13:19:41 -04:00 |
|
Andriy Mulyar
|
a9668eb2e4
|
Added optional top_p and top_k
|
2023-08-15 12:06:49 -04:00 |
|
Adam Treat
|
2c0ee50dce
|
Add starcoder 7b.
|
2023-08-15 09:27:55 -04:00 |
|