Commit Graph

112 Commits (fd3014016bae92d45680f49067262a9d2b1a5a04)

Author SHA1 Message Date
Aaron Miller 7f979c8258 Build offline installers in CircleCI 10 months ago
Aaron Miller f0735efa7d vulkan python bindings on windows fixes 10 months ago
Adam Treat a69d23ecc4 Fix for windows circleci 10 months ago
Adam Treat b9fd0c25b2 Try and fix the rest of circleci for vulkan. 10 months ago
Adam Treat 85e34598f9 more circleci 10 months ago
Adam Treat 9f1cbad4f1 more Circleci 10 months ago
Adam Treat 202805637b More circleci 10 months ago
Adam Treat 2832fad965 More circleci 10 months ago
Adam Treat 6a309e2ac8 More circleci 10 months ago
Adam Treat 94969a4199 More circleci 10 months ago
Adam Treat 1a2a9791bd More circleci 10 months ago
Adam Treat 8d80f7963e More circleci 10 months ago
Adam Treat 1723f82aaa More circleci 10 months ago
Adam Treat 3bdc87ff4a More circleci 10 months ago
Adam Treat 5e5a235639 More circleci 10 months ago
Adam Treat 4521c71b4e More circleci 10 months ago
Adam Treat 2f1c995739 More circleci 10 months ago
Adam Treat 84e08858a8 Fix missing run in circleci 10 months ago
Adam Treat 6fd6369ab3 Fix yaml parsing 10 months ago
Adam Treat 54bc61e280 Make it work on gpt4all-backend linux circleci too. 10 months ago
Adam Treat 320eda9685 Get VulkanSDK installed on linux circleci. 10 months ago
Jacob Nguyen b43eec0e2c
fix ts tests on windows (#1342)
* fix ts tests on windows

* fix cleanup

* fix tests

* hold on c sharp workflows

* fix: downloadModel doesnt not mkdirp
11 months ago
Jacob Nguyen 9100b2ef6f
fix continue_config.yml (#1270)
* fix continue_config.yml

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>

* fix continue_config.yml

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>

---------

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>
12 months ago
Jacob Nguyen 545c23b4bd
typescript: fix final bugs and polishing, circle ci documentation (#960)
* fix: esm and cjs compatibility

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>

* Update prebuild.js

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>

* fix gpt4all.js

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>

* Fix compile for windows and linux again. PLEASE DON'T REVERT THISgit gui!

* version bump

* polish up spec and build scripts

* lock file refresh

* fix: proper resource closing and error handling

* check make sure libPath not null

* add msvc build script and update readme requirements

* python workflows in circleci

* dummy python change

* no need for main

* second hold for pypi deploy

* let me deploy pls

* bring back when condition

* Typo, ignore list  (#967)

Fix typo in javadoc,
Add word to ignore list for codespellrc

---------

Co-authored-by: felix <felix@zaslavskiy.net>

* llmodel: change tokenToString to not use string_view (#968)

fixes a definite use-after-free and likely avoids some other
potential ones - std::string will convert to a std::string_view
automatically but as soon as the std::string in question goes out of
scope it is already freed and the string_view is pointing at freed
memory - this is *mostly* fine if its returning a reference to the
tokenizer's internal vocab table but it's, imo, too easy to return a
reference to a dynamically constructed string with this as replit is
doing (and unfortunately needs to do to convert the internal whitespace
replacement symbol back to a space)

* Initial Library Loader for .NET Bindings / Update bindings to support newest changes (#763)

* Initial Library Loader

* Load library as part of Model factory

* Dynamically search and find the dlls

* Update tests to use locally built runtimes

* Fix dylib loading, add macos runtime support for sample/tests

* Bypass automatic loading by default.

* Only set CMAKE_OSX_ARCHITECTURES if not already set, allow cross-compile

* Switch Loading again

* Update build scripts for mac/linux

* Update bindings to support newest breaking changes

* Fix build

* Use llmodel for Windows

* Actually, it does need to be libllmodel

* Name

* Remove TFMs, bypass loading by default

* Fix script

* Delete mac script

---------

Co-authored-by: Tim Miller <innerlogic4321@ghmail.com>

* bump llama.cpp mainline to latest (#964)

* fix prompt context so it's preserved in class

* update setup.py

* metal replit (#931)

metal+replit

makes replit work with Metal and removes its use of `mem_per_token`
in favor of fixed size scratch buffers (closer to llama.cpp)

* update documentation scripts and generation to include readme.md

* update readme and documentation for source

* begin tests, import jest, fix listModels export

* fix typo

* chore: update spec

* fix: finally, reduced potential of empty string

* chore: add stub for createTokenSream

* refactor: protecting resources properly

* add basic jest tests

* update

* update readme

* refactor: namespace the res variable

* circleci integration to automatically build docs

* add starter docs

* typo

* more circle ci typo

* forgot to add nodejs circle ci orb

* fix circle ci

* feat: @iimez verify download and fix prebuild script

* fix: oops, option name wrong

* fix: gpt4all utils not emitting docs

* chore: fix up scripts

* fix: update docs and typings for md5 sum

* fix: macos compilation

* some refactoring

* Update index.cc

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>

* update readme and enable exceptions on mac

* circle ci progress

* basic embedding with sbert (not tested & cpp side only)

* fix circle ci

* fix circle ci

* update circle ci script

* bruh

* fix again

* fix

* fixed required workflows

* fix ci

* fix pwd

* fix pwd

* update ci

* revert

* fix

* prevent rebuild

* revmove noop

* Update continue_config.yml

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>

* Update binding.gyp

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>

* fix fs not found

* remove cpp 20 standard

* fix warnings, safer way to calculate arrsize

* readd build backend

* basic embeddings and yarn test"

* fix circle ci

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>

Update continue_config.yml

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>

fix macos paths

update readme and roadmap

split up spec

update readme

check for url in modelsjson

update docs and inline stuff

update yarn configuration and readme

update readme

readd npm publish script

add exceptions

bruh one space broke the yaml

codespell

oops forgot to add runtimes folder

bump version

try code snippet https://support.circleci.com/hc/en-us/articles/8325075309339-How-to-install-NPM-on-Windows-images

add fallback for unknown architectures

attached to wrong workspace

hopefuly fix

moving everything under backend to persist

should work now

* update circle ci script

* prevent rebuild

* revmove noop

* Update continue_config.yml

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>

* Update binding.gyp

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>

* fix fs not found

* remove cpp 20 standard

* fix warnings, safer way to calculate arrsize

* readd build backend

* basic embeddings and yarn test"

* fix circle ci

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>

Update continue_config.yml

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>

fix macos paths

update readme and roadmap

split up spec

update readme

check for url in modelsjson

update docs and inline stuff

update yarn configuration and readme

update readme

readd npm publish script

add exceptions

bruh one space broke the yaml

codespell

oops forgot to add runtimes folder

bump version

try code snippet https://support.circleci.com/hc/en-us/articles/8325075309339-How-to-install-NPM-on-Windows-images

add fallback for unknown architectures

attached to wrong workspace

hopefuly fix

moving everything under backend to persist

should work now

* Update README.md

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>

---------

Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>
Co-authored-by: Adam Treat <treat.adam@gmail.com>
Co-authored-by: Richard Guo <richardg7890@gmail.com>
Co-authored-by: Felix Zaslavskiy <felix.zaslavskiy@gmail.com>
Co-authored-by: felix <felix@zaslavskiy.net>
Co-authored-by: Aaron Miller <apage43@ninjawhale.com>
Co-authored-by: Tim Miller <drasticactions@users.noreply.github.com>
Co-authored-by: Tim Miller <innerlogic4321@ghmail.com>
12 months ago
Adam Treat 64b409e0b8 keep trying 1 year ago
Adam Treat e59946f05d try again to unbreak circleci 1 year ago
Adam Treat b72b409d40 try again to unbreak circlci 1 year ago
Adam Treat 59cae1132c Try and unbreak circleci. 1 year ago
mvenditto b96b6ef38f pack metal files nuget 1 year ago
mvenditto 4d0201ac33 copy metal kernels for macos 1 year ago
mvenditto c92c1af697 nuget pack and push 1 year ago
mvenditto f3b6f49684 fix workspace symlinks on unix, fix persist_workspace on windows and macos runtimes dir 1 year ago
mvenditto 2927d11a28 fix 1 year ago
mvenditto 620ccda696 try fix 1 year ago
mvenditto cac18c273e More experiments 1 year ago
mvenditto 4a99e6662a fix csharp jobs deps 1 year ago
mvenditto 380bbcf18f fix cmakelist path 1 year ago
mvenditto 0277e8400a debug ls 1 year ago
mvenditto 9eb50cc115 refine runtimes persist + c# linux build 1 year ago
mvenditto 6d9575e103 copy only needed mingw dlls 1 year ago
mvenditto 113c25e4de fix win mingw dll path 1 year ago
mvenditto d107cccf18 msvc dll path fix 1 year ago
mvenditto 51928cd6c3 fix msvc putting file in target dir 1 year ago
mvenditto 99ca80cf1a change build-bindings-backend when condition 1 year ago
mvenditto 289c96cdf8 remove bad cp 1 year ago
mvenditto f4a0fc6cef add holds 1 year ago
mvenditto ddd087dadb fix wrong cmake arg in macos job 1 year ago
mvenditto 2e131053e8 fix missing cmake in win msvc job 1 year ago
mvenditto 11ac85b01f add needed sudo in ubuntu machine scenario 1 year ago
mvenditto 021a388b38 typo again, should sleep 1 year ago