112 Commits (36f7fb584824961dc692c9f2354ee8f60c50587b)

Author	SHA1	Message	Date
Jacob Nguyen	b43eec0e2c	fix ts tests on windows (#1342) ... * fix ts tests on windows * fix cleanup * fix tests * hold on c sharp workflows * fix: downloadModel doesnt not mkdirp	1 year ago
Jacob Nguyen	9100b2ef6f	fix continue_config.yml (#1270) ... * fix continue_config.yml Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * fix continue_config.yml Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> --------- Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com>	1 year ago
Jacob Nguyen	545c23b4bd	typescript: fix final bugs and polishing, circle ci documentation (#960) ... * fix: esm and cjs compatibility Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * Update prebuild.js Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * fix gpt4all.js Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * Fix compile for windows and linux again. PLEASE DON'T REVERT THISgit gui! * version bump * polish up spec and build scripts * lock file refresh * fix: proper resource closing and error handling * check make sure libPath not null * add msvc build script and update readme requirements * python workflows in circleci * dummy python change * no need for main * second hold for pypi deploy * let me deploy pls * bring back when condition * Typo, ignore list (#967) Fix typo in javadoc, Add word to ignore list for codespellrc --------- Co-authored-by: felix <felix@zaslavskiy.net> * llmodel: change tokenToString to not use string_view (#968) fixes a definite use-after-free and likely avoids some other potential ones - std::string will convert to a std::string_view automatically but as soon as the std::string in question goes out of scope it is already freed and the string_view is pointing at freed memory - this is *mostly* fine if its returning a reference to the tokenizer's internal vocab table but it's, imo, too easy to return a reference to a dynamically constructed string with this as replit is doing (and unfortunately needs to do to convert the internal whitespace replacement symbol back to a space) * Initial Library Loader for .NET Bindings / Update bindings to support newest changes (#763) * Initial Library Loader * Load library as part of Model factory * Dynamically search and find the dlls * Update tests to use locally built runtimes * Fix dylib loading, add macos runtime support for sample/tests * Bypass automatic loading by default. * Only set CMAKE_OSX_ARCHITECTURES if not already set, allow cross-compile * Switch Loading again * Update build scripts for mac/linux * Update bindings to support newest breaking changes * Fix build * Use llmodel for Windows * Actually, it does need to be libllmodel * Name * Remove TFMs, bypass loading by default * Fix script * Delete mac script --------- Co-authored-by: Tim Miller <innerlogic4321@ghmail.com> * bump llama.cpp mainline to latest (#964) * fix prompt context so it's preserved in class * update setup.py * metal replit (#931) metal+replit makes replit work with Metal and removes its use of `mem_per_token` in favor of fixed size scratch buffers (closer to llama.cpp) * update documentation scripts and generation to include readme.md * update readme and documentation for source * begin tests, import jest, fix listModels export * fix typo * chore: update spec * fix: finally, reduced potential of empty string * chore: add stub for createTokenSream * refactor: protecting resources properly * add basic jest tests * update * update readme * refactor: namespace the res variable * circleci integration to automatically build docs * add starter docs * typo * more circle ci typo * forgot to add nodejs circle ci orb * fix circle ci * feat: @iimez verify download and fix prebuild script * fix: oops, option name wrong * fix: gpt4all utils not emitting docs * chore: fix up scripts * fix: update docs and typings for md5 sum * fix: macos compilation * some refactoring * Update index.cc Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * update readme and enable exceptions on mac * circle ci progress * basic embedding with sbert (not tested & cpp side only) * fix circle ci * fix circle ci * update circle ci script * bruh * fix again * fix * fixed required workflows * fix ci * fix pwd * fix pwd * update ci * revert * fix * prevent rebuild * revmove noop * Update continue_config.yml Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * Update binding.gyp Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * fix fs not found * remove cpp 20 standard * fix warnings, safer way to calculate arrsize * readd build backend * basic embeddings and yarn test" * fix circle ci Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> Update continue_config.yml Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> fix macos paths update readme and roadmap split up spec update readme check for url in modelsjson update docs and inline stuff update yarn configuration and readme update readme readd npm publish script add exceptions bruh one space broke the yaml codespell oops forgot to add runtimes folder bump version try code snippet https://support.circleci.com/hc/en-us/articles/8325075309339-How-to-install-NPM-on-Windows-images add fallback for unknown architectures attached to wrong workspace hopefuly fix moving everything under backend to persist should work now * update circle ci script * prevent rebuild * revmove noop * Update continue_config.yml Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * Update binding.gyp Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * fix fs not found * remove cpp 20 standard * fix warnings, safer way to calculate arrsize * readd build backend * basic embeddings and yarn test" * fix circle ci Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> Update continue_config.yml Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> fix macos paths update readme and roadmap split up spec update readme check for url in modelsjson update docs and inline stuff update yarn configuration and readme update readme readd npm publish script add exceptions bruh one space broke the yaml codespell oops forgot to add runtimes folder bump version try code snippet https://support.circleci.com/hc/en-us/articles/8325075309339-How-to-install-NPM-on-Windows-images add fallback for unknown architectures attached to wrong workspace hopefuly fix moving everything under backend to persist should work now * Update README.md Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> --------- Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> Co-authored-by: Adam Treat <treat.adam@gmail.com> Co-authored-by: Richard Guo <richardg7890@gmail.com> Co-authored-by: Felix Zaslavskiy <felix.zaslavskiy@gmail.com> Co-authored-by: felix <felix@zaslavskiy.net> Co-authored-by: Aaron Miller <apage43@ninjawhale.com> Co-authored-by: Tim Miller <drasticactions@users.noreply.github.com> Co-authored-by: Tim Miller <innerlogic4321@ghmail.com>	1 year ago
Adam Treat	64b409e0b8	keep trying	1 year ago
Adam Treat	e59946f05d	try again to unbreak circleci	1 year ago
Adam Treat	b72b409d40	try again to unbreak circlci	1 year ago
Adam Treat	59cae1132c	Try and unbreak circleci.	1 year ago
mvenditto	b96b6ef38f	pack metal files nuget	1 year ago
mvenditto	4d0201ac33	copy metal kernels for macos	1 year ago
mvenditto	c92c1af697	nuget pack and push	1 year ago
mvenditto	f3b6f49684	fix workspace symlinks on unix, fix persist_workspace on windows and macos runtimes dir	1 year ago
mvenditto	2927d11a28	fix	1 year ago
mvenditto	620ccda696	try fix	1 year ago
mvenditto	cac18c273e	More experiments	1 year ago
mvenditto	4a99e6662a	fix csharp jobs deps	1 year ago
mvenditto	380bbcf18f	fix cmakelist path	1 year ago
mvenditto	0277e8400a	debug ls	1 year ago
mvenditto	9eb50cc115	refine runtimes persist + c# linux build	1 year ago
mvenditto	6d9575e103	copy only needed mingw dlls	1 year ago
mvenditto	113c25e4de	fix win mingw dll path	1 year ago
mvenditto	d107cccf18	msvc dll path fix	1 year ago
mvenditto	51928cd6c3	fix msvc putting file in target dir	1 year ago
mvenditto	99ca80cf1a	change build-bindings-backend when condition	1 year ago
mvenditto	289c96cdf8	remove bad cp	1 year ago
mvenditto	f4a0fc6cef	add holds	1 year ago
mvenditto	ddd087dadb	fix wrong cmake arg in macos job	1 year ago
mvenditto	2e131053e8	fix missing cmake in win msvc job	1 year ago
mvenditto	11ac85b01f	add needed sudo in ubuntu machine scenario	1 year ago
mvenditto	021a388b38	typo again, should sleep	1 year ago
mvenditto	cd3bfea09b	fix filters	1 year ago
mvenditto	fec2fd2832	try to fix error	1 year ago
mvenditto	3c126ffa03	typo	1 year ago
mvenditto	ec9148f52c	further tests	1 year ago
mvenditto	422aecc5ba	revert some bad changes	1 year ago
mvenditto	d151beb8bf	fix	1 year ago
mvenditto	4697b968a8	better restore cache + some experimentation	1 year ago
mvenditto	7e92f9c401	macos again	1 year ago
mvenditto	ddf124bb76	fix dotnet install version on macos	1 year ago
mvenditto	d9fab97e83	remove --no-build from test	1 year ago
mvenditto	6e044e1a89	add --nologo to suppress welcome message + cleanup	1 year ago
mvenditto	a2d59b09e5	try fix nuget cache issue on win and macos dotnet tool path	1 year ago
mvenditto	7805492c4f	try fix dotnet tools path on osx + bugfix	1 year ago
mvenditto	54efa75c7d	try bump sdk to 7	1 year ago
mvenditto	3853560a44	fix	1 year ago
mvenditto	c3aafc81d9	debug	1 year ago
mvenditto	5dcfdc192b	try an alternative build on macos	1 year ago
mvenditto	2f59332f9a	try to fix weird build errors an macos	1 year ago
mvenditto	95651809b3	try to fix dotnet install on macos	1 year ago
mvenditto	3ef1cbef90	revert	1 year ago
mvenditto	79767148e0	macos try to install dotnet with brew	1 year ago