28 Commits (6562cf0e16114bd96be72c2e89264c4de4f8dec9)
 

Author SHA1 Message Date
Atinoda 6562cf0e16 Update config directories and compose example
Add `characters` directory to config
Remove softprompts from compose
11 months ago
Atinoda b6b1ca1391 Implement per-extension initialisation
(Plansee)
11 months ago
Atinoda 4c24344796 Remove ExLlama manual installation (no longer required) 11 months ago
Atinoda ef85657f3c
Implement Nightly builds as Github workflow (#10) 11 months ago
Atinoda 5b6477ddf3 Move nightly builds to dedicated branch 11 months ago
Atinoda b9d7caffdf
Update docker-nightly.yml 11 months ago
Atinoda f4638e1bd2
Create docker-nightly.yml 11 months ago
Atinoda d8fcbd7ca3
Fix example standalone run commands
Credit to @sdizen in #7 connection refused issue - thanks for sharing the fix!
11 months ago
Atinoda 84c1bbe883 Integrate `llama-cublas` into base image
- Update README.md with deprecation warnings and improved descriptions.
- Fix the build error in the latest `llama-cpp-python` version by removing CMAKE directives.
12 months ago
Atinoda ff496b6929 Integrate ExLlama in base image
Closes #6
12 months ago
Atinoda ee3f779157
Update README.md 12 months ago
Atinoda 56f068d4e8 Disable extensions folder mapping by default 12 months ago
Atinoda 068bea0948 Minor update README.me 12 months ago
Atinoda 19f9c1b1ac Implement persistent extensions with optional runtime build
- Extensions are now explicitly copied from source to named volume
- Optional rebuild at runtime allows for extensions not present during build
- Closes #3
12 months ago
Atinoda 7caaaa4a7c Update to upstream changes
- AutoGPTQ manual installation removed (it is included in requirements)
- Softprompt config removed
- Build date print-out added to `docker-entrypoint.sh`
- `README.md` updated
1 year ago
Atinoda 524dad64c9 Fix `api` set up hint in README.md 1 year ago
Atinoda a0137d40b8 Refactor to pull Docker hub images
Also fixes `triton` dependency conflict
1 year ago
Atinoda b29d617880 Fix `cuda` variant dependency conflict
This variant will be pruned at a later date if the upstream author does not continue development on the branch.
1 year ago
Atinoda 1f409aefcd Update README.md
Shoutout to PanQiWei.
1 year ago
Atinoda eafec5449a Update README.md 1 year ago
Atinoda a75df0d7ae Integrate AutoGPTQ into base image 1 year ago
Atinoda 19133da4a7 Add disclaimer 1 year ago
Atinoda f00296f970
PR: Instruct git to preserve .sh line endings
Instruct git to preserve .sh line endings
1 year ago
Atinoda e048102bfd Instruct git to preserve .sh line endings 1 year ago
Atinoda 14a3bd3138 Implement `monkey-patch` variant 1 year ago
Atinoda 1cfe526bb9 Improve config directory handling 1 year ago
Atinoda dd8dab6fb9 Implement llama-cpp with CUBLAS
Also switch to devel image for deployment - it will be more flexible for variant builds.
1 year ago
Atinoda bd884491e4 Initial commit 1 year ago