Commit Graph

3 Commits (d018b4c8219fcd23dfa44ccf6fb4e74f4d855eb2)

Author SHA1 Message Date
cosmic-snow b66d0b4fff
Fix CLI app.py (#910)
- the bindings API changed in 057b9, but the CLI was not updated
- change 'std_passthrough' param to the renamed 'streaming'
- remove '_cli_override_response_callback' as it breaks and is no longer needed
- bump version to 0.3.4
1 year ago
Konstantin Gukov 100c809f1e Do not ignore explicitly passed 4 threads 1 year ago
drbh d4861030b7
adds a simple cli chat repl (#566)
* adds a simple cli chat repl

* add n thread support and append assistant response
1 year ago