justheuristic a2634001e9 Reduce vocabulary size in test model, fix bug in routing when overlapped (#45) ... This PR reduces this vocabulary size to save memory during conversion, keeping only the first 50k tokens As a result, * tests that load client-side embeddings need significantly less RAM * we can now run CI tests with 4 servers instead of 2 - needed to test routing - see bugs uncovered * some of the servers now use load balancing * CI convert_model now takes 4-5 minutes (was 6-7)		2022-08-17 18:50:52 +03:00
..
remove_old_models.py	Reduce vocabulary size in test model, fix bug in routing when overlapped (#45)	2022-08-17 18:50:52 +03:00