5 Commits

Author	SHA1	Message	Date
somebody	8d0bc404a5	Model: More Jax import fixes and formatting	2023-03-17 15:36:44 -05:00
somebody	b93c339145	Model: Lazyload backends	2023-03-13 20:29:29 -05:00
somebody	0320678b27	Model: WIP horde and API tests	2023-03-13 14:11:06 -05:00
somebody	cd8ccf0a5e	Modeling: Add seed parameter to raw_generate ... Yahooo, decoupling from koboldai_vars. This makes the generation test pass in `test_generation.py`, and makes full determinism outside of core_generate work.	2023-03-12 21:49:10 -05:00
somebody	8937e7f6df	Model: Add basic tests ... We now do some basic tests for: - hf torch loading (normal, lazy, lowmem) - hf torch generation (shape batches, shape tokencount, faulty determinism) Currently full determinism is failing; yahoo, the tests work! All of the tests initally failed (note the test environment functions different from the aiserver environment due to aiserver doing a lot of initalizing stuff, working on phasing that out) but now only one fails. Very useful for finding bugs!	2023-03-10 20:00:39 -06:00