somebody 5f4216730e Make logit bias work correctly(?) when prob is -inf ...

samplers'll do that to you

though now i am curious: what kind of effect would running the bias
before the samplers have? maybe a future option

2023-07-21 18:33:35 -05:00

..

inference_models

Make logit bias work correctly(?) when prob is -inf

2023-07-21 18:33:35 -05:00

inference_model.py

Fix for default inference model is_valid and requested_parameters having vram as a required parameter.

2023-07-15 11:11:29 -04:00

lazy_loader.py

Fall back to unpatched HF

2023-07-08 14:36:45 -05:00

logits_processors.py

Make logit bias work correctly(?) when prob is -inf

2023-07-21 18:33:35 -05:00

patches.py

Patches: Make lazyload work on quantized

2023-07-17 16:47:31 -05:00

post_token_hooks.py

Model: Respect model lazyload over kaivars

2023-03-10 20:00:39 -06:00

stoppers.py

Potential fix

2023-04-27 19:51:10 -05:00

test_generation.py

Model: More Jax import fixes and formatting

2023-03-17 15:36:44 -05:00

tokenizer.py

Fix tokenizer fallback for llama

2023-05-01 19:42:52 -05:00

warpers.py

Fix for --nobreakmodel forcing CPU

2023-06-02 12:58:59 -04:00