Upload 81 files
"No model.safetensors.index.json found in remote" - fixed looks like that hadn't gotten pushed last night.
I must have overwritten my model weights after testing. The assertion and the hidden states errors' are from transformers librar function call that required bfloat16 for but I had already cast it to float16/fp16. - Fixed with two options for moving forward.
If you don't want to redownload the weights, I had made a patch last night that kills this assert statement in the tranformers library that caused this issue.
If you run this patch it will cast your bf16 weights into fp16 in place, without assertion errors
It uses sequential onloading so you don't need a gpu or a ton of ram.
In files and versions you can find the patch file you can run to patch your model files - bf16-assertion-patch.py
Your other option is to download v0.1.1 weights that I tested and released tonight.