LnL-AI
/

dbrx-base-converted-v2-4bit-gptq-marlin

Text Generation

4-bit precision

Model card Files Files and versions

Qubitium commited on Apr 1, 2024

Commit

2533adf

·

verified ·

1 Parent(s): 2881c40

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -10,7 +10,7 @@ Please use better calibrated version at https://huggingface.co/LnL-AI/dbrx-base-
 Run:
 1. Use PR https://github.com/AutoGPTQ/AutoGPTQ/pull/625
 2. Need ~68GB of VRAM (1xA100 80G will do)
-3. Use combine_sensors.sh script to combine the two split files into one. HF has max 50GB file size limit.
 ```json
 {

 Run:
 1. Use PR https://github.com/AutoGPTQ/AutoGPTQ/pull/625
 2. Need ~68GB of VRAM (1xA100 80G will do)
+3. Use combine_tensors.sh script to combine the two split files into one. HF has max 50GB file size limit.
 ```json
 {