Upload folder using huggingface_hub

README.md

@@ -3,12 +3,22 @@ license: apache-2.0
 license_link: https://choosealicense.com/licenses/apache-2.0/
 ---
 # RedPajama-INCITE-Chat-3B-v1-int4-ov
-* Model creator: [Together](https://huggingface.co/togethercomputer)
+* Model creator: [Togethercomputer](https://huggingface.co/togethercomputer)
  * Original model: [RedPajama-INCITE-Chat-3B-v1](https://huggingface.co/togethercomputer/RedPajama-INCITE-Chat-3B-v1)
 
 ## Description
+This is [RedPajama-INCITE-Chat-3B-v1](https://huggingface.co/togethercomputer/RedPajama-INCITE-Chat-3B-v1) model converted to the [OpenVINO™ IR](https://docs.openvino.ai/2024/documentation/openvino-ir-format.html) (Intermediate Representation) format with weights compressed to INT4 by [NNCF](https://github.com/openvinotoolkit/nncf).
+
+## Quantization Parameters
+
+Weight compression was performed using `nncf.compress_weights` with the following parameters:
+
+* mode: **int4_asym**
+* ratio: **0.8**
+* group_size: **128**
+
+For more information on quantization, check the [OpenVINO model optimization guide](https://docs.openvino.ai/2024/openvino-workflow/model-optimization-guide/weight-compression.html).
 
-This is [RedPajama-INCITE-Chat-3B-v1](https://huggingface.co/togethercomputer/RedPajama-INCITE-Chat-3B-v1) model converted to the [OpenVINO™ IR](https://docs.openvino.ai/2024/documentation/openvino-ir-format.html) (Intermediate Representation) format.
 
 ## Compatibility
 
@@ -46,7 +56,7 @@ For more examples and possible optimizations, refer to the [OpenVINO Large Langu
 
 ## Limitations
 
-Check the original model card for [limitations](https://huggingface.co/togethercomputer/RedPajama-INCITE-Chat-3B-v1#limitations).
+Check the original model card for [limitations]().
 
 ## Legal information
 
@@ -54,4 +64,4 @@ The original model is distributed under [apache-2.0](https://choosealicense.com/
 
 ## Disclaimer
 
-Intel is committed to respecting human rights and avoiding causing or contributing to adverse impacts on human rights. See [Intel’s Global Human Rights Principles](https://www.intel.com/content/dam/www/central-libraries/us/en/documents/policy-human-rights.pdf). Intel’s products and software are intended only to be used in applications that do not cause or contribute to adverse impacts on human rights.
+Intel is committed to respecting human rights and avoiding causing or contributing to adverse impacts on human rights. See [Intel’s Global Human Rights Principles](https://www.intel.com/content/dam/www/central-libraries/us/en/documents/policy-human-rights.pdf). Intel’s products and software are intended only to be used in applications that do not cause or contribute to adverse impacts on human rights.