Andrei-Alex commited on
Commit
31a819f
·
1 Parent(s): 6cb8177

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -27
README.md CHANGED
@@ -3,15 +3,14 @@ base_model: meta-llama/Llama-2-7b-chat-hf
3
  tags:
4
  - generated_from_trainer
5
  model-index:
6
- - name: FineTune
7
  results: []
8
- library_name: peft
9
  ---
10
 
11
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
  should probably proofread and complete it, then remove this comment. -->
13
 
14
- # FineTune
15
 
16
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on an unknown dataset.
17
 
@@ -29,28 +28,6 @@ More information needed
29
 
30
  ## Training procedure
31
 
32
-
33
- The following `bitsandbytes` quantization config was used during training:
34
- - load_in_8bit: False
35
- - load_in_4bit: True
36
- - llm_int8_threshold: 6.0
37
- - llm_int8_skip_modules: None
38
- - llm_int8_enable_fp32_cpu_offload: False
39
- - llm_int8_has_fp16_weight: False
40
- - bnb_4bit_quant_type: nf4
41
- - bnb_4bit_use_double_quant: False
42
- - bnb_4bit_compute_dtype: bfloat16
43
-
44
- The following `bitsandbytes` quantization config was used during training:
45
- - load_in_8bit: False
46
- - load_in_4bit: True
47
- - llm_int8_threshold: 6.0
48
- - llm_int8_skip_modules: None
49
- - llm_int8_enable_fp32_cpu_offload: False
50
- - llm_int8_has_fp16_weight: False
51
- - bnb_4bit_quant_type: nf4
52
- - bnb_4bit_use_double_quant: False
53
- - bnb_4bit_compute_dtype: bfloat16
54
  ### Training hyperparameters
55
 
56
  The following hyperparameters were used during training:
@@ -71,8 +48,6 @@ The following hyperparameters were used during training:
71
 
72
  ### Framework versions
73
 
74
- - PEFT 0.4.0
75
- - PEFT 0.4.0
76
  - Transformers 4.31.0
77
  - Pytorch 2.0.1+cu117
78
  - Datasets 2.14.4
 
3
  tags:
4
  - generated_from_trainer
5
  model-index:
6
+ - name: Fine-Tune-Adapters
7
  results: []
 
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
11
  should probably proofread and complete it, then remove this comment. -->
12
 
13
+ # Fine-Tune-Adapters
14
 
15
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on an unknown dataset.
16
 
 
28
 
29
  ## Training procedure
30
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
31
  ### Training hyperparameters
32
 
33
  The following hyperparameters were used during training:
 
48
 
49
  ### Framework versions
50
 
 
 
51
  - Transformers 4.31.0
52
  - Pytorch 2.0.1+cu117
53
  - Datasets 2.14.4