AlexCuadron commited on
Commit
699f039
·
verified ·
1 Parent(s): 3bc87fa

Upload folder using huggingface_hub

Browse files
README.md CHANGED
@@ -1,5 +1,6 @@
1
  ---
2
  base_model:
 
3
  - Qwen/Qwen2.5-32B
4
  - all-hands/openhands-lm-32b-v0.1-ep3
5
  library_name: transformers
@@ -15,12 +16,12 @@ This is a merge of pre-trained language models created using [mergekit](https://
15
  ## Merge Details
16
  ### Merge Method
17
 
18
- This model was merged using the [Linear](https://arxiv.org/abs/2203.05482) merge method.
19
 
20
  ### Models Merged
21
 
22
  The following models were included in the merge:
23
- * [Qwen/Qwen2.5-32B](https://huggingface.co/Qwen/Qwen2.5-32B)
24
  * [all-hands/openhands-lm-32b-v0.1-ep3](https://huggingface.co/all-hands/openhands-lm-32b-v0.1-ep3)
25
 
26
  ### Configuration
@@ -29,13 +30,10 @@ The following YAML configuration was used to produce this model:
29
 
30
  ```yaml
31
  models:
32
- - model: Qwen/Qwen2.5-32B
33
- parameters:
34
- weight: 0.5
35
  - model: all-hands/openhands-lm-32b-v0.1-ep3
36
- parameters:
37
- weight: 0.5
38
- merge_method: linear
39
  dtype: float16
40
 
41
  ```
 
1
  ---
2
  base_model:
3
+ - all-hands/openhands-lm-32b-v0.1
4
  - Qwen/Qwen2.5-32B
5
  - all-hands/openhands-lm-32b-v0.1-ep3
6
  library_name: transformers
 
16
  ## Merge Details
17
  ### Merge Method
18
 
19
+ This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Qwen/Qwen2.5-32B](https://huggingface.co/Qwen/Qwen2.5-32B) as a base.
20
 
21
  ### Models Merged
22
 
23
  The following models were included in the merge:
24
+ * [all-hands/openhands-lm-32b-v0.1](https://huggingface.co/all-hands/openhands-lm-32b-v0.1)
25
  * [all-hands/openhands-lm-32b-v0.1-ep3](https://huggingface.co/all-hands/openhands-lm-32b-v0.1-ep3)
26
 
27
  ### Configuration
 
30
 
31
  ```yaml
32
  models:
33
+ - model: all-hands/openhands-lm-32b-v0.1
 
 
34
  - model: all-hands/openhands-lm-32b-v0.1-ep3
35
+ base_model: Qwen/Qwen2.5-32B
36
+ merge_method: model_stock
 
37
  dtype: float16
38
 
39
  ```
mergekit_config.yml CHANGED
@@ -1,9 +1,6 @@
1
  models:
2
- - model: Qwen/Qwen2.5-32B
3
- parameters:
4
- weight: 0.5
5
  - model: all-hands/openhands-lm-32b-v0.1-ep3
6
- parameters:
7
- weight: 0.5
8
- merge_method: linear
9
  dtype: float16
 
1
  models:
2
+ - model: all-hands/openhands-lm-32b-v0.1
 
 
3
  - model: all-hands/openhands-lm-32b-v0.1-ep3
4
+ base_model: Qwen/Qwen2.5-32B
5
+ merge_method: model_stock
 
6
  dtype: float16
model-00001-of-00014.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bdcb8fec1ad752cfc5c014de1aca81806c4c81ca78f601cf830b53347c0ee930
3
  size 4949338448
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd176df6e4284ad04943e348552cabfec6c244f559d7d17b17c87422a1b4c9a4
3
  size 4949338448
model-00002-of-00014.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:310307da753ff2bde6ba596b36e52b1924c8aab465a582bb327b2603ee6b696e
3
  size 4991425912
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:81c25b388b88f65ad83f887042a9a61a8905f200142f9994210baaff18c9e165
3
  size 4991425912
model-00003-of-00014.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:da341dce65ea16f8dc0298551f1d6dfae96e6041fa1c4bb063bae9f977823a1f
3
  size 4876059352
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d581a872134649bb7e69793d5b0050965314659e9ec8d36b5a180ffa1466f3a
3
  size 4876059352
model-00004-of-00014.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dffe4920b3e360de52c33a4e84f56c9cf4b11dba6aa34d364d154bca3988762b
3
  size 4876059336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e99eab5007e2861f147dd638df8c6ef0e9075df166bc72c9a602c3479465e80d
3
  size 4876059336
model-00005-of-00014.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0b8dcea11dcb72757b3573c9e0b00d8dc0c4462443ab8250a4319227b0140413
3
  size 4876059352
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00eac163fadc5564d58a4515ea1dd1b2c150794c3b64b5b0f4662fd0c922cf2d
3
  size 4876059352
model-00006-of-00014.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c17458462aadb2391b0fdf6f0724e02b5d5be98d35c5de3e4cf7b016837994eb
3
  size 4876059336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1448b88615475a7c29e74f36987c99ce33b6ccae5f5824f07d610735783f94c
3
  size 4876059336
model-00007-of-00014.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:43f797e2b003021e8faa6625f417d7fa0c6e1d3379bc6e63a4c0ac2b04cac482
3
  size 4876059352
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2570d1ce042a135ff02be48388869fe71f1354dfe8c5a7356437ec8d844edce
3
  size 4876059352
model-00008-of-00014.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:db649e9ed12de9ad8bb4798ecf4732f5ed73dc93045cecdf21c3144c8d2e893f
3
  size 4876059336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cbc959af8a566aaf4da78b8e2d88373374936d52312b3641039acab8f73964f1
3
  size 4876059336
model-00009-of-00014.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e2f67b1a1c52257dbc3c62e0222cf9fcb9a80fefc84b4a707cee461708b0e36a
3
  size 4876059352
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d7f84526459e48d9b7fd2f551b4501d0fdd9ab52eac54f49689ac5796ac5e6d
3
  size 4876059352
model-00010-of-00014.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:517449e6bd4a462062e47d0c395bb55801a37130ba241b883ea2a2e70e3e3814
3
  size 4876059336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:20c097d4d84b503650766c582d11fbb14be0383207b0b3ad3e541eba725d7560
3
  size 4876059336
model-00011-of-00014.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:699dc612b7a8575049ae378b264f5dc899001305b58c4d8858ca8949183c7b3d
3
  size 4876059352
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7baadbda4c33ac62b966d10bc2f4733836f317155c2ae5c18c72ff255c3fd01
3
  size 4876059352
model-00012-of-00014.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:393a5f5c7d3a3883c6d99ecf8e194b69019ff8e91ad472a0cc754a87a85fb978
3
  size 4876059336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98ca80aa7384c177099a81ec693d926b73c1752622d4c1903d0e95b08a5d92f0
3
  size 4876059336
model-00013-of-00014.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ffa7b11a1426177118787b0d623be21fe902c2b21300338ae8a043bf6d143b8d
3
  size 4876059336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8fd7a37b9a44a5677b8a05093773786b2e078c33d8698cac067d6df2f86fa810
3
  size 4876059336
model-00014-of-00014.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:aedb206d1fad0b9a7928f286e04d6f45f3bb3f8f1772394871361d721fbf7b6d
3
  size 1950423704
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e92b133d32303f4b10d71d24558b12f3eeb6340143fab3f8545309a4db8ae28a
3
  size 1950423704