Upload folder using huggingface_hub
Browse files- README.md +6 -8
- mergekit_config.yml +3 -6
- model-00001-of-00014.safetensors +1 -1
- model-00002-of-00014.safetensors +1 -1
- model-00003-of-00014.safetensors +1 -1
- model-00004-of-00014.safetensors +1 -1
- model-00005-of-00014.safetensors +1 -1
- model-00006-of-00014.safetensors +1 -1
- model-00007-of-00014.safetensors +1 -1
- model-00008-of-00014.safetensors +1 -1
- model-00009-of-00014.safetensors +1 -1
- model-00010-of-00014.safetensors +1 -1
- model-00011-of-00014.safetensors +1 -1
- model-00012-of-00014.safetensors +1 -1
- model-00013-of-00014.safetensors +1 -1
- model-00014-of-00014.safetensors +1 -1
README.md
CHANGED
|
@@ -1,5 +1,6 @@
|
|
| 1 |
---
|
| 2 |
base_model:
|
|
|
|
| 3 |
- Qwen/Qwen2.5-32B
|
| 4 |
- all-hands/openhands-lm-32b-v0.1-ep3
|
| 5 |
library_name: transformers
|
|
@@ -15,12 +16,12 @@ This is a merge of pre-trained language models created using [mergekit](https://
|
|
| 15 |
## Merge Details
|
| 16 |
### Merge Method
|
| 17 |
|
| 18 |
-
This model was merged using the [
|
| 19 |
|
| 20 |
### Models Merged
|
| 21 |
|
| 22 |
The following models were included in the merge:
|
| 23 |
-
* [
|
| 24 |
* [all-hands/openhands-lm-32b-v0.1-ep3](https://huggingface.co/all-hands/openhands-lm-32b-v0.1-ep3)
|
| 25 |
|
| 26 |
### Configuration
|
|
@@ -29,13 +30,10 @@ The following YAML configuration was used to produce this model:
|
|
| 29 |
|
| 30 |
```yaml
|
| 31 |
models:
|
| 32 |
-
- model:
|
| 33 |
-
parameters:
|
| 34 |
-
weight: 0.5
|
| 35 |
- model: all-hands/openhands-lm-32b-v0.1-ep3
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
merge_method: linear
|
| 39 |
dtype: float16
|
| 40 |
|
| 41 |
```
|
|
|
|
| 1 |
---
|
| 2 |
base_model:
|
| 3 |
+
- all-hands/openhands-lm-32b-v0.1
|
| 4 |
- Qwen/Qwen2.5-32B
|
| 5 |
- all-hands/openhands-lm-32b-v0.1-ep3
|
| 6 |
library_name: transformers
|
|
|
|
| 16 |
## Merge Details
|
| 17 |
### Merge Method
|
| 18 |
|
| 19 |
+
This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Qwen/Qwen2.5-32B](https://huggingface.co/Qwen/Qwen2.5-32B) as a base.
|
| 20 |
|
| 21 |
### Models Merged
|
| 22 |
|
| 23 |
The following models were included in the merge:
|
| 24 |
+
* [all-hands/openhands-lm-32b-v0.1](https://huggingface.co/all-hands/openhands-lm-32b-v0.1)
|
| 25 |
* [all-hands/openhands-lm-32b-v0.1-ep3](https://huggingface.co/all-hands/openhands-lm-32b-v0.1-ep3)
|
| 26 |
|
| 27 |
### Configuration
|
|
|
|
| 30 |
|
| 31 |
```yaml
|
| 32 |
models:
|
| 33 |
+
- model: all-hands/openhands-lm-32b-v0.1
|
|
|
|
|
|
|
| 34 |
- model: all-hands/openhands-lm-32b-v0.1-ep3
|
| 35 |
+
base_model: Qwen/Qwen2.5-32B
|
| 36 |
+
merge_method: model_stock
|
|
|
|
| 37 |
dtype: float16
|
| 38 |
|
| 39 |
```
|
mergekit_config.yml
CHANGED
|
@@ -1,9 +1,6 @@
|
|
| 1 |
models:
|
| 2 |
-
- model:
|
| 3 |
-
parameters:
|
| 4 |
-
weight: 0.5
|
| 5 |
- model: all-hands/openhands-lm-32b-v0.1-ep3
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
merge_method: linear
|
| 9 |
dtype: float16
|
|
|
|
| 1 |
models:
|
| 2 |
+
- model: all-hands/openhands-lm-32b-v0.1
|
|
|
|
|
|
|
| 3 |
- model: all-hands/openhands-lm-32b-v0.1-ep3
|
| 4 |
+
base_model: Qwen/Qwen2.5-32B
|
| 5 |
+
merge_method: model_stock
|
|
|
|
| 6 |
dtype: float16
|
model-00001-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4949338448
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bd176df6e4284ad04943e348552cabfec6c244f559d7d17b17c87422a1b4c9a4
|
| 3 |
size 4949338448
|
model-00002-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4991425912
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:81c25b388b88f65ad83f887042a9a61a8905f200142f9994210baaff18c9e165
|
| 3 |
size 4991425912
|
model-00003-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059352
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3d581a872134649bb7e69793d5b0050965314659e9ec8d36b5a180ffa1466f3a
|
| 3 |
size 4876059352
|
model-00004-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059336
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e99eab5007e2861f147dd638df8c6ef0e9075df166bc72c9a602c3479465e80d
|
| 3 |
size 4876059336
|
model-00005-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059352
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:00eac163fadc5564d58a4515ea1dd1b2c150794c3b64b5b0f4662fd0c922cf2d
|
| 3 |
size 4876059352
|
model-00006-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059336
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f1448b88615475a7c29e74f36987c99ce33b6ccae5f5824f07d610735783f94c
|
| 3 |
size 4876059336
|
model-00007-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059352
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e2570d1ce042a135ff02be48388869fe71f1354dfe8c5a7356437ec8d844edce
|
| 3 |
size 4876059352
|
model-00008-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059336
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cbc959af8a566aaf4da78b8e2d88373374936d52312b3641039acab8f73964f1
|
| 3 |
size 4876059336
|
model-00009-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059352
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4d7f84526459e48d9b7fd2f551b4501d0fdd9ab52eac54f49689ac5796ac5e6d
|
| 3 |
size 4876059352
|
model-00010-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059336
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:20c097d4d84b503650766c582d11fbb14be0383207b0b3ad3e541eba725d7560
|
| 3 |
size 4876059336
|
model-00011-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059352
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e7baadbda4c33ac62b966d10bc2f4733836f317155c2ae5c18c72ff255c3fd01
|
| 3 |
size 4876059352
|
model-00012-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059336
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:98ca80aa7384c177099a81ec693d926b73c1752622d4c1903d0e95b08a5d92f0
|
| 3 |
size 4876059336
|
model-00013-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4876059336
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8fd7a37b9a44a5677b8a05093773786b2e078c33d8698cac067d6df2f86fa810
|
| 3 |
size 4876059336
|
model-00014-of-00014.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1950423704
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e92b133d32303f4b10d71d24558b12f3eeb6340143fab3f8545309a4db8ae28a
|
| 3 |
size 1950423704
|