Hugging Face's logo

Motif-Technologies
/
optimizer

Kernels
Model card Files
xet
Community
8
optimizer

Commit History

misc
35894d1

ca1207 commited on

use inpalce op in update_g
6e9baad

ca1207 commited on

use COMM_DTYPE instead of hardcoded dtype
2a8631f

ca1207 commited on

apply all2all scatter gather
ff6d675

ca1207 commited on

feat(muon_clip) : add muon clip (#6)
d65066c
unverified

dongseokmotif dongseokmotif github-actions[bot] commited on

chore: add nix build workflow (#8)
8997e30
unverified

wyldecat github-actions[bot] commited on

feat(muon) : add tuned-abc-values & blfoat16 communication
f7faa93

wyldecat commited on

feat: update muon to receive paramgroups, not model (#4)
b0f46c7
unverified

leejunhyeok junhyeok.lee wyldecat commited on

fix(muon): add update_p stage and dealloc tensors properly
99e7c0c

wyldecat commited on

feat(muon): add test for muon
3261444

wyldecat commited on

chore: add .gitignore
79fc8ba

wyldecat commited on

chore: add push-to-hf workflow
268d190

wyldecat commited on

Merge pull request #1 from MotifTechnologies/pre-commit_test_and_apply_lint
9d8a41d
unverified

TaehyunKim commited on

add pre commit action w/o pre-commit applied
80187d6

TaehyunKimMotif commited on

Update README.md
15b5d41
verified

JH-Motif commited on

fix(optimizer): resolve bug where weight decay was multiplied by wrong lr value (#5)
671b033
verified

dongseokmotif commited on

support torch 2.8 (#3)
1e2b528
verified

iamwyldecat commited on

fix(muon): handle un-distributed env
1f13dae

iamwyldecat commited on

refactor(muon): change argument adam_wd to weight_decay and handle params' type
02ac540

iamwyldecat commited on

fix(muon): free tensors that are no longer needed
64757cb

iamwyldecat commited on

chore(muon): update comment
036642a

iamwyldecat commited on

chore(muon): clean build and update doc
febdf5b

iamwyldecat commited on

fix(muon): delete intermediate tensors immediately to lower peak mem usage
bdd2678

iamwyldecat commited on

chore: initial commit
8535e80

iamwyldecat commited on

initial commit
cf531ba
verified

iamwyldecat commited on