wvnvwn/llama-3.2-1b-instruct-ttl
Text Generation
•
1B
•
Updated
Jongbok Won
wvnvwn
AI & ML interests
Preference Optimization and Machine Alignment
Organizations
None yet
wvnvwn/llama-3.2-1b-instruct-dpo-gen
Text Generation
•
1B
•
Updated
wvnvwn/llama-3.2-1b-instruct-simpo-gen
Text Generation
•
1B
•
Updated
wvnvwn/llama-3.2-1b-instruct-m_vv3-gen
Text Generation
•
1B
•
Updated
wvnvwn/llama-3.2-1b-instruct-m_vv2-gen
Text Generation
•
1B
•
Updated
wvnvwn/llama-3.2-1b-instruct-m_vv1-gen
Text Generation
•
1B
•
Updated
wvnvwn/llama-3.2-1b-instruct-m_v3
1B
•
Updated
wvnvwn/llama-3.2-1b-instruct-m_v2
1B
•
Updated
wvnvwn/llama-3.2-1b-instruct-m_v1
1B
•
Updated
wvnvwn/phi-2-train
Updated
wvnvwn/bpr_model
Updated
wvnvwn/bpr_score_wo_detach
3B
•
Updated
wvnvwn/bpr_ncpo_nos
3B
•
Updated
wvnvwn/bpr_ncpo_nos_chosen_anchor
3B
•
Updated
wvnvwn/bpr_cosine_wo_detach
3B
•
Updated
wvnvwn/phi-2-sft-ncpo-chosen-anchor
3B
•
Updated
wvnvwn/phi-2-sft-ncpo
3B
•
Updated
wvnvwn/phi-3.5-mini-instruct-ncpo-blender-chosen-anchor
4B
•
Updated
wvnvwn/ncpo_new_sft
Updated
wvnvwn/phi-2-sft-new-full
3B
•
Updated
wvnvwn/phi-3.5-mini-instruct-simpo-blender
4B
•
Updated
wvnvwn/phi-3.5-mini-instruct-dpo-blender
4B
•
Updated
wvnvwn/phi-3.5-mini-instruct-ncpo-blender
4B
•
Updated
wvnvwn/phi-2-sft
Text Generation
•
Updated
wvnvwn/full_llama3_8b_sft_offncpo
8B
•
Updated
wvnvwn/full_llama3_8b_sft_simpo
8B
•
Updated
wvnvwn/full_llama3_base_sft_dpo
8B
•
Updated
wvnvwn/ncpo-with-ultrafeedback-binarized-random-20000-2-tau0.5
4B
•
Updated