Duplicated from  banghua/n_rm

berkeley-nest

/

Starling-RM-7B-alpha

like 105

Follow

Berkeley-Nest 87

GPT4 User: Your instruction goes here
<|end_of_turn|>GPT4 Assistant:

Oh my apologies for missing the question here. Actually our reward model has a different prompt format as language model. It's included in the example code: "[INST] Hello? [/INST] Hi, how can I help you?"

Llama 2 in fastchat ;) https://github.com/lm-sys/FastChat/blob/7c12409c6fb23c1d87d8cbebe6a73110a67bf98e/fastchat/conversation.py#L1040