Add pipeline tag and improve model card (#1)

- Add pipeline tag and improve model card (8c2b606fc85469d117d76e290a65e5c29e76ca4d)
- Make the README consistent for the model over iterations (ad63cc0daf9fa12a3a3d48861445b5942a12a77c)


Co-authored-by: Niels Rogge <[email protected]>

README.md

@@ -1,19 +1,17 @@
 ---
-library_name: transformers
-license: mit
 datasets:
 - HuggingFaceH4/ultrafeedback_binarized
 language:
 - en
+library_name: transformers
+license: mit
+pipeline_tag: text-generation
 ---
 
-<!-- This is a model released from the preprint: *[Bootstrapping Language Models with DPO Implicit Rewards](https://arxiv.org/abs/2406.09760)*. Please refer to our [repository](https://github.com/sail-sg/dice) for more details. -->
-
 # Llama-3-Base-8B-DICE-Iter1
 
 This model was developed using [Bootstrapping Language Models with DPO Implicit Rewards](https://arxiv.org/abs/2406.09760) (DICE) at iteration 1, based on the [princeton-nlp/Llama-3-Base-8B-SFT-DPO](https://huggingface.co/princeton-nlp/Llama-3-Base-8B-SFT-DPO) architecture as the starting point. 
 
-<!-- We utilized the prompt sets extracted from [HuggingFaceH4/ultrafeedback_binarized](https://huggingface.co/datasets/HuggingFaceH4/ultrafeedback_binarized). -->
 
 ## Links to Other Models
 - [Llama-3-Base-8B-DICE-Iter1](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter1)
@@ -34,6 +32,9 @@ This model was developed using [Bootstrapping Language Models with DPO Implicit
 |[Llama-3-Base-8B-DICE-Iter1](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter1) |25.08 |25.77
 |[Llama-3-Base-8B-DICE-Iter2](https://huggingface.co/sail/Llama-3-Base-8B-DICE-Iter2) |**27.55** |**30.99**
 
+## Code
+https://github.com/sail-sg/dice
+
 ## Citation
 
 ```bibtex