Update README.md

README.md

@@ -1,3 +1,24 @@
----
-license: mit
----
+---
+license: mit
+datasets:
+- rhyliieee/notes-completion-set
+base_model:
+- aaditya/Llama3-OpenBioLLM-8B
+pipeline_tag: text-generation
+library_name: transformers
+---
+Finetuned a pretrained Model with Lora, resize the base model's embeddings, then load Peft Model with the resized base model.
+
+"""
+# add special tokens to the tokenizer and base model before merging peft with base
+open_tokenizer.add_special_tokens({
+    "additional_special_tokens": ["<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"]
+})
+base_model.resize_token_embeddings(len(open_tokenizer))
+
+# reload the peft model with resized token embedding of base model
+peft_model = PeftModel.from_pretrained(base_model, "rhyliieee/LLaMA3-8Bit-Lora-Med-v1",)
+
+# perform merging
+merged_peft_base_with_special_tokens = peft_model.merge_and_unload()
+"""