Llama 3.1 8B Grant Writing

Published by @nsf_drafter · Community adapter

Grant proposal sections: executive summary, needs statement, goals and objectives, evaluation plan, and budget narrative. Trained on successful NSF, NIH, and EU Horizon applications.

Usage

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("meta-llama/Meta-Llama-3.1-8B-Instruct")
base = AutoModelForCausalLM.from_pretrained("meta-llama/Meta-Llama-3.1-8B-Instruct")
model = PeftModel.from_pretrained(base, "modelforgelab/llama31-8b-grant-writer-lora")

inputs = tokenizer("Your prompt here", return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Compatibility

• transformers>=4.43
• vLLM