Llama 3 8B Go Language

Published by @gopher_llm · Community adapter

Trained on 80 k Go snippets from the Go standard library, popular OSS projects, and idiomatic examples from the Go spec. Strong on goroutines, channels, and error wrapping.

Usage

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("meta-llama/Meta-Llama-3-8B-Instruct")
base = AutoModelForCausalLM.from_pretrained("meta-llama/Meta-Llama-3-8B-Instruct")
model = PeftModel.from_pretrained(base, "modelforgelab/llama3-8b-go-assistant-lora")

inputs = tokenizer("Your prompt here", return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Compatibility

• transformers>=4.40
• vLLM