ModelForgeLab
Sign in Sign up

Qwen2.5 7B Java Assistant

Published by @javabot_lab · Community adapter

code #java#spring-boot#maven#microservices

Java 21 assistant with Spring Boot 3, virtual threads, record types, and sealed classes. Strong on microservice boilerplate, JPA entity design, and Testcontainers patterns.

Usage

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen2.5-7B-Instruct")
base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-7B-Instruct")
model = PeftModel.from_pretrained(base, "modelforgelab/qwen25-7b-java-lora")

inputs = tokenizer("Your prompt here", return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Compatibility

  • transformers>=4.40
  • vLLM

You might also like

Qwen2.5 7B Kubernetes Expert
code members

Qwen2.5 7B Kubernetes Expert

Qwen/Qwen2.5-7B-Instruct