Mistral 7B C# Assistant

Published by @dotnet_ai · Community adapter

C# assistant covering .NET 8, ASP.NET Core, Entity Framework, and Unity. LINQ query generation, nullable reference type annotations, and async Task patterns.

Usage

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("mistralai/Mistral-7B-Instruct-v0.3")
base = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-Instruct-v0.3")
model = PeftModel.from_pretrained(base, "modelforgelab/mistral-7b-csharp-lora")

inputs = tokenizer("Your prompt here", return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Compatibility

• transformers>=4.38
• vLLM