#edge

1 adapter tagged #edge.

Related tags: #q4 #offline #gguf #llama3
Llama 3 8B Instruct (GGUF Q4) sample output
text-generation public

Llama 3 8B Instruct (GGUF Q4)

meta-llama/Meta-Llama-3-8B-Instruct

by @quant_lab

v1.0.0 gguf 4800 MiB