TinySwallow Llama.cpp

TinySwallow-1.5B-Instruct, a Japanese instruction-tuned language model, leverages TAID knowledge distillation from Qwen2.5-32B-Instruct, improving instruction following and conversational abilities.
Model

Select the AI model to use for chat
512 4096
0.1 2
0.1 1
1 100
1 2