在 MLX 上使用 LoRA / QLoRA 微调 Text2SQL(八):使用 LoRA 基于 TinyLlama 微调
- TinyLlama: The Mini AI Model with a Trillion-Token Punch
- Just using MLX to fine-tune TinyLlama with LoRA locally on a 8 GB Mac Mini.
TinyLlama/TinyLlama-1.1B-Chat-v1.0
- 输入
<|system|>
You are a chatbot who can help code!</s>
<|user|>
Write me a function to calculate the first 10 digits of the fibonacci sequence in Python and print it out to the CLI.</s>
<|assistant|>
- 输出