Model
Gemma 2 · Turkish Wikipedia
Purpose
Start a passage in Turkish and this version of Gemma 2 9B can generate a continuation. Turkish Wikipedia supplied the reading material for another round of pretraining. A technique called LoRA limited the adjustments to a small set of parameters. The experiment held back 1,000 Wikipedia paragraphs to measure how well the model predicted the next token in unfamiliar passages from the same source.
- Base model or method
- Google Gemma 2 9B