Model

Gemma 2 · Turkish Wikipedia

Purpose

Start a passage in Turkish and this version of Gemma 2 9B can generate a continuation. Turkish Wikipedia supplied the reading material for another round of pretraining. A technique called LoRA limited the adjustments to a small set of parameters. The experiment held back 1,000 Wikipedia paragraphs to measure how well the model predicted the next token in unfamiliar passages from the same source.

Base model or method
Google Gemma 2 9B

Sources

Gemma 2 · Turkish Wikipedia

Turkish Wikipedia