2025 · Public research dataset · Version 1

TARA: Turkish Advanced Reasoning Assessment Dataset

A set of Turkish-language tasks for examining how language models reason across domains.

Research question

How do you ask a language model to reason in Turkish?

Evidence and scope

Ceren Öcal Taşar and I assembled tasks across ten categories, including logic, planning, Python and SQL. A reader can inspect the prompts and expected responses before looking at a model’s score.

Version 1 contains 100 synthetic examples. The dataset card describes their generation and notes that a single generator and a small sample limit what the scores say about everyday Turkish.

Primary source

Contribution
Davut Emre Taşar · Co-creator
Source attribution
Davut Emre Taşar, Ceren Öcal Taşar
Publication status
Public research dataset · Version 1
Publication or platform
Hugging Face Datasets
Identifier
10.57967/hf/5193

Sources

Research areas · Language

Related work