PolEval 2026

Task 1 PolOCRBench PolOCRBench evaluates transcription, table extraction, and key information extraction from challenging Polish document images. It provides a common evaluation setting for vision-language models, dedicated OCR systems, and models developed… Test A OpenTest B Upcoming 1 dataset Task 2 Polish Language Document Layout Detection The aim of the task is to advance the research concerning document layout detection in Polish. Document layout recognition involves identifying such elements as the title, section header, main text, table, footnote, image, list, etc. The… Test A OpenTest B Upcoming 1 dataset Task 3 Adversarial Style Modification: Probing the Human–AI Perception Gap We often recognize a writer's style before we can explain what makes it distinctive. A characteristic rhythm, choice of words, or way of constructing sentences can be enough for us to recognize an author's voice. Computational models can… Test A (development) OpenTest B (final) Upcoming Evaluated by its organisers Task 4 Reverse PolEval: Diagnostic Benchmark Design for Polish LLMs PolEval 2026 shared task. Participants design the benchmark. Organisers run a fixed panel of local open-weight models and score how diagnostic the submitted set is. A useful item is not merely hard. An item on which every model fails, or… Track 1 - Benchmark set OpenTrack 2 - Generator Open Evaluated by its organisers Task 5 PoLiS: Polish Linguistic Skills This task evaluates linguistic competence in Polish across six complementary subtasks covering morphosyntax, lexical semantics, reference, discourse relations and punctuation. Systems are evaluated on morphosyntactic error detection and… Test A OpenTest B Upcoming 6 datasets