PoLiS: Polish Linguistic Skills

This task evaluates linguistic competence in Polish across six complementary subtasks covering morphosyntax, lexical semantics, reference, discourse relations and punctuation. Systems are evaluated on morphosyntactic error detection and correction, contextual numeral inflection, word-sense discrimination, coreference antecedent selection, universal discourse parsing and comma placement. Together, the subtasks assess the ability to use grammatical, semantic and discourse context to make precise linguistic decisions at the word, sentence and multi-sentence levels.

• Subtask 1: Polish Morphosyntactic Error Detection and Correction
• Subtask 2: Contextual Numeral Inflection in Polish
• Subtask 3: Same Sense in Context for Polish
• Subtask 4: Polish Coreference Antecedent Selection
• Subtask 5: Polish Universal Discourse Parsing
• Subtask 6: Polish Comma Placement

Model size limit

Only models with at most 12B parameters may be used in this task. The limit is meant to encourage creative adaptation of models to the task, e.g. through fine-tuning, rather than reliance on the largest available models.