This job is no longer available
This job expired on 17/11/2026. It no longer accepts applications.
LLM Language Evaluation Specialist (Gaeilge)
Thoth AI
Job description
About the role
We are seeking a Gaeilge language specialist to evaluate AI‑generated content for a long‑term LLM Language Evaluation Project. The role is remote, project‑based and expected to run for at least three months, with an initial paid trial phase.
Key responsibilities
- Assess AI/LLM‑generated Gaeilge text for accuracy, naturalness and linguistic appropriateness following detailed guidelines.
- Identify and classify issues such as mistranslations, missing content, incorrect terminology, spelling, grammar, punctuation, spacing errors, and other readability problems.
- Detect abnormal cases including non‑Gaeilge content, language identification errors, duplicate entries, or content that must be rejected.
- Provide structured evaluation results consistently while maintaining high attention to detail.
Required profile
- High proficiency in Gaeilge.
- Previous experience with LLM evaluation, AI training, data annotation, localization or translation projects.
- Strong understanding of Gaeilge grammar, vocabulary and natural language usage.
- Ability to follow detailed evaluation guidelines and work with digital documents and online tools.
Required skills
- Experience evaluating large language model outputs.
- Familiarity with structured annotation tools.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Iceland.
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Thoth AI
Related job offers
-
Icelandic Linguist - AI Trainer
DataAnnotation Islande -
SAP Close Automation Consultant (Iceland)
Yadimen Consultancy Ltd Islande -
Redwood Automation Solution Designer - SAP Finance Close
Yadimen Consultancy Ltd Islande -
Hardware Engineer - Data Centre (GPU Compute)
European Tech Recruit Région Capital -
Field Engineer - GPU Data Centre Hardware
European Tech Recruit Reykjavik