This job is no longer available
This job expired on 03/10/2026. It no longer accepts applications.
Data Science Expert – Remote Contractor
YO IT Consulting
Job description
About the role
We are partnering with a leading AI research organization to engage experienced data scientists on a remote contract basis. The focus is on evaluating how well AI systems perform real‑world data‑science tasks by designing grading criteria and scoring work samples.
Key responsibilities
- Design precise, task‑specific grading criteria for deliverables such as analyses, models, dashboards, experiment readouts, and written recommendations.
- Score AI‑generated and human work samples against those criteria, providing detailed written justifications for each score.
- Apply consistent, evidence‑based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on grading frameworks.
Required profile
- 5+ years of professional data‑science experience in industry, preferably in business operations, product, or growth analytics at top‑tier technology companies.
- Deep fluency in experiment design, A/B testing, metric definition, and communicating findings to executive stakeholders.
- Exceptionally strong written communication and detail‑orientation.
- Comfort with having judgments reviewed and calibrated against peers.
- Prior experience with AI training, evaluation, or human‑data projects is a strong plus.
Required skills
- Python
- SQL
- Experiment design
- A/B testing
- Metric definition
What we offer
- Weekly payments via Stripe or Wise based on services rendered.
- Fully remote work with a flexible schedule.
- Independent contractor engagement with the possibility of project extensions.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Iceland.
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
YO IT Consulting
Related job offers
-
Icelandic Linguist - AI Trainer
DataAnnotation Islande -
SAP Close Automation Consultant (Iceland)
Yadimen Consultancy Ltd Islande -
Redwood Automation Solution Designer - SAP Finance Close
Yadimen Consultancy Ltd Islande -
Hardware Engineer - Data Centre (GPU Compute)
European Tech Recruit Région Capital -
Field Engineer - GPU Data Centre Hardware
European Tech Recruit Reykjavik