AI Model Coding Evaluation

AI Model Coding Evaluation

AI Model Coding Evaluation

Job Overview

Location
Worldwide
Job Type
Freelancer.com
Salary
$62 - $117 Project
Date Posted
11 hours ago

Additional Details

Job ID
51831
Job Views
2

Job Description

I need you to pit two anonymised AI coding assistants against each other on the exact same task, watch them work in real time, and decide which one performs better. The task you will give each model is to draft technical documentation that explains how an API or developer tool works.

Your job is to:
• Stream both sessions side-by-side, logging every prompt and full response.
• Note any behavioural issues—hallucinations, security lapses, policy breaks—quoting the transcript and grading the severity.
• Rate each model on accuracy, clarity, code quality and overall usefulness.
• Declare a winner and justify the decision in a short summary.

What I expect back:
1. The complete, timestamped transcripts for both models.
2. An issue log with severity ratings.
3. A comparative scorecard.
4. Your written verdict.

You’ll need strong coding experience, daily familiarity with AI coding tools, keen attention to detail and clear written English. A reliable dev machine and stable internet are a must because the work happens live.

This is an hourly contract. Please copy the form below into your proposal and answer every line; incomplete forms will be ignored.

Form
1. Do you use AI in your daily coding? If yes, which AI tools and which model do you mainly use?
2. Your development device specs (OS, CPU, RAM, storage, internet speed). Attach performance screenshots.
3. Are you comfortable working in the PT timezone? Can you work at any time?
4. Your weekly commitment (hours):

---
來源:Freelancer.com | 出價次數:37 | 剩餘時間:6 日 | 專案類型:按小時

常見問題 FAQ

點樣申請呢份工?

請點擊頁面上嘅「立即申請」按鈕,或者按照聯絡資料聯絡僱主。

申請後幾耐有回覆?

回覆時間視乎僱主,一般 1-2 星期內會有面試邀請。

呢份工係唔係真實㗎?

EZJobs 上嘅所有職位都經過審核,確保真實有效。

Location

Similar Jobs

STANDARD GLORY MANAGEMENT LIMITED

Office & Plant Assistant

Full Time

ABLE CHOICE PERSONNEL CONSULTANCY

Human Resources cum Administrative Officer(EA)

Full Time

LCSC ELECTRONICS TECHNOLOGY (HK) LIMITED

Warehouse Assistant

Full Time
Full Time

Cookies

This website uses cookies to ensure you get the best experience on our website.

Accept