Software Engineer Annotator (Remote)

About the role

We are looking for an experienced Software Engineer Annotator to work remotely, focusing on evaluating and labeling software engineering datasets that train AI and large language models. The role combines strong programming expertise with meticulous data annotation to ensure high‑quality code examples for model development.

Key responsibilities

• Review AI‑generated code for correctness, efficiency, readability, and security.
• Annotate and label datasets covering code completion, debugging, refactoring, and optimization tasks.
• Provide structured feedback to improve model performance and adhere to annotation guidelines.
• Compare multiple AI‑generated responses and rank them based on accuracy and usefulness.
• Collaborate with AI trainers, reviewers, and data teams to maintain quality standards.

Required profile

• Bachelor’s degree in Computer Science, Software Engineering or related field.
• 3–5 years of professional software engineering experience.
• Experience with data annotation, AI training, or code review is a plus.
• Understanding of software development lifecycle and coding best practices.
• Basic knowledge of AI/ML or LLM concepts is advantageous.

Required skills

• Programming languages: Python, Java, JavaScript, C++, Go.
• Strong grasp of data structures, algorithms, and software engineering principles.
• Familiarity with APIs, backend systems, and web technologies.
• Experience using annotation platforms or labeling tools.