AI Data Trainer, Code Evaluation

Location

Employment Type

Location Type

Department

Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.

We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. We like to work hard and move fast to do what’s best for our customers.

Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each person is one of the best in the world at what they do. We believe that a diverse range of perspectives is a requirement for building great products.

Join us on our mission and shape the future!

Why this role?

We are on a mission to build machines that understand the world and make them safely accessible to all. Data quality is foundational to this process. Machines (or Large Language Models to be exact) learn in similar ways to humans - by way of feedback. By labelling, ranking, auditing, and correcting text output, you will improve Large Language Model’s performance for iterations to come, thus having a lasting impact on Cohere’s tech.

Please Note: This is a part-time independent contractor position available within Canada only. We seek candidates who are able to commit to 16 hours per week at a CAD $40/hour contract rate. This role is BYOD - Bring Your Own Device (laptop). Remote work within Canada is permitted. Performance incentives included!

As an AI Data Trainer, you will:

• Label and Rank: Accurately label and rank machine learning data, with a focus on code-related content.
• Audit and Correct: Complete reading or coding-based tasks in an efficient and attentive manner.
• Perform Preference-Based Tasks: Evaluate and complete tasks, assessing which responses best conform to project guidelines.
• Recommend Optimizations: Identify and suggest opportunities for improving data quality and model performance in coding tasks.
• Provide Feedback: Collaborate and communicate effectively, providing feedback to cross-functional team members, particularly on coding-related matters.
• Have Detail-Oriented Execution: Maintain meticulous attention to detail while performing repetitive and precise tasks, particularly when working with language data.

You may be a good fit if you have:

• Subject matter expertise in software engineering - you have both studied in these fields and have practical experience applying them in a workplace.
• Proficient knowledge and understanding in either Python or JavaScript.
• Proficient knowledge in SQL (any dialect).
• Familiarity with bash/scripting, or another object-oriented language (C++/Java/Go/TypeScript) is a plus.
• Strong attention to detail and commitment to accuracy - you’re the type to proofread all of your emails!
• High tolerance for repetitive and monotonous work.
• Ability to follow complex instructions, navigate ambiguity and work independently.
• Superb sense of urgency and time management.
• Curiosity about technology and a knack for tackling problems in creative ways.
• A reliable laptop and internet connection.

The Candidate Journey:
Initial Screening - Once you have submitted your application our Talent Team will review your resume and writing samples.
Coding Assessment - You will receive a HackerRank coding assessment.
Video Interview - If selected to move forward, you will have a short video call with a member of our Operations Team!
Offer - Independent Contractor Agreement

As an independent contractor, you maintain control over how you complete your work and may work with multiple clients simultaneously, although we ask you to declare if any of these are with a direct competitor of Cohere and maintain IP confidentiality of the Cohere project. Independent contractors are not eligible for health benefits or other benefits provided to employees. Compensation for services is provided to contractors by contractors invoicing for services provided pursuant to the terms of our agreement with the contractor.

It is important to understand that as an independent contractor, continuous work is not guaranteed. The client-contractor relationship is fundamentally project-based, meaning engagements may be temporary, periodic, or intermittent based on our organizational needs and project availability. As an independent contractor, you should anticipate fluctuations in workflow and, therefore, compensation for services when Cohere does not require as many hours of services in a week.

Prospective candidates, please be advised: this role involves working with human-generated and model-generated tasks that may involve exposure to not safe for work (NSFW) text content as part of data annotation tasks, including explicit, offensive, or other inappropriate material.

If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply! If you want to work really hard on a glorious mission with teammates that want the same thing, Cohere is the place for you.

We value and celebrate diversity and strive to create an inclusive work environment for all. We welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.

Full-Time Employees at Cohere enjoy these Perks:

An open and inclusive culture and work environment

‍ Work closely with a team on the cutting edge of AI research

Weekly lunch stipend, in-office lunches & snacks

Full health and dental benefits, including a separate budget to take care of your mental health

100% Parental Leave top-up for 6 months for employees based in Canada, the US, and the UK

Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement

Remote-flexible, offices in Toronto, New York, San Francisco and London and co-working stipend

✈️ 6 weeks of vacation

Note: This post is co-authored by both Cohere humans and Cohere technology.