Responsibilities:

Design and execute on solutions for AI quality, evaluation, and annotation

Leverage Generative AI prompting, human input, hybrid approaches in the development of scalable and high-quality human judgment workflows

Conduct data-driven analysis and provide linguistic insights for project development

Be part of working groups that develop high-quality human judgment/annotation/evaluation pipelines

Create documentation and guidelines for standard procedures of internal processes

Research new methodologies for process and product improvement

Maximize productivity, process efficiency and quality through streamlined workflows, process standardization, documentation

Basic Qualifications:

B.S./B.A Degree in Computational Linguistics, Language Technologies, Linguistics or a related field

2+ years relevant industry experience

2+ years experience with large-scale, end-to-end human judgment flows and tools for the training/evaluation of AI models

2+ years experience to breakdown linguistic data requirements into concise, clear instructions and designs

1+ years experience programming in Python or any other scripting language