[Hiring] Senior Machine Learning Scientist @Turnitin, LLC

Role Description

Turnitin is a recognized innovator in the global education space. For more than 20 years, Turnitin has partnered with educational institutions to promote honesty, consistency, and fairness across all subject areas and assessment types. Over 16,000 academic institutions, publishers, and corporations use our products and services.

At Turnitin, working remotely is our default. We respect local cultures, embrace diversity, and we respect personal choice. Our diverse community of colleagues is unified by a shared desire to make a difference in education. Our remote-first culture allows for every employee to get the same access to learning and career opportunities, and it enables us to think differently about where and how we recruit talent from all kinds of diverse backgrounds.

Machine Learning is integral to the continued success of our company. Our product roadmap is exciting and ambitious. You will join a global team of curious, helpful, and independent scientists and engineers, united by a commitment to deliver cutting-edge, well-engineered Machine Learning systems. You will work closely with product and engineering teams across Turnitin to integrate Machine Learning into a broad suite of learning, teaching, and integrity products.

Your contributions will have global reach and scale. Billions of papers have been submitted to the Turnitin platform, and hundreds of millions of answers have been graded on the Gradescope and Examsoft platforms. Machine Learning powers our AI Writing detection system, gives automated feedback on student writing, investigates authorship of student writing, revolutionizes the creation and grading of assessments, and plays a critical role in many back-end processes.

Responsibilities

• Work with subject matter experts and product owners to determine what questions should be asked and what questions can be answered.
• Work with subject matter experts to curate, generate, and annotate data, and create optimal datasets following responsible data collection and model maintenance practices.
• Answer questions and make trainable datasets from raw data, using efficient SQL queries and scripting languages, visualizing when necessary.
• Develop and tune Machine Learning models, following best practices to select datasets, architectures, and model parameters.
• Utilize, adopt, and fine-tune Language Models, including third-party LLMs (through prompt engineering and orchestration) and locally hosted LMs.
• Stay current in the field - read research papers, experiment with new architectures and LLMs, and share your findings.
• Optimize models for scaled production usage.
• Communicate insights, as well as the behavior and limitations of models, to peers, subject matter experts, and product owners.
• Write clean, efficient, and modular code, with automated tests and appropriate documentation.
• Stay up to date with technology, make good technological choices, and be able to explain them to the organization.

Qualifications

• Experience working with text data to build Deep Learning and ML models, both supervised and unsupervised. Experience with deep learning in other modalities such as vision and speech would be a strong bonus.
• A strong understanding of the math and theory behind machine learning and deep learning.
• Software engineering background with at least 8 years of experience (we use Python, SQL, Unix-based systems, git, and github for collaboration and review).
• Machine / Deep Learning development skills, including experiment tracking (we use AWS SageMaker, Hugging Face, transformers, PyTorch, scikit-learn, Jupyter, Weights & Biases).
• An understanding of Language Models, using and training / fine-tuning and a familiarity with industry-standard LM families.
• Master's degree or PhD in Computer Science, Electrical Engineering, AI, Machine Learning, applied math or related field, with relevant industry experience, or outstanding previous achievements in this role.
• Excellent communication and teamwork skills.
• Fluent in written and spoken English.

Requirements

• Familiarity in coding for at-scale production, ranging from best practices to building back-end API services or stand-alone libraries.
• Essential dev-ops skills (we use Docker, AWS EC2/Batch/Lambda).
• Familiarity in building front-ends (LLMs or more standard React, Javascript, Flask) for simple demos, POCs and prototypes.
• Experience with advanced prompting, fine-tuning or training an LLM, open-source or cloud, using industry accepted platforms (such as mosaic.ai or stochastic.ai).
• Showcase previous work (e.g. via a website, presentation, open source code).

Benefits

• Remote First Culture
• Health Care Coverage*
• Education Reimbursement*
• Competitive Paid Time Off
• 4 Self-Care Days per year
• National Holidays*
• 2 Founder Days + Juneteenth Observed
• Paid Volunteer Time*
• Charitable contribution match*
• Monthly Wellness or Home Office Reimbursement*
• Access to Modern Health (mental health platform)
• Parental Leave*
• Retirement Plan with match/contribution*

Company Description

When you join Turnitin, you'll be welcomed into a company that is a recognized innovator in the global education space. For over 25 years, Turnitin has partnered with educational institutions to promote honesty, consistency, and fairness across all subject areas and assessment types. Over 21,000 academic institutions, publishers, and corporations use our services: Feedback Studio, Originality, Gradescope, ExamSoft, Similarity, and iThenticate.

Turnitin is a global organization with team members in over 35 countries including the United States, Mexico, United Kingdom, Australia, Japan, India, and the Philippines.

Turnitin, LLC is an equal opportunity employer- vets/disabled.