[Hiring] AI Trainer @Aston Carter

Role Description

We are seeking a detail-oriented Software Engineering Evaluator to assess and improve the quality of AI-generated software development work. In this role, you will apply your engineering expertise to design realistic coding scenarios, evaluate AI-generated solutions, and provide structured feedback on code quality, correctness, and technical execution. This opportunity is ideal for software engineers who enjoy reviewing code, solving technical problems, and applying strong engineering judgment to ensure high-quality, production-ready outcomes.

Key Responsibilities

• Create realistic software engineering tasks based on real-world development workflows, including technical requirements, supporting documentation, test cases, and code repositories.
• Evaluate AI-generated code solutions against professional engineering standards for correctness, maintainability, performance, and reliability.
• Compare outputs from different AI systems using identical requirements and environments, documenting relative strengths and areas for improvement.
• Develop test plans, evaluation rubrics, and success criteria that clearly define expected functionality, coding standards, and edge-case handling.
• Review code changes, implementation decisions, automated tests, and design approaches to verify technical quality and adherence to requirements.
• Identify and document issues such as:
  • Missed edge cases
  • Incorrect or incomplete implementations
  • Fragile code changes
  • Ineffective testing strategies
  • Requirements misinterpretation
  • Unsupported assumptions or fabricated outputs
• Collaborate with engineers and reviewers to refine evaluation tasks, improve assessment methodologies, and maintain quality standards across projects.
• Contribute technical expertise across a variety of technologies, platforms, and software development environments.

Qualifications

• Experience developing, testing, and maintaining software applications or systems.
• Proficiency in at least one modern programming language such as:
  • Python
  • JavaScript / TypeScript
  • Java
  • Go
  • C++
  • C#
  • Ruby
  • PHP
  • Swift
  • Kotlin
  • Rust
• Strong understanding of software engineering principles, debugging techniques, testing methodologies, and version control systems.
• Ability to quickly understand unfamiliar codebases and evaluate implementation quality.
• Experience using tools such as Git, testing frameworks, command-line interfaces, and debugging tools.
• Excellent written communication skills with the ability to explain technical findings clearly and objectively.
• Professional-level English proficiency.

Requirements

• Two or more years of software development experience in a professional, academic, freelance, or open-source setting.
• Familiarity with containerization, CI/CD pipelines, and modern development workflows.
• Experience using AI-powered coding assistants or large language model (LLM) tools such as ChatGPT, Claude, GitHub Copilot, or similar technologies.
• Bachelor's degree (completed or in progress) in Computer Science, Software Engineering, Information Systems, or a related discipline, or equivalent practical experience.

What Success Looks Like

• Consistently identifies technical issues, risks, and implementation gaps with supporting evidence.
• Demonstrates sound engineering judgment when evaluating code quality and software behavior.
• Produces clear, actionable feedback that improves the quality of AI-generated software outputs.
• Applies best practices in testing, maintainability, performance, and software design.
• Delivers objective and well-documented evaluations across multiple technologies and domains.

Skills

• Software Development
• Code Review
• Quality Assurance
• Test Design & Validation
• Debugging & Troubleshooting
• Git & Version Control
• Software Architecture
• Technical Documentation
• Analytical Thinking
• AI-Assisted Development
• Backend, Frontend, and Full-Stack Development
• Problem Solving

Job Type & Location

• This is a Permanent position based out of Tampa, FL.
• The pay range for this position is $45000.00 - $60000.00/yr.
• Independent contractor paid through PayPal. No benefits offered.
• This is a fully remote position.

Application Deadline

This position is anticipated to close on Nov 20, 2026.