How AccioJob Saw a 70% Reduction in False-Positive Assessments with Retell AI

70
%
Reduction in false-positive assessments
2
<
Days spent integrating Retell AI
40
%
Client cost savings
How AccioJob Saw a 70% Reduction in False-Positive Assessments with Retell AI
Retell AI is loaded with features that can fulfill our case and it's pretty easy to integrate.
Head of Engineering at AccioJob
Neeraj Sharma

AccioJob is an Edtech company that helps aspiring software engineers and data scientists land top-notch job opportunities by offering structured learning paths, mock tests, and mentorship. The platform also features a customized, AI-driven assessment tool that enhances the hiring process, ensuring better accuracy and efficiency in candidate evaluations, ultimately helping both candidates and employers find the best match.By integrating Retell AI into their innovative assessment tools, AccioJob have drastically reduced false-positive assessment scores, improved hiring accuracy, and streamlined candidate evaluations, helping their partners identify top talent at a lower cost.

The numbers

Using Retell AI to build an AI invigilator, AccioJob delivers accurate, efficient, and cost-effective talent assessment solutions

  • 70% 

Reduction in false-positive assessments

  • <2

Days spent integrating Retell AI into their platform

  • 40 

Client cost savings compared to other solutions*

*Based on the price that AccioJob charge for AI invigilation versus a traditional outsourced interview

“Retell AI is loaded with features that can fulfill our case and it's pretty easy to integrate.”

Neeraj Sharma, Head of Engineering at AccioJob. 

The company

Revolutionizing talent acquisition with GenAI 

AccioJob is redefining how companies identify top talent in India’s competitive job market. In addition to offering courses and certifications in full-stack development and data science, the company integrates cutting-edge AI technology into the hiring and evaluation process for engineering roles.

To streamline an enormous volume of job applications, AccioJob developed innovative assessment tools to streamline the evaluation process. However, the growing number of sophisticated cheating tools threatened their ability to identify the right candidates for their partner companies. By seamlessly integrating Retell AI with their existing talent management system, AccioJob is able to evaluate candidates at scale with personalized tests and stay ahead of innovations designed to beat their assessments. 

Challenges

Adapting to the Evolving Challenges of Candidate Screening

As Head of Engineering at AccioJob, Neeraj Sharma experienced firsthand the complexity of identifying and hiring top talent in India’s competitive job market. “In India, when we post a software engineer role on LinkedIn, we get more than 1,000 applications,” Sharma explains. To address this, his team developed an AI-driven assessment tool that generates customized tests based on role requirements, significantly streamlining the evaluation process. “After adding this layer, we narrowed it down to 100 candidates. Then, after another two or three filtering layers, to 10 or 20 people.” 

Today, over 20 companies across India rely on AccioJob’s tools to identify top talent with ease. However, AccioJob faced significant challenges keeping up with innovations in tools designed to beat their tests: 

Lowering the False-Positive Rate

Despite implementing robust AI-generated assessments and proctoring systems, AccioJob found that sophisticated cheating methods led to a false positive rate as high as 50%. This undermined the reliability of their assessments. “We couldn’t meet our customers’ needs because we weren’t able to identify the right talent,” Sharma explains.

The Constant Need to Adapt

Whenever AccioJob released new assessments, they were very effective and accurate at identifying talent. However, candidates rapidly found workarounds to cheat on tests. This cat-and-mouse game forced AccioJob to continually innovate, iterating on their platform every few months to combat evolving methods of cheating.

Designing Quick and Effective Cheating Detection

With candidates already spending over an hour completing assessments, AccioJob needed a fast, seamless way to detect cheaters. The most straightforward approach was to introduce brief follow-up questions targeting the candidates’ highest-scoring responses.

Limited Bandwidth for In-House Solutions

AccioJob decided to build an AI-based invigilator into their assessment. However, Sharma’s team quickly realized that building this in-house would require significant time and resources.

Solutions 

Using Retell AI for Accurate and Cost-Effective Talent Assessment

By integrating Retell AI into their assessment tool, AccioJob is able to combat cheating and reduce false positives on tests. Retell AI offered AccioJob several benefits in enhancing the reliability of their evaluations:

A Lightweight and Easy-to-Integrate API

Retell AI’s simple and efficient API allowed AccioJob to quickly integrate an AI invigilator into their assessment platform. Immediately after the candidate finishes their test, the AI calls the candidate to ask follow-up questions for 5-6 minutes. This drastically improves the reliability of the assessment while adding minimal time to the client interview.

“The call scheduling part was just a few API calls. Our team was able to integrate in hardly two days.”

Personalized Candidate Screening at Scale

The AI is able to identify the candidates’ highest-scoring question and ask targeted, more difficult follow-up questions. Using data from the follow-up call, AccioJob generates an authenticity score, a key metric to identify whether candidates have cheated. The data generated during these calls reduced false positive scores by 70%. 

“We see 15% false-positives compared to 50% before. This is only the beginning. We are trying to reduce it further.”

Passing Savings and Insight onto Clients

By enhancing the reliability of their evaluations, AccioJob delivers significant cost savings to their clients at a fraction of the price of outsourcing interviews. Even better, the AI delivers reliable, consistent insight into the interviewee’s answers. 

“This is a 30-40% cost saving compared to a human interviewer and we see a massive difference in the quality of feedback.”

Seamless, Self-Optimizing Integration with Talent Management Systems

AccioJob have seen an overwhelmingly positive response to this assessment from their customers. Although it remains to be seen over time, early feedback suggests that the false positive score is decreasing over time. This is in total contrast to AccioJob’s previous assessments, where cheaters consistently found ways to bypass the system within just a few months.

“Our partner companies are really, really satisfied with these candidates.”

Why AccioJob Chose Retell AI

Building for the future: The AI invigilator is just the beginning for AccioJob: This product has created a demand for further voice AI integration in the interview process. “This saves small startups so much bandwidth.”

Consistency and accuracy: AccioJob has a network of mentors who can interview candidates, but they see more unbiased and consistent assessment from the AI invigilator. “The feedback from the AI invigilator is really accurate.”

The benefits of an API: By working with Retell, AccioJob’s benefit from external infrastructure management and rapid feature development. “We chose Retell because we wanted the best features to come to us very quickly.”

Industry
Software training institute
Location
India

Time to hire your AI call center.

Revolutionize your call operation with Retell.