Virtual TA Boosts Student Success at Georgia State University

student texting with chatbot

In a recent study at Georgia State University, students who received timely messages about their coursework from a virtual teaching assistant demonstrated significant improvement in their academic success. Researchers conducted a randomized controlled trial using artificial intelligence chatbot technology from Mainstay (formerly AdmitHub) in an Introduction to Government course to provide students with reminders about course requirements and deadlines; customized feedback on their progress; weekly digests with upcoming due dates and estimated time to complete tasks; practice quizzes; coaching and encouragement; and information on campus support systems, tools and resources. Students in the program received two to three messages per week from the chatbot.

Overall, students who had access to the tool were 16% more likely to earn a B grade or higher, the researchers found. Among first-generation students, those who received messages from the chatbot earned final grades about 11 points higher than similar students who did not receive the messages, and were more likely to pass the class. Sophomores, junior and seniors (continuing students) who received chatbot messages achieved final grades about 7 points higher; were more likely to pass the class; were less likely to earn a D, fail or withdraw; and were less likely to drop other courses across the board. And students using the tool who had lower academic performance in high school were more likely to earn a B or higher and more likely to complete more credit hours at the university.

Student feedback was also positive: 92% said they would recommend using the chatbot in the course as well as extending it to other courses; 77% found the weekly digests helpful, and 70% found the chatbot messages helpful.

"We know that personalized input and feedback from instructors can have a transformative impact on students' academic performance, but that's not always easy to provide in large classroom settings," said Tim Renick, executive director of the National Institute for Student Success and professor at Georgia State University, in a statement. "With the support of a virtual TA that was able to provide just-in-time nudges and answer questions 24/7, students performed at significantly higher levels academically, with the biggest gains enjoyed by first-generation students in the course. This approach is demonstrating the potential of new technology like AI to build a better learning experience for students while reducing equity gaps."

"Too often, students' academic struggles have nothing to do with their intellect or commitment — but rather stem from logistical challenges, like competing family or professional priorities, that cause deadlines to slip," commented Drew Magliozzi, co-founder and CEO of Mainstay. "By using AI to open up new lines of communication with students through empathetic, contextualized conversation, colleges can not only provide an extra layer of proactive support to ensure that fewer things slip through the cracks — but also listen and respond to students at scale, to better ensure that every learner gets the support they need as they navigate their educational journey."

For more information, visit the Mainstay site.

About the Author

Rhea Kelly is editor in chief for Campus Technology, THE Journal, and Spaces4Learning. She can be reached at [email protected].

Featured

  • From Fire TV to Signage Stick: University of Utah's Digital Signage Evolution

    Jake Sorensen, who oversees sponsorship and advertising and Student Media in Auxiliary Business Development at the University of Utah, has navigated the digital signage landscape for nearly 15 years. He was managing hundreds of devices on campus that were incompatible with digital signage requirements and needed a solution that was reliable and lowered labor costs. The Amazon Signage Stick, specifically engineered for digital signage applications, gave him the stability and design functionality the University of Utah needed, along with the assurance of long-term support.

  • digital network with glowing blue and red lines, featuring multiple red arrows shifting in different directions

    Report: Attackers Change Tactics as Ransomware Payoffs Decline

    Attackers are changing tactics as they collect less money from ransomware payoffs, according to a new report from Chainalysis, a blockchain analytics firm.

  • SXSW EDU

    Explore the Future of AI in Higher Ed at SXSW EDU 2025

    This March 3-6 in Austin, TX, the SXSW EDU Conference & Festival celebrates its 15th year of exploring education's most critical issues and providing a forum for creativity, innovation, and expression.

  • business leader standing confidently amid interconnected gears

    Leading Through Complexity: How Online Leaders Can Drive Digital Institutional Transformation

    Leaders charged with developing and expanding online programs at their institutions are finding themselves in increasingly complex roles, but there are a few core steps institutional leaders can take to ensure success.