Virtual TA Boosts Student Success at Georgia State University

student texting with chatbot

In a recent study at Georgia State University, students who received timely messages about their coursework from a virtual teaching assistant demonstrated significant improvement in their academic success. Researchers conducted a randomized controlled trial using artificial intelligence chatbot technology from Mainstay (formerly AdmitHub) in an Introduction to Government course to provide students with reminders about course requirements and deadlines; customized feedback on their progress; weekly digests with upcoming due dates and estimated time to complete tasks; practice quizzes; coaching and encouragement; and information on campus support systems, tools and resources. Students in the program received two to three messages per week from the chatbot.

Overall, students who had access to the tool were 16% more likely to earn a B grade or higher, the researchers found. Among first-generation students, those who received messages from the chatbot earned final grades about 11 points higher than similar students who did not receive the messages, and were more likely to pass the class. Sophomores, junior and seniors (continuing students) who received chatbot messages achieved final grades about 7 points higher; were more likely to pass the class; were less likely to earn a D, fail or withdraw; and were less likely to drop other courses across the board. And students using the tool who had lower academic performance in high school were more likely to earn a B or higher and more likely to complete more credit hours at the university.

Student feedback was also positive: 92% said they would recommend using the chatbot in the course as well as extending it to other courses; 77% found the weekly digests helpful, and 70% found the chatbot messages helpful.

"We know that personalized input and feedback from instructors can have a transformative impact on students' academic performance, but that's not always easy to provide in large classroom settings," said Tim Renick, executive director of the National Institute for Student Success and professor at Georgia State University, in a statement. "With the support of a virtual TA that was able to provide just-in-time nudges and answer questions 24/7, students performed at significantly higher levels academically, with the biggest gains enjoyed by first-generation students in the course. This approach is demonstrating the potential of new technology like AI to build a better learning experience for students while reducing equity gaps."

"Too often, students' academic struggles have nothing to do with their intellect or commitment — but rather stem from logistical challenges, like competing family or professional priorities, that cause deadlines to slip," commented Drew Magliozzi, co-founder and CEO of Mainstay. "By using AI to open up new lines of communication with students through empathetic, contextualized conversation, colleges can not only provide an extra layer of proactive support to ensure that fewer things slip through the cracks — but also listen and respond to students at scale, to better ensure that every learner gets the support they need as they navigate their educational journey."

For more information, visit the Mainstay site.

About the Author

Rhea Kelly is editor in chief for Campus Technology, THE Journal, and Spaces4Learning. She can be reached at [email protected].

Featured

  • abstract pattern of shapes, arrows and circuit lines

    Internet2 Announces a New President and CEO to Step Up in October

    Internet2, the member-driven nonprofit offering advanced network technology services and cyberinfrastructure to the research and education community has completed its search, which began this past May, for a new president and CEO to take the helm.

  • shield with an AI microchip emblem hovering above stacks of gold coins

    AI Security Spend Surges While Traditional Security Budgets Shrink

    A new Thales report reveals that while enterprises are pouring resources into AI-specific protections, only 8% are encrypting the majority of their sensitive cloud data — leaving critical assets exposed even as AI-driven threats escalate and traditional security budgets shrink.

  • stack of gold coins disintegrates into digital particles against a dark circuit-board background with glowing AI imagery

    MIT Report: Most Organizations See No Business Return on Gen AI Investments

    A recent report out of the MIT Media Lab found that despite $30-40 billion in enterprise spending on generative AI, 95% of organizations are seeing no business return.

  • young man in a denim jacket scans his phone at a card reader outside a modern glass building

    Colleges Roll Out Mobile Credential Technology

    Allegion US has announced a partnership with Florida Institute of Technology (FIT) and Denison College, in conjunction with Transact + CBORD, to install mobile credential technologies campuswide. Implementing Mobile Student ID into Apple Wallet and Google Wallet will allow students access to campus facilities, amenities, and residence halls using just their phones.