Virtual TA Boosts Student Success at Georgia State University

student texting with chatbot

In a recent study at Georgia State University, students who received timely messages about their coursework from a virtual teaching assistant demonstrated significant improvement in their academic success. Researchers conducted a randomized controlled trial using artificial intelligence chatbot technology from Mainstay (formerly AdmitHub) in an Introduction to Government course to provide students with reminders about course requirements and deadlines; customized feedback on their progress; weekly digests with upcoming due dates and estimated time to complete tasks; practice quizzes; coaching and encouragement; and information on campus support systems, tools and resources. Students in the program received two to three messages per week from the chatbot.

Overall, students who had access to the tool were 16% more likely to earn a B grade or higher, the researchers found. Among first-generation students, those who received messages from the chatbot earned final grades about 11 points higher than similar students who did not receive the messages, and were more likely to pass the class. Sophomores, junior and seniors (continuing students) who received chatbot messages achieved final grades about 7 points higher; were more likely to pass the class; were less likely to earn a D, fail or withdraw; and were less likely to drop other courses across the board. And students using the tool who had lower academic performance in high school were more likely to earn a B or higher and more likely to complete more credit hours at the university.

Student feedback was also positive: 92% said they would recommend using the chatbot in the course as well as extending it to other courses; 77% found the weekly digests helpful, and 70% found the chatbot messages helpful.

"We know that personalized input and feedback from instructors can have a transformative impact on students' academic performance, but that's not always easy to provide in large classroom settings," said Tim Renick, executive director of the National Institute for Student Success and professor at Georgia State University, in a statement. "With the support of a virtual TA that was able to provide just-in-time nudges and answer questions 24/7, students performed at significantly higher levels academically, with the biggest gains enjoyed by first-generation students in the course. This approach is demonstrating the potential of new technology like AI to build a better learning experience for students while reducing equity gaps."

"Too often, students' academic struggles have nothing to do with their intellect or commitment — but rather stem from logistical challenges, like competing family or professional priorities, that cause deadlines to slip," commented Drew Magliozzi, co-founder and CEO of Mainstay. "By using AI to open up new lines of communication with students through empathetic, contextualized conversation, colleges can not only provide an extra layer of proactive support to ensure that fewer things slip through the cracks — but also listen and respond to students at scale, to better ensure that every learner gets the support they need as they navigate their educational journey."

For more information, visit the Mainstay site.

About the Author

Rhea Kelly is editor in chief for Campus Technology, THE Journal, and Spaces4Learning. She can be reached at rkelly@1105media.com.

Featured

  • computer with a red warning icon on its screen, surrounded by digital grids, glowing neural network patterns, and a holographic brain

    Report Highlights Security Risks of Open Source AI

    In these days of rampant ransomware and other cybersecurity exploits, security is paramount to both proprietary and open source AI approaches — and here the open source movement might be susceptible to some inherent drawbacks, such as use of possibly insecure code from unknown sources.

  • pattern of interconnected glowing nodes and lines forming a neural network structure

    Meta AI Releases Open Source Machine Learning Library to Tackle Dataset Management Challenges

    Meta AI has announced LeanUniverse, an open source machine learning (ML) library designed to address the growing challenges of managing datasets in large-scale machine learning projects.

  • modern college building with circuit and brain motifs

    Anthropic Launches Claude for Education

    Anthropic has announced a version of its Claude AI assistant tailored for higher education institutions. Claude for Education "gives academic institutions secure, reliable AI access for their entire community," the company said, to enable colleges and universities to develop and implement AI-enabled approaches across teaching, learning, and administration.

  • glowing brain, connected circuits, and abstract representations of a book and graduation cap on a light gray gradient background

    Snowflake Launches Program to Upskill 100,000 People in Data and AI

    Cloud data platform Snowflake is embarking on an effort to train and certify more than 100,000 users on its AI Data Cloud by 2027. The One Million Minds + One Platform program will provide Snowflake-delivered courses, training materials, and free access to Snowflake software, at no cost to learners.