UC Berkeley enhances computer science education with Azure OpenAI Service

Discover how UC Berkeley uses Azure OpenAI Service to enhance computer science education and prepare students for their future careers.

Editor’s note: Microsoft product marketing managers Haley Mendlin and Victoria Sykes contributed to this story.

Educational leaders are constantly on the lookout for new methods to improve student learning and equip them for future challenges and opportunities. With the swift progress in generative AI, a new range of possibilities has opened up for educational institutions.

The University of California, Berkeley (UC Berkeley) recognized the potential of AI to enhance computer science education, enrich learning experiences, and prepare students for the workplace of the future. They used Azure OpenAI Service to deploy a custom AI chatbot to support student learning and help students with complex coursework. Their experience offers a valuable example of ways to tailor AI to the unique needs and goals of your school.

Benefits of AI in higher education

From the University of Sydney’s AI assistants for teachers to Auburn University’s workshops on building custom chatbots. From enhancing research and practical applications at Georgia Tech to streamlining query responses at the University of South Florida, it’s clear that education continues to evolve with AI innovation.

Here are just a few examples of the many ways that AI can be used to differentiate instruction and enhance student learning:

  • Personalized learning: AI can tailor educational experiences to individual students’ needs, providing personalized feedback and support.
  • Scalability: AI tools can handle large volumes of requests, making them ideal for large classes and education at scale.
  • Constant availability: AI-powered assistants can provide support around the clock, ensuring students have access to help whenever they need it.
  • Efficiency: AI can help with routine tasks, allowing educators to focus on more complex and creative aspects of teaching.
  • Data-driven insights: AI can analyze student performance data to start identifying areas for improvement and optimize learning strategies.

Supporting students with AI innovation

UC Berkeley PhD student, J.D. Zamfirescu-Pereira, together with master’s student Laryn Qi and Electrical Engineering and Computer Science faculty members Narges Norouzi and John DeNero, started looking into ways to build an interactive bot. The bot would be deployed on Azure OpenAI Service, specifically GPT-4 for the classroom, to support students taking the Intro to Computer Science class.

The team developed the 61A-Bot—named after the Intro to Computer Science course—to help students through the rigorous curriculum. The 61A-Bot acts as a specialized chatbot, helping students solve complex problems independently by providing hints whenever they encounter coding challenges.

UC Berkeley enhances computer science education with Azure OpenAI Service
61-A bot providing assistance to students to understand their coding errors, enhancing their learning experience.

“The Azure OpenAI Service provided remarkably high-quality hints generated by GPT-4 from a robust and scalable API that reliably handled heavy loads from hundreds of students working simultaneously near homework deadlines,” says John DeNero, Faculty Director and Associate Teaching Professor.

Deploying a custom AI assistant

UC Berkeley’s 61A-Bot is part of a broader trend of using AI and large language models (LLMs) in education. The deployment occurred over two semesters, where more than 2,000 students made over 100,000 requests to the chatbot. The bot offered one-shot, contextual feedback through both a “Get Help” button within a popular code editor and a “get feedback” feature within the command-line auto grader.

This innovative approach not only reduced homework completion times but also increased the availability of support options for students. Students who used the bot experienced significant reductions in homework completion times, seeing reductions of over 30 minutes. The immediate support provided by the bot was especially appreciated during late-night study sessions.

The benefits of 61A-Bot are far-reaching—from debugging help and personalized feedback to generating course materials and answering forum questions. The bot significantly reduced homework completion times and increased opportunities for students to receive real-time feedback. UC Berkeley has demonstrated how AI tools like those created by using Azure OpenAI Service are becoming integral to educational institutions.

Enhancing learning experiences with AI

As educational institutions continue to explore AI’s role in the classroom, it’s crucial to prioritize tools that make learning more efficient. The journey of 61A-Bot is a testament to the transformative power of AI and an example of thoughtful integration to enhance education.

A key ingredient of successful education is to ensure that students are spending their time effectively. AI tools that provide individualized guidance and feedback can help students make continuous progress in learning new material and tackle challenging assignments with confidence.

John DeNero, Faculty Director and Associate Teaching Professor, UC Berkeley

To evaluate the impact of introducing 61A-Bot, the research team sought to answer three key questions: whether the hints provided by the bot helped students improve their code, how effectively the hints captured problems in student code, and whether the issues resolved by students were the same as those addressed in the hints. The results were highly encouraging, demonstrating how the bot can help enhance learning experiences and support students in their academic journey.

Gaining practical experience

Through ingenuity and dedication, the faculty and students at UC Berkeley created a tool that not only helped make learning more efficient but also helped foster a sense of independence and confidence among their peers. Their tailored implementation of a specialized chatbot provided students with valuable opportunities to gain experience with AI in a secure, controlled setting, which will be increasingly important for their future careers.

“Generative AI needs to be deployed thoughtfully and carefully in order to have a positive impact on education, and this work is urgent because we’ve observed that many students will use AI on their assignments no matter what—whether it helps or hurts their learning,” says DeNero. “Therefore, quickly developing helpful ways of using AI is a critical need, and Azure OpenAI Service allowed us to make very fast progress at scale in UC Berkeley’s largest introductory computer science course.”

This is an exciting example of how schools can responsibly and securely incorporate generative AI tools into their teaching methods. By adopting this transformative technology, you can enhance educational outcomes and prepare students for the workplace of the future.

Explore and share these AI resources:

  • AI in Education Report: Learn more about the need for bridging the AI literacy gap and starting AI conversations in our AI in Education Report.
  • Microsoft Education AI Toolkit: Designed to guide school leaders through the process of integrating AI into their school’s operations and building robust plans for your organization.
  • Worklab: Discover the latest research insights on the future of work and generative AI