ONEIDA COUNTY, N.Y. (WUTR-TV) — SUNY Polytechnic Institute has begun research on the use of artificial intelligence in classrooms.
“The basic gist of it is we’re trying to recognize the emotional states that a student is feeling while they are using virtual reality or augmented reality in the classroom.” – Dr. Michael Reale, Asistant Professor of Computer Science, SUNY Polytechnic Institute
Dr. Reale says that in order for professors to be able to correctly respond to how a student is performing in class, they need to understand how the student is feeling.
“The goal here is to have a device that’s on the virtual or augmented reality headset such that it recognizes the emotional state of the student, and for this particular project we are targeting what are called non-standard expressions.” – Dr. Michael Reale, Asistant Professor of Computer Science, SUNY Polytechnic Institute
The project has 2 phases. The first part is building a database of students using virtual reality headsets and recording video and audio from their facial expressions. The second part will take the information from the database to train an artificail intelligence system to assess their students engagement in classrooms.
“We’re getting multiple depth images and sort of stitching them together to get a point cloud where we have all of these little points in space and that’s a lot more challenging and process and to figure out surface of the face. What we’ve been doing is working with different kinds of neuronetwork models to process point clouds specifically targeted towards facial expression.” – Dr. Michael Reale, Asistant Professor of Computer Science, SUNY Polytechnic Institute
Dr. Reale says they’re aiming to having the project complete and being studied in classrooms by next year.