ERAS: Bridging the Gap Between Code and Emotion in Spanish Learning Environments

A Corpus for Sentiment Analysis and Emotion Recognition for a Learning Environment

2018-07-01
Raúl Oramas Bustillos, María Lucía Barrón-Estrada, Ramón Zataraín-Cabada, Sandra Lucia Ramírez-Ávila
Summary
Problem
Method
Results
Takeaways
Abstract

This paper presents the development of the Educational Resources Assessment System (ERAS) and a corresponding Spanish-language corpus for Sentiment Analysis and Emotion Recognition in programming education. It introduces a specialized dataset categorized by learning-centered emotions (frustration, boredom, excitement, engagement) and evaluates various ML classifiers, identifying Bernoulli Naive Bayes as the top performer with 76.77% baseline accuracy.

TL;DR

Researchers have developed the Educational Resources Assessment System (ERAS) to capture how students feel while learning to code. By building a first-of-its-kind Spanish corpus labeled with learning-specific emotions like frustration and engagement, the study paves the way for Intelligent Tutoring Systems (ITS) that don't just teach—they empathize.

Background: Beyond "Happy" or "Sad"

In the world of AI education, recognizing that a student is "angry" isn't as helpful as recognizing they are frustrated by a specific recursion exercise. Existing Sentiment Analysis (SA) tools are often general-purpose and English-centric. The authors of this paper identify a critical vacuum: the lack of Spanish-language resources that focus on learning-centered emotions, which are the true drivers of information retention and cognitive success.

Methodology: The ERAS Framework

The researchers developed a multi-stage pipeline to transform raw student opinions into a structured dataset for machine learning.

1. Data Collection (ERAS)

Students interact with programming learning objects (videos, text, images). After consuming the content, they provide a textual opinion and tag it with one of five emotions: Frustrated, Bored, Neutral, Excited, or Engagement.

2. The Sentiment Analysis Module

The authors compared several classical Machine Learning architectures. The process follows a standard but robust NLP pipeline:

  • Pre-processing: Normalization, tokenization, and stemming of Spanish text.
  • Weighting: Generating a TF-IDF matrix (Term Frequency-Inverse Document Frequency) to quantify the importance of specific pedagogical terms.
  • Classification: Testing algorithms including SVM, KNN, and Naive Bayes.

Model Architecture and Pipeline Figure 1: The ERAS system loop—from student interaction to emotion registration.

Experimental Insights & SOTA Comparison

The study evaluated six different classifiers. Interestingly, the Bernoulli Naive Bayes (BNB) emerged as the most robust, particularly for handling text features.

ClassifierAccuracy (TASS)
Bernoulli NB76.77%
SGDC Classifier76.69%
SVC75.79%
KNN68.46%

However, the transition from general text (TASS) to the niche educational corpus was challenging. The accuracy dropped to 40.70% on the newly created dataset.

The "Positivity Bias" Problem

A key finding of the research was the extreme imbalance in student feedback. Students were overwhelmingly positive (754 vs. 97 negative comments).

Distribution of Emotions Figure 2: The distribution reveals a heavy bias towards positive emotions like Engagement and Excitement.

The authors argue that this "neutral/excited" tendency is an obstacle for training robust AI. To build a truly intelligent system, we must "induce students to write negative comments" to capture the nuances of where learning breaks down.

Critical Analysis & Future Outlook

This work serves as a foundational step for Spanish-speaking Intelligent Learning Environments (ILE). While the current accuracy on the internal corpus is modest, the methodology proves that we can quantify subjective learning experiences.

  • The SOTA Edge: Unlike general sentiment tools, this approach explicitly links emotions to specific learning formats (Video vs. Image-Text), allowing teachers to see exactly which resources cause frustration.
  • Limitations: The corpus size remains small (851 entries), and the gender imbalance (45 male vs. 8 female) might introduce demographic bias in linguistic expression.
  • The Next Leap: Integration with actual Intelligent Tutoring Systems will allow for real-time pedagogical adjustments—switching a video to a text format if the system detects the student is becoming "bored" or "frustrated."

Takeaway

The future of AI in the classroom isn't just about better content; it’s about better listening. By focusing on Spanish learning-centered emotions, ERAS provides the raw data needed to make digital tutors as perceptive as human ones.

Find Similar Papers

Try Our Examples

  • Search for recent papers focusing on "learning-centered emotions" detection in Intelligent Tutoring Systems beyond basic Ekman emotions.
  • Which studies first defined the distinction between Sentiment Analysis and Opinion Mining in the context of educational feedback?
  • Examine how data augmentation or synthetic data generation (like SMOTE or LLMs) is being used to fix class imbalance in small-scale educational sentiment datasets.
Contents
ERAS: Bridging the Gap Between Code and Emotion in Spanish Learning Environments
1. TL;DR
2. Background: Beyond "Happy" or "Sad"
3. Methodology: The ERAS Framework
3.1. 1. Data Collection (ERAS)
3.2. 2. The Sentiment Analysis Module
4. Experimental Insights & SOTA Comparison
5. The "Positivity Bias" Problem
6. Critical Analysis & Future Outlook
7. Takeaway