Back To Projects

Predicting emotion ratings from color statistics of images

Claire M.

We utilized this data to see how visual elements affect our everyday lives by engineering features of images and running that through a variety of neural networks.


Which features in art affect emotional reactions? In order to answer this question, we took a variety of abstract images and included people’s emotional ratings for each image, for eight different emotions. We utilized this data to see how visual elements affect our everyday lives by engineering features of images and running that through a variety of neural networks. Out of all the networks we ran our data through, the linear regression model performed the best with a mean average error of around 1.4. All the other neural networks, including a convolutional neural network, had a mean average error of at least 1.7. The full-size linear regression model with all engineered features worked best in predicting the emotional values associated with each image. That is, all specific features were significant and we did not find meaningful differences among the models for different emotion ratings.

Explore More!

Claire M.
Clayton Greenberg
Teaching Professor from UPenn

Related Projects

Detecting Facial Expressions

This paper shows that machine learning algorithms can be used in order to classify emotions into different categories. The most promising results were from the K-nearest neighbor model, with 61.5% accuracy in the training set, and 32.1% accuracy in the testing set.
Bertran M.
Mentored by Odysseas Drosis
Utilizing Artificial Intelligence for the Identification of Students with Depression and Anxiety through Social Media Analysis

In response to the escalating concerns about the mental well-being of students, this research represents a significant stride in utilizing artificial intelligence (AI) to discern individuals experiencing depression and anxiety through their social media comments.
Taneesh S.
Mentored by
How Does One’s Background Determine Their Mental State?

Mental health issues have become very prevalent in recent times, and although significant progress has been made in terms of treatment in the form of counseling, medication, and other methods, in order to truly find out the root cause of many mental health issues, a correlation has to be drawn between one’s mental state and another factor, such as family history, age, work environment, etc. It is also beneficial to correlate one’s mental state with a multitude of factors to see the compilation.
Sohum T.
Mentored by Akshay Jagadeesh