Background shadow
EmpAI Logo
Empathetic AI
Empathetic AI

Using AI to Visualize the Emotional Impact of Online Media

Using AI to Visualize the Emotional Impact of Online Media

EmpAI Mobile UI
EmpAI Mobile UI

Client

Pinchuk Art Centre

Client

Pinchuk Art Centre

Service

End-to-end product design, art direction, project management

Service

End-to-end product design, art direction, project management

Date

December 2017 - March 2018

Date

December 2017 - March 2018

Overview:

Project Overview

In 2017, during the early stages of AI, I recognized its potential to predict, filter, and personalize online content. Amid the escalating information war between Ukraine and Russia, I aimed to highlight how media manipulates emotions and shapes perceptions. The project used AI to analyze news sentiment and visualize predicted human reactions through a 3D video simulation of a Ukrainian family responding to online media stimuli.

Design Challenges & Technical Constraints

Design Challenge: Translating complex human emotions into an immersive multimedia experience.

  • I developed a 3D simulation with NPCs (non-player characters) that reacted to eight primary human emotions.

  • Characters exhibited behaviors through animations, sounds, and text based on AI-detected emotions.

Technical Constraints: Limited AI capabilities in 2017.

  • My team pivoted from analyzing all multimedia content to focusing solely on text-based news websites, adapting to the AI limitations of that time.

  • We used pre-generated dialogue based on sentiment analysis of 1,000 news articles to reduce processing costs.

  • Initially focused on English-language resources, we expanded to Ukrainian and Russian content using Google Translate, and later, adapted to new challenges by switching to StarDict.

Solution & Key Features

  • Emotion Detection: AI analyzed text for primary emotions using the DepecheMood dataset.

  • Visualization: The 3D characters displayed behaviors matching the detected emotions. An LED display showcased news headlines while the simulation ran.

Results & Impact

🚀 Engagement: 25% increase at the Pinchuk Art Center.

📸 Media Coverage: Featured in Vogue Ukraine, sparking discussions about AI's role in media.

✨ Audience Feedback: Viewers reported increased mindfulness of their media consumption habits.

Reflections & Future Vision

  • Learning: Simplified technology and pre-generated content helped overcome early AI limitations.

  • Today’s Approach: I would leverage modern tools like OpenAI or Meta’s models for real-time sentiment analysis of multimedia content, including video.

  • Enhancements: Adding interactive features to allow viewers to provide feedback and contribute to AI training.

EmpAI Project Iterations
EmpAI Project Iterations
EmpAI Project Scheme
EmpAI Project Scheme
EmpAI media coverage
EmpAI media coverage
EmpAI Phone UI
EmpAI Phone UI