top of page

co-creative story

Co-creative System to Generate More Creative Story

System Description

The problem of story generation involves multiple participants collaborating in order to create a story. We present a co-creative system such that an AI agent is capable of generating a visual story while collaborating with the user. In our proposed system, a user starts providing a storyline and the agent responds by providing an image to create a scene. The goal of the system is to respond with a creative visual story by introducing a surprising sense to the user.

 

My Role: 

I designed user interface and developed high fidelity prototype. I designed a pilot user study in Wizard of Oz condition to examine the impact of the co-creative agent on the user in making up a story and the process in which the user develops the story.

Design Goal

Creative storytelling is hard. For example, telling a creative story is a difficult task that requires a variety of knowledge and cognitive processes: knowledge about themes, writing techniques, and presentation; processes such as planning, problem-solving, recall and creativity. We came up with the concept of addressing unexpectedness situation to design Co-Story system to evoke user’s curiosity and help users to build a creative story.

goal.png

System Design

Co-story is designed to help user’s creative storytelling process. In order to interact with the system, a user provides the system with input by saying the storyline. Based on the sentences provided by the user, the co-creative agent recognizes words and provides visual elements to compose a scene. User can create scenes just by arranging the visual elements provided. The co-creative agent continuously stimulates the user’s curiosity and brings unexpected situations. Users are given unexpected stimuli in various ways while they interact with the Co-Story. If the story deviates from what they expected, and if they receive unexpected visual feedback, its effect inspires them, which affect them in creative thoughts and help them to build a creative story.

Interface Design

interface.png

User Experience

ezgif.com-gif-maker (1).gif

User Study

Wizard of Oz

We designed a pilot user study in Wizard of Oz condition to examine the impact of the co-creative agent on the user in making up a story and the process in which the user develops the story. We used google slide for wizard of Oz study. It allows us to edit, add images and animations, and modify any user’s input in real-time. Two wizards and a participant can work together in the same presentation at the same time. The first wizard plays a role as story database and second wizard as cartoon image database.

Picture9.png

We recruited 5 participants. The user would then build on the story with collaboration from the agent while the study is being video recorded. We provided the opening line of a famous American childhood story called “Jack and the beanstalk” along with an opening image of the scene

Analysis

Final-IUI-39.jpg
Final-IUI-40.jpg

  • Co-Story could help users think in various ways, stimulate their interest, and let them make creative stories more easily.

  • Hard to generalize the study results. Comparative within-experiments could prove the effects of Co-Story on storytelling based on more reliable data

  • Important to produce database in the future and provide feedbacks based on more accurate data to maintain consistency

  • Improve visual feedbacks

  • Make clear co-creative agent contribution

  • Other interaction feedbacks : Sounds, animations, lights

bottom of page