DESIGN NAME: Flow
PRIMARY FUNCTION: Interactive Generative Art
INSPIRATION: Thinking about the limitations of current AI art generators. In addition to inputting cue words, in what other ways can we influence the generation of AI artworks? How can the general audience (non-professional practitioners) experience the fascination brought by AI-produced art? I achieve real-time interaction between viewers and AI artworks by introducing the fastest-generating AI macromodels into Touch Desiger, so that the experiencers can interact with the AI artworks through the camera.
UNIQUE PROPERTIES / PROJECT DESCRIPTION: "Flow" is a new attempt for interactive art in the field of AI, which realises real-time interaction between the audience and AI artworks by introducing large models of generative art and motion capture technology. After the audience inputs the description of the image, the AI artwork can be generated on the screen in real time without additional waiting, and the audience can influence the formed AI artwork through the change of body movement, so that it is no longer just a static picture.
OPERATION / FLOW / INTERACTION: Enter prompts to generate images in real time, and wave your hands or any body movement to change and interact with the generated images.
PROJECT DURATION AND LOCATION: -
|
PRODUCTION / REALIZATION TECHNOLOGY: Plug-ins are made by writing Python code in Touch Designer to connect to the API port of the large model to get the big model. Create visual effects such as particles in Touch Designer to visually process the generated images. And access the camera port to capture the audience's movement in real time, and convert the movement into data in Touch Designer to influence the effect of the generated image.
SPECIFICATIONS / TECHNICAL PROPERTIES: In order to realise real-time interaction between AI art and the viewer, large models with low resolution but fast generation speeds, such as SD turbo, need to be selected. At the same time, considering the smoothness of response and ensuring proper resolution, I preset the resolution of the generated image to 500×500 so that the FPS can be kept around 10 when the viewer interacts with the screen.
TAGS: AI, Interactive Art, Digital Art, Generative Art
RESEARCH ABSTRACT: -
CHALLENGE: The challenge in the development of this project was how to combine the large model with the digital creative tool TouchDesigner, and how to make the generation of the images smoother and more interactive with the audience. In order to achieve the effect of real-time generation without waiting, the picture quality of the generated images needed to be sacrificed, but I used digital art techniques to secondary process to achieve a better visual effect.
ADDED DATE: 2024-06-15 21:22:46
TEAM MEMBERS (1) :
IMAGE CREDITS: Image #1: Creator Yuming Chen
Image #2: Creator Yuming Chen
Image #3: Creator Yuming Chen
Image #4: Creator Yuming Chen
Image #5: Creator Yuming Chen
Video Credits: Yuming Chen
|