Labyss

Speech Recognition Program x ChatGPT x Text-To-Video AI
(SPOTLIGHT 2024 @ Tai Kwun)

Labyss , part of the art programs of SPOTLIGHT 2024 at Tai Kwun, is an interactive performative installation in which the audience experiences a fictitious company where they can share and store their memories. 


Labyss 是2024年大舘SPOTLIGHT的其中一個藝術項目。在這個互動表演中,觀衆會沉浸體驗一個虛構的科技公司,並將自己的記憶儲存在其中。

In the experience, the audience is required to answer the questions given by the custom program about their memories or past experience, and at the end of the experience, they will see their memories visualized by AI projected on the wall. 

The program involves multiple functions including:
– Recognizing speech in Cantonese, mandarin, and English,
– Generating new questions focusing on memories and experiences based on audiences’ answers,
– Creating prompts for visualizing the memories, 
– Visualizing the memories and animating them on the outputted canvas. 

OpenAI whisper, finetuned ChatGPT, Stream Diffusion are used in the software.


在這個體驗中,觀衆需要回答一些由程序提供的問題,問題聚焦於他/她的記憶或過去的經歷。在體驗的最後,觀衆將會在房間内看到他們/她們的記憶如何被人工智能詮釋與視覺化。

這個程序包含的功能有:
– 識別觀衆在記憶采訪室中訴説的内容
– 生成關於他們/她們的記憶或者過往經歷的新的問題
– 生成用於生成記憶影像的提示詞
– 將記憶視覺化並生成影像

程序使用的AI有:OpenAI Whisper,ChatGPT微調模型,Stream Diffusion。

Concept: The Algorithmic Theatre
Text and Direction: Kristian Husted, Kristian Byskov
Director: Kristian Husted
Dramaturg: Pernille Kragh
Creative Partner: The Collective
Software Programming: Yoki Yao – The Collective
Assistant Director and Adaptation: Vida Wu