Project case study
A digital employee who guides the museum
A full-height holographic character who quizzes visitors by voice and then answers any question about the museum from its own knowledge base.
- Client
- Museum of the Ministry of Finance of Russia
- Completed
The challenge
The first interactive zone of the museum had to welcome visitors, involve them in the history of the ministry and then answer whatever they want to know — in natural speech, without a keyboard in sight.
What Awake! delivered
The character’s behaviour is assembled from video states: idle, introduction, question, listening, reactions, answers and farewell. The visitor answers out loud; Whisper recognises the speech, and the AI classifies the answer — yes, no, “I don’t know”, unclear, “later” — and triggers the matching reaction. After two quiz questions the guide switches to open conversation by voice or text, and ChatGPT answers from the museum’s knowledge base with built-in moderation. We went through many iterations on site: skip buttons, three farewells, transitions, sounds — and re-laid the interface when the screen turned out to be mounted higher than planned.
Outcome
The digital employee became the opening interactive of the museum and works as a guide that never runs out of answers.
Technologies and methods
Unity, Whisper speech recognition, ChatGPT with a museum knowledge base, video state machine, holographic display