How AI and AR turned a simple conference guide into an adventure
Explore how Shift Quest transformed the Infobip Shift conference in Zadar by combining voice commands, AR, and interactive quests, creating a dynamic experience that blended utility with engaging gameplay.
So, what exactly is Shift Quest?
Shift Quest is an interactive AI assistant built exclusively for the Shift Conference in Zadar in 2024, designed to merge functionality with fun.
Imagine a typical conference guide, but instead of dry schedules and maps, it invites you on a gamified adventure – Shift Quest becomes your companion, guiding you, sparking curiosity, and making the whole experience way more fun and interactive.
Its primary role was to help participants navigate the event while offering fun “quests” to complete, allowing attendees to interact using voice commands and engage with AR elements.
Now, let’s take a deep dive into the behind-the-scenes of this chatbot.
Building Shift Quest: AI, AR, and Voice Integration in Action
Kristijan Opacak, AI Digital Customer Success Associate at Infobip and part of the Shift Quest team, summed it up: the results were impressive.
“Shift Quest attracted more participants than expected, with many spending significant time exploring the event. Feedback was positive, with attendees enjoying the mix of helpful guidance and playful elements. It kept people engaged and connected to the conference.”
What set Shift Quest apart was its combination of conversational AI, voice recognition, and augmented reality (AR).
“Attendees could complete quests, collect virtual items, and explore the conference, making it more interactive. Voice commands and AR made it feel like part of an ongoing story – both fun and useful.”
This tech combo sets Shift Quest apart from typical event chatbots, offering more than just text-based interactions. The use of voice commands for natural communication and AR for immersive experiences made it a richer, game-like tool that other chatbots lacked.
Biggest challenge? Making AR and voice work seamlessly
But from a development perspective, it wasn’t all fun and games.
As Opacak explains, one of the biggest challenges for Infobip and Inner Reality team was integrating AR and voice technology in a seamless and responsive way.
“We wanted real-time responses, which meant optimizing API calls and fine-tuning the voice engine to handle different accents and speech patterns.
It took some trial and error, but we were able to improve performance and ensure everything ran smoothly. This was achieved through constant testing and adjustments, which allowed us to deliver a high-quality experience by the time the event came around.”
Real-time communication was key to making Shift Quest feel engaging and alive.
“This responsiveness kept the experience dynamic and connected, ensuring users remained engaged and always had fresh challenges based on real-time conditions.”
Key lessons for developers
For developers, the key takeaway is clear: don’t limit yourself to just text.
Integrate technologies like AR and voice to create a more engaging experience. It’s also crucial to design with flexibility in mind, ensuring the chatbot adapts to various user needs and feels personalized.
Ultimately, a successful chatbot strikes the right balance between cutting-edge technology and a seamless, user-friendly experience.