AI Characters in the MUD Metaverse
Welcome to the frontier where Artificial Intelligence converges with immersive virtual reality! Get ready for a hands-on workshop that pulls back the curtain on creating AI characters that don't just exist-they react, talk, and live within the MUD Metaverse.
Make characters that think & talk
Welcome to the frontier where Artificial Intelligence converges with immersive virtual reality! Get ready for a hands-on workshop that pulls back the curtain on creating AI characters that don't just exist—they react, talk, and live within the MUD Metaverse. Using the intuitive XR Creator Studio, you'll master the secrets to building agents with a 'brain' (OpenAI), a persistent 'memory', a unique 'personality', and animated 3D 'body', making them feel truly alive and interactive.
We'll show you, step by step, how to fundamentally transform a simple digital model into an interactive being. This is the alchemy of AI character creation, built around four core pillars:
A Brain (Powered by OpenAI)
This is the central nervous system of your agent, granting it the power of genuine cognition. We won't just teach you to connect an API; we'll show you how to harness the incredible language models of OpenAI to give your character the ability to process complex questions, generate natural, human-like dialogue, and make in-the-moment decisions. This brain allows your character to think, making every interaction feel unique and meaningful.
A Personality (Custom Instructions)
We'll dive deep into the art of custom instruction prompting. This is where you set the DNA of your agent—defining its role, its tone (friendly, serious, humorous), and its core knowledge. You'll gain complete control over who your agent is, ensuring it remains consistent, and captivating to users, allowing you to breathe a unique spirit into your digital creation.
A Persistent Memory (So They Remember Things)
You will learn the critical techniques for giving your agent a persistent memory. This allows it to recall past conversations, remember user preferences, and learn from every interaction it has.
A Physical Body (3D Models + Animations)
You'll discover how to seamlessly attach a 3D model to your intelligent core, and how to sync its animations with its thoughts and actions. Imagine your agent turning its head when addressed, gesturing to make a point, or walking to an objective. This final step integrates its mind and body, deploying an AI character that is fully embodied and ready to interact in a live, spatial, and immersive environment.
What You’ll Learn (The Fun Way)
1- Giving Your Agent a Brain (OpenAI Basics)
Your agent needs a brain, and we'll show you the simple, yet powerful, steps to give it one by connecting it directly to the cutting-edge language models from OpenAI—the digital equivalent of a central nervous system. You’ll learn how to:
-
Create an OpenAI account (quick and easy).
-
Get an API key (allows your agent to securely tap into OpenAI's vast knowledge base).
2 - Creating Your AI Character in XR Creator Studio
You'll step inside the XR Creator Studio, the intuitive, visual interface where you design everything that comes to life in the MUD Metaverse. You’ll learn how to:
-
Drop an AI Agent into your virtual scene.
-
Connect conversations to actions and events in the world.
3 - Personality & Instructions (Who Is Your Agent?)
This is the most creative part of the process—where a brilliant brain is given a unique soul. You’ll learn how to define three vital components:
-
Tell your agent who they are. This step is all about setting the role and the context of their existence, ensuring their responses are perfectly in character, every time.
-
Set their tone. The right tone is what separates a friendly, approachable character from a rigid robot.
-
Control what they know and what they should never say. Your agent's focus is its power. You'll learn how to provide a specific knowledge base to keep them on-topic.
4 - Memory: Teaching your agent to remember
Without memory, every conversation is like the first: robotic, frustrating, and ultimately pointless. We'll show you how to architect your agent's memory system so it retains the context of an ongoing conversation. This means your agent won't forget what the user just said two minutes ago, allowing for natural, flowing, and logical dialogue that deepens the user's immersion.
You’ll learn how to:
-
Give your agent memory so conversations make sense.
-
Store things it learns from users.
5 - Giving your agent a body
This is the final, essential step in moving your creation from an intelligent program to an embodied, interactive character in the MUD Metaverse. It's not enough for an AI to just speak; it must exist, move, and react in the world.
-
Attach a 3D character model to your AI, gaining a visual presence that users can see and interact with.
-
Sync animations with talking and events. Imagine your agent turning its head when a user addresses it, using a hand gesture to emphasize a point, or walking to an objective when asked.
instructor
Yoan Escobar brings over a decade of experience in software engineering, with a diverse background that includes interactive application development in VR/AR, machine learning, computer vision, web technologies, and system integration. Throughout his career, he has led and mentored cross-functional teams while continuously learning alongside them. He believes that strong teams grow through collaboration, active communication, knowledge sharing, and continuous self-improvement.
Workshop Format
01 | Format Overview
-
Duration: 1 Hour.
-
Instruction Level: Beginner → Intermediate. The workshop is structured to accommodate those new to AI character creation while providing depth for intermediate builders.
-
Prerequisites: No prior experience with Artificial Intelligence (AI) or large language models is required.
02 | Essential Tools and Platforms
Participants will gain hands-on experience utilizing the following platforms and assets:
-
XR Creator Studio: The primary visual development interface for building and deploying AI Agents.
-
OpenAI Dashboard: Used for account creation and securing the necessary API key to enable cognitive function.
-
MUD Metaverse Platform: The live, immersive environment where the final AI characters will be tested and deployed.
-
Ready-to-Use Assets: Access to pre-configured 3D character models and animation sets to streamline the embodiment process.
What You’ll Walk Away With
By the end of this hands-on workshop, you will not only understand the theory but will have practical, valuable skills to apply immediately. You’ll be able to:
-
Design and Construct a Complete AI Character: Build a fully-functional, intelligent agent from the ground up, ready for deployment inside the MUD Metaverse.
-
Master Personality Control: Utilize custom instruction prompting to define and control your agent’s unique personality, tone, and core knowledge base, ensuring every interaction is perfectly in character.
-
Implement Persistent Memory: Architect memory systems that enable your agent to maintain context, recall user preferences, and feel consistent and smart across all conversations.
-
Achieve Embodied Presence: Seamlessly integrate a 3D character model, syncing its complex animations and movements with its dialogue for a truly believable and spatial presence.
-
Deploy and Test in a Live XR Environment: Successfully test, debug, and deploy your custom AI Agent, making it instantly interactive in a live, extended reality world.
Who This Is For: Your Tribe of Builders
This hands-on workshop is specifically designed for visionary creators ready to move beyond theory and build the next generation of interactive experiences. It is perfect for:
-
Welcome to the frontier where Artificial Intelligence converges with immersive virtual reality! Get ready for a hands-on workshop that pulls back the curtain on creating AI characters that don't just exist-they react, talk, and live within the MUD Metaverse.
-
Game Developers: Developers looking to integrate cutting-edge, dynamic NPC dialogue and behavior, transforming their game narrative and player engagement.
-
AI and Prompt Enthusiasts: Anyone fascinated by large language models who wants to move from simple text prompts to controlling a fully embodied, intelligent agent in a 3D world.
-
Educators & Storytellers: Professionals seeking to build next-level, interactive learning environments, historical simulations, or compelling narrative experiences with living, thinking characters.
-
Anyone Who Wants to Build Interactive Worlds: If your objective is to create spaces where users feel a sense of presence and connection with digital inhabitants, this workshop provides the essential, practical skills you need.
XRCAMP WINTER 2025 HUB
Rainbow Music Land
Steal A Brainrot
Pertend Hard Rock Stadium
White Gallery
Cats and Kittysss
Gallery
alexxxxx
basement
DOGS:3
The Workshop
Very New
F1 Race
Creepy Place
Sound of Art
Soccer Staidium
Grass Big
Ice Cream
Main Room
Roseyyyy
Bunbun and Zitzy
Im Insane:)
Fever Dream
The Under World
Elf on the Job
XR Controls Overview
Getting started? Select your device to see the basic controls.
Use arrows or W, A, S, D
Use W, A, S, D + Hold Shift
Use Q and E or left mouse button
Right mouse button
Left mouse button
Use the joystick
Touch + Drag
Touch
Left controller thumbstick
B or Y buttons to move faster
Right controller thumbstick
Right controller trigger
Left or Right controller trigger
Free access Program
Participation is free, but registration is required. Space is limited to 25 students. Parents will receive a confirmation email or phone call once registration is processed.
XRcamp
XRCamp ART + TECH is a program by MUD Foundation that utilizes the internet and WebXR as a medium for the exploration and creation of immersive practices at the crossroads of art and technology. XRCamp provides participants an opportunity to explore the possibilities of creating art using emerging technologies in a hands-on workshop environment.
SUPPORT MUD FOUNDATION PROGRAMS AND DIGITAL INFRASTRUCTURE FOR THE ARTS AND EDUCATION
MUD Foundation empowers artists, communities, and organizations to create and connect through accessible digital infrastructure, XR technology, and critical media programs. Your donation fuels innovation, education, and cultural engagement, helping our platforms, exhibitions, and workshops stay open and accessible to all.
Why Donate?
-
Make cutting-edge art and technology accessible for everyone.
-
Strengthen digital education and creative youth programs.
-
Expand critical media initiatives addressing the impact of technology on society.
-
Enable artists and organizations to collaborate and connect across digital spaces.
-
Support public art and immersive media that reshape the experience of culture in our communities.
-
Provide access to specialized venue space and technology for creative production.
-
Fund scholarships and outreach for youth and underserved artists.
-
Develop and maintain open-source XR platforms for the broader community.
Sponsors
