Mobile Photogrammetry for WebXR
Photogrammetry is the process of creating 3D models from photographs. With advances in mobile phone technology, it is now possible to generate high-quality 3D models using just a smartphone.
Mobile Photogrammetry for WebXR
Join us for a free, hands-on workshop designed for artists, educators, and cultural preservation practitioners interested in immersive technology, digital archival preservation, and digital storytelling.
Learn how to capture real-world objects and environments using just your smartphone and transform them into interactive 3D experiences for the web.
Participants will explore mobile photogrammetry using the Abound app, process their models in Blender, and publish them on the Mud Foundation’s WebXR platform. No prior experience required, just bring a modern mobile phone and a laptop with Blender installed.
Discover how accessible tools can bring art, history, and science to life, in cultural organizations and the classrooms through immersive 3D content.
instructor
Eric Hupe is an Assistant Professor of Art History at Lafayette College and the director of ZeuxisVR: Immersive Art History. He specializes in Italian Renaissance art, with a focus on the intersections of art, optical science, and theology in early modern Italy. This research has been published in Predella, Source: Notes in the History of Art, and Artibus et Historiae. Through ZeuxisVR, Hupe leads a digital initiative that creates virtual reality environments of cultural sites and develops open educational resources, enhancing art history pedagogy by making cultural heritage accessible to a broader audience.
Recommended Photogrammetry Apps
Several apps are available for mobile photogrammetry, each with its own features and capabilities. Below are some of the best options:
Polycam (iOS & Android)
-
Offers both LiDAR (for supported iPhones) and photogrammetry options.
-
Cloud processing for high-quality results.
-
Ideal for capturing objects and spaces.
RealityScan (iOS & Android)
-
Developed by Epic Games.
-
User-friendly interface with guided capture process.
-
Integrates with Sketchfab for sharing models.
Abound (iOS and Android)
-
Optimized for LiDAR-enabled devices.
-
Supports exporting to multiple 3D formats.
-
Developed by Metashape.
When scanning individual objects, follow these steps to achieve the best results:
-
Lighting: Ensure even, natural lighting without harsh shadows or reflections.
-
Background: Use a neutral background or place the object on a non-reflective surface.
-
Camera Movement: Move around the object in a circular path, capturing overlapping images from multiple angles. See diagrams.
-
Angles: Take photos from high, mid, and low angles to cover all details. See diagrams.
-
Number of Images: Capture at least 50-100 images for complex objects.
-
Avoid Blur: Keep the camera steady and use a tripod or stabilizer if necessary.
For interior photogrammetry, use these techniques:
-
Lighting: Utilize ambient and artificial light sources to evenly illuminate the space.
-
Camera Path: Walk slowly and capture overlapping images while maintaining a steady height. Move around the perimeter of the room and shoot across the space from different heights and different angles. See diagrams.
-
Overlapping Images: Ensure at least 60-70% overlap between consecutive shots.
-
Focus on Details: Capture additional images of textures, artwork, or intricate architectural elements.
-
Avoid Moving Objects: Ensure there are no moving people, pets, or objects to prevent reconstruction errors.
-
Use a Wide Field of View: If available, use your phone's ultra-wide camera to capture more context in each shot.
Once a 3D model is created, optimizing it for WebXR applications ensures smooth performance and accessibility across different devices. Below are key optimization techniques:
-
Automated Mesh Simplification: Use tools like MeshLab, Blender’s Decimate Modifier, or app-based automation features to reduce polygon count while preserving details. (Intermediate/Advanced)
-
Texture Optimization: Compress textures using formats like JPEG or WebP to minimize file size without sacrificing quality. Attempt to have no more than eight 4k textures.
-
GLTF/GLB Format: Convert models to GLTF/GLB, the preferred format for WebXR, which offers efficient compression and better compatibility.
-
Cloud-Based Processing: Utilize services like RapidPipline or convrse.ai optimization tools to prepare models for web display. (Beginner/Intermediate)
-
Automated Pipelines: Some photogrammetry apps include automated optimization features that handle decimation, texture baking, and WebXR export with minimal user intervention.
By integrating these techniques, 3D models can be efficiently displayed in WebXR environments, ensuring seamless interaction and accessibility on VR headsets, mobile devices, and web browsers.
Photogrammetry with a mobile phone is an accessible and powerful tool for creating 3D models. By selecting the right app and following best practices for capturing images, you can generate high-quality reconstructions of objects and interior spaces. Experiment with different techniques and settings to optimize your results.
Verse
mud-ai-agents
Step into the frontier of immersive intelligence. In this hands-on workshop, participants will learn how to build intelligent, interactive AI agents inside the MUD Metaverse using XR Creator Studio. Leveraging the power of OpenAI’s API, this session will guide you through creating fully contextual, visually embodied agents capable of dynamic conversation and world interaction.
XR Controls Overview
Getting started? Select your device to see the basic controls.
Use arrows or W, A, S, D
Use W, A, S, D + Hold Shift
Use Q and E or left mouse button
Right mouse button
Left mouse button
Use the joystick
Touch + Drag
Touch
Left controller thumbstick
B or Y buttons to move faster
Right controller thumbstick
Right controller trigger
Left or Right controller trigger
SUPPORT MUD FOUNDATION EVENTS AND PROGRAMS
Tech-Centered Art, Art Creation, and XR Art Access: Together, let's build the future of art on digital media. By supporting our art + tech programs, our vibrant art-tech community, and the XR tech infrastructure of our non-profit community partners, we're ensuring that our programs remain accessible to everyone, becoming a collaborative ecosystem for all!
Your contributions go to the MUD Foundation INC, a 501(c)(3) organization based in Miami, Florida, and are used at our discretion for charitable purposes. They are tax-deductible in the U.S. to the fullest extent permitted by law.
Sponsors
