How to use XR Tour feature?

What's XR?

XR is an end-to-end (client-to-web) 3D Gaussian Splatting service introduced by D5 Render. Users can set up camera matrix templates within D5 Render's scene to capture multiple photos of a model or environment from various angles. These images can then be uploaded to the D5 server, where machine learning processes reconstruct them into a shareable and browsable 3D file online.

Cases↓

UE Science Fiction Architecture

Perspective from the Peak

A simplified explanation: What is 3DGS?

Imagine recording a video of a room with your phone. Traditional methods might produce a basic 3D model, but it would lack detail and render slowly. In contrast, 3DGS represents each point in the scene as a "fuzzy ball" defined by its color, position, size, and transparency (using Gaussian functions). These fuzzy balls are then projected onto 2D images for rendering, enabling fast and high-quality 3D reconstruction.

This approach resembles treating each point in the scene as a light spot and reconstructing the entire scene by overlaying these spots. Leveraging the characteristics of Gaussian functions, the rendered images exhibit smooth edges, intricate details, and realistic visual effects.

Why is this technology important?

● High quality: Compared to traditional methods, 3DGS can more realistically reproduce scene details and lighting effects.

● Real-time rendering: Using GPU acceleration, 3DGS can achieve real-time rendering at over 30 frames per second, making it suitable for applications such as virtual reality (VR) and augmented reality (AR) that require instant feedback.

● Low cost: Using ordinary photos or videos, without the need for expensive equipment or complex modeling processes, ordinary users can easily generate high-quality 3D content.

Render XR files in D5 Render & upload to server for training

Click on the "TOUR/XR TOUR" option in the menu in the upper right corner, then click Edit to enter edit mode

When entering edit mode for the first time, the user needs to click on a location in the scene with the mouse to initialize the initial center point of the camera matrix template.

Edit Window

The essence of a camera template is that many cameras are evenly distributed on the surface of an object, with all cameras facing the same viewpoint. The position and size are adjusted so that the object being photographed is located as close as possible to the center of the camera template.

Template Types

Hemispherical Template: Ideal for capturing architectural structures.
Spherical Template: Best suited for photographing products or other objects requiring a 360-degree view.

Shooting Precision

Medium Precision: Hemispherical Template (~70 shots), Spherical Template (~140 shots).
High Precision: Hemispherical Template (~300 shots), Spherical Template (~600 shots).

4. Preview Window

After switching to the "Preview Window", users can switch between preview tabs using the WASD shortcut keys to preview the final rendering effect of each camera angle and apply uniform parameter adjustments.

After adjusting the shooting details, click “Render” to bring up the rendering settings pop-up window. Select the storage location and resolution, then click to start rendering.

After rendering locally, you can upload it to the D5 Showreel platform with one click to initiate a 3D Gaussian Splatting training submission. Once training is complete, the system will automatically send an email notification to the user to view the training results.

XR Local Client Operation Workflow Display

Hemispherical template workflow

To create a refined architectural bird's-eye XR tour, users can utilize the clipping tool to trim the D5 scene intended for 3D reconstruction, ensuring that the core building is positioned as centrally as possible within the scene.

Select the center of the hemispherical camera matrix template and adjust the position using the gizmos component.

View the shooting results of the camera matrix on the preview page.

After confirming the effect, click to render, and all camera positions in the camera matrix will be rendered at once.

After rendering is complete, click Publish to D5 Cloud. The client will upload the local files to the cloud project and submit a machine learning training task.

Spherical template workflow

Spherical templates are more suitable for photographing products such as furniture, appliances, and daily necessities. We recommend importing your desired model into the D5 scene and changing the environment's HDRI file to pure white. Then, use point lights and area lights to enhance the model's lighting, simulating the effect of a shadowless studio. Align the center of the spherical template with the center of the model, and proceed with rendering and training delivery.

Please download the file to view the complete operation process: Download Link

After training is complete, click Edit in the Showreel training record to view the training results in the Interactive Editor.

Web Editor

After completing the training, users need to perform some simple post-processing in various web editors on the Showreel platform to achieve better presentation results.

Interact Editor: Add hotspots, modify scene parameters, adjust the initial preview angle, compress the size of shared files, etc.
Crop Editor: Crop your ply files using a variety of selectors.

Please download the file to view the complete operation process: Download Link

Interact Editor

Enter Interact Editor

After completing the training, log in to the Showreel platform and open the corresponding cloud project (editing permissions: uploader & administrator). Click “Edit” to enter the “Interact Editor.”
After completing the training, the initial angle of the ply file is likely to be mismatched with the editor's world coordinates. Users need to manually rotate the ply file's angle to align it with the editor's world coordinate system after selecting the ply file (refer to the grid plane in the scene for reference).

Select the corresponding object in the scene list on the left to modify the parameters in the parameter panel on the right.

In the scene list: “Multimedia” and “iframe” assets support deletion.

Add assets to the Interact Editor

a. Add multimedia hotspots: Allow users to format text, upload images, and embed videos within a pop-up using a rich text editor.

b. Add iframe hotspots: Enable users to paste external website URLs (e.g., CRM lead forms, online drawings) or embed iframe codes (e.g., video player embed codes).

Publish & cancel sharing links

To share an online project with users, click the "Publish" button located at the top-right corner of the editor. Once the publishing process is complete, a shareable link or a downloadable QR code poster will be generated.

Performance Mode: Compresses the file to 1/10th of its original size, making it more suitable for viewing on mobile devices.
Lossless Mode: Retains the original PLY file without any compression.

After publishing, the system generates a shareable link. The default initial perspective in the shared link corresponds to the last saved view in the 3D interface of the interactive editor. If users wish to update the project after sharing the link (e.g., by modifying the previous PLY file), they must click "Update Link" again. Otherwise, the shared link will still contain the old file.

Interact Editor Publishing Process

Please download the file to view the complete operation process: Download Link

Crop Editor

Select the model in the scene, click “Crop PLY File” in the right sidebar, and enter model editing mode.

Selection Tools

Rectangle Selection: Select a rectangular area.

Lasso Selection: Use the lasso tool to freely draw selection boundaries.

Polygon Selection: Define selection boundaries using straight-line lasso.

Brush Selection: Freely draw selection areas using a brush.

Sphere Selection: Set the radius of a sphere to select a spherical area in the scene and add it to the selection.

After selecting a region, you can click the top-left corner or use shortcut keys to perform actions such as inverse selection, locking, or deletion.

Editing Tools

Allows you to move, rotate, scale the model, and switch between local coordinate systems.

Display Modes

Enables switching between point cloud mode and ellipsoid mode for the model, making selection and other operations more convenient.

The video demonstrates how different types of selectors can be used to choose specific portions for cropping and how to perform inverse selection.

External export & workflow combined with other software

The online XR tour browsing service that comes with D5 can help users share plans and collaborate. In addition, there are even more ways to use it with other software.

*Project list ↓ Supports downloading ply source files

Apply it to your official website, online store, or software.

Directly use the D5 sharing link as a data source, embedding it into your company’s official website or online store via an iframe (using the Shopify plugin), or incorporating it into online documents.