XR Tour
What's D5 RENDER XR？
D5 RENDER XR is a new way of displaying rendering results that combines 3d rendering technology and 3d guassian splatting technology, allowing users to use renderers to render images of multiple angles of an object (or scene) in batches, and then publish these training data to the cloud,Through the AI training of the 3d guassian splatting training service deployed on the server, a 3d web link (file format is. ply or. splat) that can be shared online is finally obtained.
What's 3d Guassian Splatting?
Imagine recording a video of a room with your phone. Traditional methods might produce a basic 3D model, but it would lack detail and render slowly. In contrast, 3DGS represents each point in the scene as a "fuzzy ball" defined by its color, position, size, and transparency (using Gaussian functions). These fuzzy balls are then projected onto 2D images for rendering, enabling fast and high-quality 3D reconstruction.
This approach resembles treating each point in the scene as a light spot and reconstructing the entire scene by overlaying these spots. Leveraging the characteristics of Gaussian functions, the rendered images exhibit smooth edges, intricate details, and realistic visual effects.
Advantages of 3d Guassian Splatting technology:
High quality: Compared to traditional methods, 3DGS can more realistically reproduce scene details and lighting effects.
Real-time rendering: Using GPU acceleration, 3DGS can achieve real-time rendering at over 30 frames per second, making it suitable for applications such as virtual reality (VR) and augmented reality (AR) that require instant feedback.
Low cost: Using ordinary photos or videos, without the need for expensive equipment or complex modeling processes, ordinary users can easily generate high-quality 3D content.
D5 RENDER XR Workflow
Step1: Create XR Tour projects, use templates to quickly shoot scenes
Select TOUR/XR TOUR in the upper right corner to create an XR TOUR project file. The XR TOUR project file will store the settings of the shooting template and the storage location information.
In the XR project, click the upper right corner of the left panel to select a template, and then click a shooting position in the scene to initialize the template.
After initializing the template position, you can use gizmos to adjust the position and angle of the template, use the "parameter panel" to adjust the size, use the "preview" to view the final shooting effect, and make secondary adjustments. The final rendered result is consistent with the "preview".
There are some limitations to using only one template. For example, a single template cannot capture both close-up and distant views of an object at the same time. Therefore, multiple templates can be added to improve coverage and capture more detail in the shooting scene.
After editing the shooting template, tick the template to be rendered in the render window, click Render and wait for the rendering to end.
Upon completion of rendering, all local files will be stored at the user-specified path, and a local HTML file will be generated for result viewing. For enterprises or devices with strict data security restrictions that prohibit data uploads, the entire set of local files can be copied offline to facilitate multi-angle presentation of the design.
Template Types and Applicable Scenarios
Hemisphere Template
Hemisphere templates represent the most widely applicable template type, suitable for rapidly capturing a comprehensive bird's-eye view of an entire building.
Cube Template
Cube templates comprise six faces and two camera orientations. Users may also choose to exclude models contained within certain faces, thereby enabling enhanced photographic detail for specific angles of the building.
Sphere Template
Sphere templates are suitable for 3D objects requiring a 720-degree display of every detail, such as product photography.
Step2: Publish to the MySpace cloud project and wait for the training to be completed.
After completing the rendering, open the “Render Tour” window, select “Share”, and you can upload the local image to the cloud-based “Personal Projects”.
Upon completion of the upload, a task with the status “Queued” will be automatically created in the web backend. Please be patient until the completion of training.
Upon completion of training, the status will update automatically (with users notified via email). Users may then click “Edit” to access the online editor, review the training results, and share the link.
Step3：Edit & Publish Share in Web Editor
Upon completion of training, click Edit to access the online editor.
The online interactive editor supports adding hotspots (web or media content), allowing users to add further details to their 3D projects.
Media Hotspot
Video: Require an iframe link for the video to be added
Images: Up to 20 photos may be added, each with a maximum size of 100MB. Supported formats: JPG, JPEG, GIF, PNG, WebP, BMP
Hyperlinks: Supports valid URLs beginning with http/https
Text: Supports free input of plain text (Chinese/English characters, numbers, symbols, etc.), including pasted text. Maximum text length: 1000 characters.
Supports adding URLs and iframe links. Click the preview button in the bottom-right corner of the editor to open a pop-up window. Clicking the icon within the scene will open the corresponding webpage pop-up.
Web Hotspot
Hotspot Style
Hotspot Colour: Select colour from the colour picker
Hotspot Size: Adjust dimensions by dragging the slider
Display Hotspot Name: Enable/disable hotspot name display in the scene
Hotspot Name: Customisable text input
Hotspot Name Position: Position relative to the icon
Text Size: Adjust hotspot name size by dragging the slider
3. Upon completing all edits, click ‘Share’ to generate a shareable link for online display of your 3D project. You may communicate with team members or external collaborators via comments.
External Export & Workflow with Other Software
The D5's built-in online XR tour browsing service facilitates project sharing and collaborative communication. Beyond this, it offers more extensive scenarios for integration with other software. Within the user project list↓, users can download .ply source files for import into other software applications.
Import CESIUM to make 3d project presentation PPT
After downloading the PLY file locally, upload it to Cesium to create an interactive 3D presentation for the proposal.
Import Spline for Website Development
After downloading ply locally, utilise Spline's APK export service to develop your own 3D app or web application.
D5 RENDER XR Best Practices
Below, a typical villa residential design project (see the figure below) is used as an example to illustrate how to select appropriate camera templates and configure shooting parameters.
First, we analyze the composition of the project. There is a single main building at the center, with three areas of “negative space” between the building and the background (surrounding trees). Based on this composition, five camera templates are created for the project: two hemisphere templates to cover the main structure, and three cube templates to capture details within the surrounding development spaces.
Using the sandwich technique to capture the building's main structure:
Employ a hemisphere template with a larger radius whilst simultaneously zooming in on the lens focal length within the [Preview]. Adjust the viewpoint to ensure the majority of the building's main structure occupies the centre of the frame. This template captures the overall detail of the building's main structure.
The previous template lacked information regarding the surrounding context (vegetation), so you may wish to add a hemisphere template. There is no need to pull the camera too close; instead, capture the entire scene's outline.
Use the cube template to add details to the scene:
For the three void spaces at the front elevation, rear courtyard, and garage of the main building structure, create three cube templates respectively.
When capturing the building’s principal elevation, retain only four faces of the cube template. This allows the cube template to be positioned more flexibly within the interstitial spaces between buildings.
Upon completion of the final capture and rendering, the results of the trained model published on the webpage are as follows:
https://share.d5render.cn/team-api/shortLink/BHNNP8
Notes
Adjust the appropriate [viewpoint offset value] according to your project's dimensions, particularly within the box model. As illustrated below, without adjusting the viewpoint offset value, the camera positioned towards the lower section of the box model will capture an upward-facing perspective. Such angles are of little benefit for enhancing detail.
Examine your camera template for a significant number of invalid shots, either within objects or below the horizon. If such invalid shots occur in large quantities, it will severely compromise the training results.
For large projects, you may utilise multiple templates to capture different areas separately before submitting them together for training.
XR Tour comment function
You can add or view comments on the XR tour's viewing page.
The comment function is enabled by default and can be disabled in the list on the right in the editor. Users must log in to the D5 account to comment, and anonymous comments from tourists are not supported.
Comments support adding the following type information:
Text: Up to 500 characters, supports @ team members (only for use between team members)
Image: up to 20MB. Support screenshot paste
Camera angle of view: Comments can be added for each camera angle. Clicking a comment will automatically switch the view to the corresponding camera angle.
Last updated