mcwlogin mcwlogin

Project Summary

I made this.

Project Details

Congratulations on publishing your project!  Don't forget to set the permissions if you want to use it in AR or VR or share with others.  
Click here to edit the detailed description for your project.

 

PUBLISHING FOR AR/VR (XR) USING CATAPULT?:
You can include images, videos, and other important details.

GLB Formatted Assets are Your Friends!  
You may publish other file formats to Catapult for display in XR including OBJ, FBX, and STL. However, GLB (compressed GLTF), assets will usually work and look best. This is because they can be hot-loaded into your project with materials, lighting, and animations intact. !IMPORTANT: Other 3D asset formats may not render, or render in gray with no apparent materials. 

You can save to GLB format directly from most 3D design and creative tools directly (some source apps may require a plugin for file export).  Note that DRACO compression of GLBs is not currently supported by most devices. 

If you are observing stuttering, tearing, crashing, or simply not rendering, consider optimizing your mesh for use with mobile devices to get the best display quality out of the current best-of-class AR/VR gear.  This usually involves decimating the mesh using a tool like Blender(.org), gltfpack by meshoptimizer, GLTFCompressor by KhronosGroup, or your favorite optimization tool.

Do you have a specific creative workflow in mind?  For more information on specific source formats please contact support@makeSEA.com.

Other Formats:  Video, images, PDF, etc.
You can also use videos in XR, in .mp4 format.  Including 360 surround and flat-screen videos as well as live streams.  We recommend 1080p, although, you may get up to 8K video to play on some devices.  For surround video that does not overtax most devices and leaves processing free for displaying other assets, we recommend 3K video (3072x1536).  Bitrate matters:  4-8Mbps is usually good; higher rates may cause poor frame rates on some devices.  To point to external video sources and indexed livestreams use the Remote Assets section on the makeSEA Project page to define a source.  See below for more information.

Catapult also supports images in .jpg and .png format, PDF files, Word and Excel docs for display in XR.

Supported file formats:

.glb (GLB/GLTF) –Preferred for 3D and Digital Twin Assets; max poly count varies by device start small (Oculus typically handles meshes of <1M polys well, HoloLens 1-2M polys and Magic Leap MM polys)

.obj* (OBJ)

.fbx* (FBX)

.stl (STL

.png (PNG)

.jpg (JPEG)

.mp4 (video; SD, HD, 360 surround**)

.pdf (PDF)

.doc* (Word)

.xls* (Excel)

 

*Limited translation; some content may not convert
**Up to 8K on Oculus, 1.5K on Magic Leap and HoloLens; recommended stream rate 4-8Mbps, “faststart” flagging recommended at encoding time.  

 

Preparing Video Content for display with Catapult:

Use your favorite video production method and software or for a quick and easy conversion tool See:

https://support.apple.com/downloads/quicktime

https://ffmpeg.org

https://obsproject.com

 

makeSEA highly recommends using FFMPEG to optimize any video for XR regardless of the source:

For 720p (SD):
ffmpeg -i <input.mp4> -r 30 -b 4096k -vf scale=1280x720 -movflags faststart <output.mp4>

For 1080P (HD):
ffmpeg -i /<input.mp4> -r 24 -b 4096k -vf scale=3072x1536 -movflags faststart <output.mp4>

For 360-Surround or UHD:
ffmpeg -i <input.mp4> -r 24 -b 4096k -vf scale=3072x1536 -movflags faststart <output.mp4>

 

Note that 3072x1536 is max resolution for MaicLeap 1 devices; larger scales may work on Magic Leap 2 and Quest 2.  Max resolution will limit if the video displays at all for a given class of hardware device.  Bitrate impacts video quality/frame-rate.  Cached videos may play more reliably at full bitrate over slow network connections.  Optimal max stream bitrate for Magic Leap 1 is 4Mbps, for Quest 2 and Magic Leap 2 is 8Mbps.  Livestream videos using Web streaming or WebRTC protocols will automatically choose the optimal bitrate and resolution for the network connection, preferring frame rate over quality.

 

Livestreams supplied in .mu38 and RTSP livestream format are supported up to the resolutions limits of each device and can be linked under the Remote Assets project section

Flatscreen videos and livestreams are available for placement and display from the bookshelf.  360 surround videos are available from the Project menu while in the project.

 

Video tagging nomenclature:  put the following string in your video title to tell Catapult how to handle the stream:

“360”:  assume the video should be used as a 360-surround video

“avatar”:  have the video canvas follow the local user (self), when playing

“greenscreen”:  chromakey/greenscreen trim the video being played

“autoplay”:  play the video as soon as it is loaded

For example, a video named “My Movie chromakey avatar autoplay”, will start as son as it is loaded upon entering the scene, will have any green background trimmed, and will pivot to follow the viewer as they move around.

About chromakey/greenscreen video:  shooting your video in front of a green background is often sufficient as long as the lighting of the green background is consistent.  However, it can help to use an editing software like iMovie to clean up the background so that it is a solid green, which will produce a cleaner trimmed effect.

Saving and Recalling Scenes:  If you are a Project owner or Team Member, and are Master of Ceremonies (MC) while in the scene, you can save the layout and placement of assets.  An opportunity to save is presented upon exit from the scene.  Or, you can save and recall the scene at any time from the General Settings menu.  Saved scene layouts are recalled automatically upon reentry into a saved scene.

 

For complete instructions see: 

https://www.makeSEA.com/how-to

Average (0 Votes)

Assets
Related Assets
Remote Assets