Zhuowei Zhang on Nostr: Modified augmentedperception’s “Immersive Light Field Video” demo to support ...
Modified augmentedperception’s “Immersive Light Field Video” demo to support WebXR:
https://deepviewvideo-webxr-welder.glitch.meI take no credit for this: all credit goes to the original researchers for releasing the immersive videos and player. I just took their code and enabled the WebXR support in Three.js.
(Patched player:
https://github.com/zhuowei/deepviewvideo)
The original version of the demo from augmentedperception is
https://augmentedperception.github.io/deepviewvideo/ .
I only have their first demo video (“Welder”) re-uploaded: each video is ~370MB, and I don’t have space to rehost them all.
Also, shoutouts to remmel (
https://github.com/remmel/deepviewvideo) for their port of deepviewvideo’s still image viewer to WebXR last year. (This is the video viewer, but I did learn some tricks from remmel’s port, such as telling Three.js to use the ‘local’ coordinate space in WebXR)
My current version works and plays the video on a Meta Quest (2019). It doesn’t run in the visionOS Simulator since the simulator doesn’t support VP9 video decoding, but should run on a real Vision Pro if you enable WebXR.
Published at
2024-02-10 10:12:42Event JSON
{
"id": "28adeedf6010c305a1efae3662e6d1851c1966868cc61ce576a5acb88c711e5b",
"pubkey": "c043dd0dc7eb1f350a58d13a3e6fd67cf6bb5bb56f81d8466d23e000c9222f1f",
"created_at": 1707559962,
"kind": 1,
"tags": [
[
"proxy",
"https://notnow.dev/objects/c243dfc4-3a32-460a-8e36-dda2617462ae",
"activitypub"
]
],
"content": "Modified augmentedperception’s “Immersive Light Field Video” demo to support WebXR:\n\nhttps://deepviewvideo-webxr-welder.glitch.me\n\nI take no credit for this: all credit goes to the original researchers for releasing the immersive videos and player. I just took their code and enabled the WebXR support in Three.js.\n\n(Patched player: https://github.com/zhuowei/deepviewvideo)\n\nThe original version of the demo from augmentedperception is https://augmentedperception.github.io/deepviewvideo/ .\n\nI only have their first demo video (“Welder”) re-uploaded: each video is ~370MB, and I don’t have space to rehost them all.\n\nAlso, shoutouts to remmel (https://github.com/remmel/deepviewvideo) for their port of deepviewvideo’s still image viewer to WebXR last year. (This is the video viewer, but I did learn some tricks from remmel’s port, such as telling Three.js to use the ‘local’ coordinate space in WebXR)\n\nMy current version works and plays the video on a Meta Quest (2019). It doesn’t run in the visionOS Simulator since the simulator doesn’t support VP9 video decoding, but should run on a real Vision Pro if you enable WebXR.",
"sig": "c2579c8a83024c79a48aa6491006ea363498efa4914dc698a5c4acdf51ac20e16a506deeeecb3167e6df57bdd97f93c3553f6779c1f5617332436196965872bd"
}