Lightweight Online Visualization of 3D Big Data Over Mobile Web Browsers

Prof Jinyuan Jia, Tongji University (Shanghai)

19 September 2019 | 16:00
CGV Seminar Room, Inffeldgasse 16c/II

Abstract

Heavy data volumes, slow transmission, low visual effect and slow rendering have been three major bottlenecks of online visualization of 3D big data over mobile Web browsers. For the first problem, we proposed a lightweight 3D preprocessing by (1) finding all the repetitive 3D components; (2) streaming the complicated 3D components of those non-repetitive ones; (3) generating the fine-grained data to suit mobile Internet. For the second problem, we proposed interest degree (repetition degree, attention degree, frustum filling degree) guided progressive transmission for smooth accessing of large scale Web3D scene. Furthermore, WebRTC based P2P transmission is proposed to reduce server burdens as massive users are accessing 3D content. For the third problem, we proposed a lightweight Web3D rendering by cloud baking lightmap at servers and texturing them onto the corresponding components at Web browsers. It not only reduces the rendering burdens of cloud servers, but enhances the visual effects of mobile Web3D with global illumination effectively and economically as well. By integrating three key technologies together, a new framework of lightweight Web3D has been established and a new lightweight Web3D engine is being developed.

Several online demos provide evidence for solving three bottleneck problems of Web3D big data, explains why solving will help push Web3D graphics in fundamental ways, and provides some steps forward.

Bio

Jinyuan Jia is a Professor in the School of Software Engineering and Director of the Smart3D Media Lab, Tongji University. Also, he has two adjunct positions as Dean of VR School and Director of SmartVR Research Center in Jilin Animation Institute. His research is focussed on Web3D key technologies including lightweight 3D modelling, progressive P2P transmission of large Web3D, and cloud baking based lightweight Web3D rendering with global illumination. His team proposed a lightweight solution to online visualization of Web3D big data over mobile Internet and developed WebVR/WebGame/WebBIM demonstration projects. That attracted wide attention and cooperation from many industrial companies.

Ten patents of his team have been bought by companies. His team has published 50 papers in SIGGRAPH Asia, CVPR, ICCV, SIGSIM, TOG, CGF, TOMM, WWWJ, Graphical Models, MTAP, TVC, CAVW, PRL, NCA and many others.