Computer Vision, Multi-viewpoint Image, 3D shape and motion reconstruction, 3D video
Overview of the research
My research is to study a computational process of 3D shape and motion estimation from multi-view videos. This realizes a new visual media called 3D video for free-viewpoint and full-3D visualization of the world as is, and contributes to advance multi-view visual information processing and human visual system understanding.
Research Interests
Pattern Recognition
Computational Photography
3D Shape Reconstruction
Computer Vision
Research Areas
Informatics, Intelligent informatics
Papers
Video Region Annotation with Sparse Bounding Boxes.
Yuzheng Xu; Yang Wu 0001; Nur Sabrina binti Zuraimi; Shohei Nobuhara; Ko Nishino
Int. J. Comput. Vis., Mar. 2023
InCrowdFormer: On-Ground Pedestrian World Model From Egocentric Views.
Mai Nishimura; Shohei Nobuhara; Ko Nishino
CoRR, 2023
nLMVS-Net: Deep Non-Lambertian Multi-View Stereo.
Kohei Yamashita; Yuto Enyo; Shohei Nobuhara; Ko Nishino
WACV, 2023
ViewBirdiformer: Learning to Recover Ground-Plane Crowd Trajectories and Ego-Motion From a Single Ego-Centric View.
Mai Nishimura; Shohei Nobuhara; Ko Nishino
IEEE Robotics Autom. Lett., 2023
Fresnel Microfacet BRDF: Unification of Polari-Radiometric Surface-Body Reflection.
Tomoki Ichikawa; Yoshiki Fukao; Shohei Nobuhara; Ko Nishino
CoRR, 2022
ViewBirdiformer: Learning to recover ground-plane crowd trajectories and ego-motion from a single ego-centric view.
Mai Nishimura; Shohei Nobuhara; Ko Nishino
CoRR, 2022
nLMVS-Net: Deep Non-Lambertian Multi-View Stereo.
Kohei Yamashita; Yuto Enyo; Shohei Nobuhara; Ko Nishino
CoRR, 2022
BlindSpotNet: Seeing Where We Cannot See.
Taichi Fukuda; Kotaro Hasegawa; Shinya Ishizaki; Shohei Nobuhara; Ko Nishino
CoRR, 2022
BlindSpotNet: Seeing Where We Cannot See.
Taichi Fukuda; Kotaro Hasegawa; Shinya Ishizaki; Shohei Nobuhara; Ko Nishino
ECCV Workshops (1), 2022
Multimodal Material Segmentation.
Yupeng Liang; Ryosuke Wakaki; Shohei Nobuhara; Ko Nishino
CVPR, 2022
Dynamic 3D Gaze from Afar: Deep Gaze Estimation from Temporal Eye-Head-Body Coordination.
Soma Nonaka; Shohei Nobuhara; Ko Nishino
CVPR, 2022
RGB Road Scene Material Segmentation.
Sudong Cai; Ryosuke Wakaki; Shohei Nobuhara; Ko Nishino
ACCV (2), 2022
Extrinsic Camera Calibration From a Moving Person.
Sangeun Lee; Keisuke Shibata; Soma Nonaka; Shohei Nobuhara; Ko Nishino
IEEE Robotics and Automation Letters, 2022
Invertible Neural BRDF for Object Inverse Rendering.
Zhe Chen; Shohei Nobuhara; Ko Nishino
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022
Surface Normals and Shape From Water.
Meng-Yu Jennifer Kuo; Satoshi Murai; Ryo Kawahara; Shohei Nobuhara; Ko Nishino
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022
Human-Object Interaction Detection with Missing Objects.
Kaen Kogashi; Yang Wu 0001; Shohei Nobuhara; Ko Nishino
17th International Conference on Machine Vision and Applications(MVA), 2021
View Birdification in the Crowd: Ground-Plane Localization from Perceived Movements.
Mai Nishimura; Shohei Nobuhara; Ko Nishino
BMVC, 2021
Invertible Neural BRDF for Object Inverse Rendering.
Zhe Chen; Shohei Nobuhara; Ko Nishino
Computer Vision - ECCV 2020 - 16th European Conference, 2020
Video Region Annotation with Sparse Bounding Boxes.
Yuzheng Xu; Yang Wu 0001; Nur Sabrina binti Zuraimi; Shohei Nobuhara; Ko Nishino
31st British Machine Vision Conference 2020(BMVC), 2020
Dyadic Human Relation Recognition.
Kaen Kogashi; Shohei Nobuhara; Ko Nishino
ICME, 2022
Structure of Multiple Mirror System From Kaleidoscopic Projections of Single 3D Point.
Kosuke Takahashi; Shohei Nobuhara
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022
3D Face Reconstruction and Gaze Estimation from Multi-view Video using Symmetry Prior
Shi Qun; Nobuhara Shohei; Matsuyama Takashi
IMT, 2012
3D Shape from Silhouettes in Water for Online Novel-view Synthesis
Yano Tomohiko; Nobuhara Shohei; Matsuyama Takashi
IMT, 2013
View Birdification in the Crowd: Ground-Plane Localization from Perceived Movements.
Mai Nishimura; Shohei Nobuhara; Ko Nishino
CoRR, 2021
Object-Oriented Color Calibration of Multi-viewpoint Cameras in Sparse and Convergent Arrangement
Nobuhara Shohei; Kimura Yuta; Matsuyama Takashi
Information and Media Technologies, 2011
Cell-based 3D Video Capture of a Freely-moving Object Using Multi-viewpoint Active Cameras
Video Region Annotation with Sparse Bounding Boxes.
Yuzheng Xu; Yang Wu; Nur Sabrina binti Zuraimi; Shohei Nobuhara; Ko Nishino
Proc. of British Machine Vision Conference, 2020, Peer-reviewed
Invertible Neural BRDF for Object Inverse Rendering.
Zhe Chen; Shohei Nobuhara; Ko Nishino
Proc. of European Conference on Computer Vision, 2020, Peer-reviewed
SOIC: Semantic Online Initialization and Calibration for LiDAR and Camera.
Weimin Wang 0007; Shohei Nobuhara; Ryosuke Nakamura; Ken Sakurada
CoRR, 2020
3D-GMNet: Single-View 3D Shape Recovery as A Gaussian Mixture.
Kohei Yamashita; Shohei Nobuhara; Ko Nishino
Proc. of British Machine Vision Conference, 2020, Peer-reviewed
Appearance and Shape from Water Reflection.
Ryo Kawahara; Meng-Yu Jennifer Kuo; Shohei Nobuhara; Ko Nishino
Proc. of IEEE Winter Conference on Applications of Computer Vision (WACV) 2020, 2020, Peer-reviewed
Surface Normals and Shape From Water.
Satoshi Murai; Meng-Yu Kuo; Ryo Kawahara; Shohei Nobuhara; Ko Nishino
in Proc. of IEEE International Conference on Computer Vision (ICCV), 2019, Peer-reviewed
Panoptic Studio: A Massively Multiview System for Social Interaction Capture.
Hanbyul Joo; Tomas Simon; Xulong Li; Hao Liu; Lei Tan; Lin Gui; Sean Banerjee; Timothy Godisart; Bart C. Nabbe; Iain A. Matthews; Takeo Kanade; Shohei Nobuhara; Yaser Sheikh
Panoptic Studio: A Massively Multiview System for Social Interaction Capture.
Hanbyul Joo; Tomas Simon; Xulong Li; Hao Liu; Lei Tan; Lin Gui; Sean Banerjee; Timothy Godisart; Bart C. Nabbe; Iain A. Matthews; Takeo Kanade; Shohei Nobuhara; Yaser Sheikh
CoRR, 2016
Cell-based visual surveillance with active cameras for 3D human gaze computation
Zhaozheng Hu; Takashi Matsuyama; Shohei Nobuhara
MULTIMEDIA TOOLS AND APPLICATIONS, Jun. 2015, Peer-reviewed
Panoptic Studio: A Massively Multiview System for Social Motion Capture
Hanbyul Joo; Hao Liu; Lei Tan; Lin Gui; Bart Nabbe; Iain Matthews; Takeo Kanade; Shohei Nobuhara; Yaser Sheikh
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, Peer-reviewed
Interference-free Epipole-centered Structured Light Pattern for Mirror-based Multi-view Active Stereo
Tomu Tahara; Ryo Kawahara; Shohei Nobuhara; Takashi Matsuyama
2015 INTERNATIONAL CONFERENCE ON 3D VISION, 2015, Peer-reviewed
A Linear Generalized Camera Calibration from Three Intersecting Reference Planes
Mai Nishimura; Shohei Nobuhara; Takashi Matsuyama; Shinya Shimizu; Kensaku Fujii
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, Peer-reviewed
Augmented Motion History Volume for Spatiotemporal Editing of 3-D Video in Multiparty Interaction Scenes
Qun Shi; Shohei Nobuhara; Takashi Matsuyama
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, Jan. 2015, Peer-reviewed
A 3D Shape Descriptor for Segmentation of Unstructured Meshes into Segment-Wise Coherent Mesh Series
Tomoyuki Mukasa; Shohei Nobuhara; Tony Tung; Takashi Matsuyama
in Proc. of International Conference on 3D Vision (3DV), 2014, Peer-reviewed
A Real-Time View-Dependent Shape Optimization for High Quality Free-Viewpoint Rendering of 3D Video
Shohei Nobuhara; Wei Ning; Takashi Matsuyama
in Proc. of International Conference on 3D Vision (3DV), 2014, Peer-reviewed
Underwater 3D surface capture using multi-view projectors and cameras with flat housings
Ryo Kawahara; Shohei Nobuhara; Takashi Matsuyama
IPSJ Transactions on Computer Vision and Applications, 2014, Peer-reviewed
Tree-structured mesoscopic surface characterization for kinematic structure estimation from 3D video
Tomoyuki Mukasa; Shohei Nobuhara; Tony Tung; Takashi Matsuyama
IPSJ Transactions on Computer Vision and Applications, 2014, Peer-reviewed
3D shape from silhouettes in water for online novel-view synthesis
Tomohiko Yano; Shohei Nobuhara; Takashi Matsuyama
IPSJ Transactions on Computer Vision and Applications, Jul. 2013, Peer-reviewed
A pixel-wise varifocal camera model for efficient forward projection and linear extrinsic calibration of underwater cameras with flat housings
Ryo Kawahara; Shohei Nobuhara; Takashi Matsuyama
Proceedings of the IEEE International Conference on Computer Vision, 2013, Peer-reviewed
Augmented motion history volume for spatiotemporal editing of 3D video in multi-party interaction scenes
Qun Shi; Shohei Nobuhara; Takashi Matsuyama
Proceedings - 2013 International Conference on 3D Vision, 3DV 2013, 2013, Peer-reviewed
3D Face Reconstruction and Gaze Estimation from Multi-view Video using Symmetry Prior
Qun Shi; Shohei Nobuhara; Takashi Matsuyama
IPSJ Transactions on Computer Vision and Applications, Oct. 2012, Peer-reviewed
A New Mirror-based Extrinsic Camera Calibration Using an Orthogonality Constraint