Research | Member | Contact Japanese page is here.


Image sensing and control technology for intelligent robotic systems
Our research interests include a wide variety of issues on image sensing and vision technology for intelligent robotic systems, such as developping neuromorphic sensors, cameras, vision algorithms, and models of the biological visual computation, application to robot control, measurement of biological information and so on, in interdisciplinary field of electronics, computer science, mechanics, and biological science.
Keywords : Embedded computer vision, sensor fusion, active vision, robotic vision, tactile image sensor, ultra-high speed imaging, aerial robotics, aerial manipulation, neuromorphic engineering.
Shimonomura Lab / Shimonomura Lab
Publications (after 2009)
  • Ryo Miyazaki, Hannibal Paul and Kazuhiro Shimonomura, "Development of Add-On Planar Translational Driving System for Aerial Manipulation with Multirotor Platform," Applied Sciences, vol.11, no.4, Paper No.1462, pp.1-14, https://doi.org/10.3390/app11041462, 2021.2.
  • Nguyen Hoai Ngo, Anh Quang Nguyen, Vu Truong Son Dao, Kazuhiro Shimonomura, Takeharu Goji Etoh, "Simulation Study on a Backside-Illuminated Cascade-Collection-Gate Image Sensor," IEEE International Conference on Communications and Electronics (ICCE2020), Phu Quoc Island, Vietnam, 2021.1.
  • Hannibal Paul, Ryo Miyazaki, Robert Ladig and Kazuhiro Shimonomura, "TAMS: Development of a Multipurpose Three-arm Aerial Manipulator System," Advanced Robotics, vol.35, no.1, pp.31-47, https://doi.org/10.1080/01691864.2020.1845237, 2021.1.
  • Nguyen Hoai Ngo, Anh Quang Nguyen, Fabian M. Bufler, Yoshinari Kamakura, Hideki Mutoh, Takayoshi Shimura, Takuji Hosoi, Heiji Watanabe, Philippe Matagne, Kazuhiro Shimonomura, Kosei Takehara, Edoardo Charbon, Takeharu Goji Etoh, "Toward the Super Temporal Resolution Image Sensor with a Germanium Photodiode for Visible Light," Sensors, vol.20, no.30, Paper No.6895, pp.1-18, https://doi.org/10.3390/s20236895, 2020.12.
  • Hannibal Paul, "Three-arm Aerial Manipulator System (TAMS) for UAVs to realize multiple tasks," 11th ISAJ Symposium on Innovations Science and Technology for New Issues and Challenges, web conference, 2020.12. Best Presentation Award
  • Kazuhiro Shimonomura, "Vision-based Tactile Image Sensor for Manipulation and Inspection Tasks," IROS2020 Workshop, 3rd Workshop on Proximity Perception in Robotics: Towards Multi-Modal Cognition, Virtual conference, 2020.10.
  • Kazuhiro Shimonomura, "Tactile Image Sensor for Food Inspection Tasks," IROS2020 Forum, Forum on Robotic Food Manipulation Challenge, Virtual conference, 2020.10.
  • Ryo Miyazaki,Hannibal Paul, Takamasa Kominami, Kazuhiro Shimonomura, "Wire-Suspended Device Control Based on Wireless Communication with Multirotor for Long Reach-Aerial Manipulation," IEEE Access, vol.8, pp.172096-172104, https://doi.org/10.1109/access.2020.3025085, 2020.9.
  • Borwonpob Sumetheeprasit, Robert Ladig and Kazuhiro Shimonomura, "Variable configuration stereo for aerial survey using two unmanned aerial vehicles," IEEE International Conference on Real-time Computing and Robotics (RCAR 2020), Virtual conference, 2020.9. Best Student Paper Award Finalist
  • Takuya Takahashi, Pornthep Sarakon, Hideaki Kawano, Kazuhiro Shimonomura and Hideaki Orii, "Creation of Random Dot Type Contact Sensor and Estimation of Pressure Distribution by Convolutional Neural Network," ICIC Express Letters, Part B: Applications, vol.11, no.9, pp.869-874, 2020.9.
  • Pornthep Sarakon, Hideaki Kawano, Kazuhiro Shimonomura, and Seiichi Serikawa, "Efficient and Small Network using Multi-trim Network Structure for Tactile Object Recognition on Embedded Systems," IEEE Access, vol.8, pp.144277-144291, 2020.8.
  • Thanushan Kugathasan, Taeko Ando, Dominik Dannheim, Takeharu Goji Etoh, Magdalena Munker, Heinz Perneggera, Angelo Rivetti, Kazuhiro Shimonomura, Walter Snoeys, "Monolithic CMOS sensors for sub-nanosecond timing," Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, vol.979, 164461, pp.1-7, 2020.7.
  • Kazuhiro Shimonomura, "Tactile image sensors applicable to manipulation and inspection tasks," Robotics: Science and Systems (RSS2020) Workshop, Visuotactile Sensors for Robust Manipulation: From Perception to Control, Virtual conference, 2020.7.
  • Hannibal Paul, Ryo Miyazaki, Robert Ladig, Kazuhiro Shimonomura, "Landing of a Multirotor Aerial Vehicle on an Uneven Surface Using Multiple On-board Manipulators," 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2019), Macau, China, 2019.11. IROS2019 Best Paper Award on Safety, Security, and Rescue Robotics in memory of Motohiro Kisoi, Finalist
  • Ryo Miyazaki, Hannibal Paul, Kazuhiro Shimonomura, "Position Control of Wire-Suspended Hand for Long-Reach Aerial Manipulation," (Late breaking results poster), 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2019), Macau, China, 2019.11.
  • Kazuhiro Shimonomura, Syuhei Shimooka, Kazuma Miyamoto, "Rolling cylindrical tactile image sensor for large-area surface inspection," IROS2019 Workshop, Robotac, Macau, China, 2019.11.
  • Yuichiro Nomura, Shohei Ikuta, Satoshi Yokota, Junpei Mita, Mami Oikawa, Hiroki Matsushima, Akira Amano, Kazuhiro Shimonomura, Yasuhiro Seya, Chieko Koike, "Evaluation of critical flicker-fusion frequency measurement methods using a touchscreen-based visual temporal discrimination task in the behaving mouse," Neuroscience Research, vol.148, pp.28-33, 2019.11.
  • Robert Ladig, Kazuhiro Shimonomura, "High Precision, Intuitive Teleoperation of Multiple Micro Aerial Vehicles Using Virtual Reality," 2019 IEEE International Conference on Systems, Man, and Cybernetics (SMC2019), Bari, Italy, 2019.10.
  • Kazuhiro Shimonomura, "Tactile Image Sensors Employing Camera: A Review," Sensors, vol.19, no.18, Paper No.3933, pp.1-21, https://doi.org/10.3390/s19183933, 2019.9.
  • Pornthep Sarakon, Hideaki Kawano, Kazuhiro Shimonomura and Seiichi Serikawa, "Shrinking Model and Random-Dot Sensor on Embedded System," International Conference on Innovative Computing, Information and Control (ICICIC2019), Seoul, Korea, 2019.8.
  • Ryo Miyazaki, Rui Jiang, Hannibal Paul, Yanzhao Huang, Kazuhiro Shimonomura, "Long-Reach Aerial Manipulation Employing Wire-Suspended Hand with Swing-Suppression Device," IEEE Robotics and Automation Letters, vol.4, no.3, pp.3045-3052, 2019.7.
  • Kenta Kumagai, Kazuhiro Shimonomura, "Event-based Tactile Image Sensor for Detecting Spatio-Temporal Fast Phenomena in Contacts," IEEE World Haptics Conference 2019 (WHC2019), Tokyo, 2019.7.
  • Kazuhiro Shimonomura, Hannibal Paul, Robert Ladig, "Aerial robot with triple-arm for grasping and landing," RSS2019 Workshop "Aerial Interaction and Manipulation: Unsolved Challenges and Perspectives", Freiburg, Germany, 2019.6.
  • T. Goji Etoh, Nguyen Ngo, Anh Quang Nguyen, Yoshiyuki Matsunaga, Taeko Ando, Kohsei Takehara, and Kazuhiro Shimonomura, "Evolution of BSI Multi-Collection-Gate Image Sensors -From Light-in-Flight imaging to Giga-fps Continuous Imaging-," 2019 International Image Sensor Workshop (IISW), Snowbird, Utah, USA, 2019.6.
  • Kazuhiro Shimonomura, "Aerial manipulation with wire-suspended devices," ICRA2019 Aerial Robotics Workshop "The Future of Aerial Robotics: Challenges and Opportunities", Montreal, Canada, 2019.5.
  • Takeharu Goji Etoh, Tomoo Okinaka, Yasuhide Takano, Kohsei Takehara, Hitoshi Nakano, Kazuhiro Shimonomura, Taeko Ando, Nguyen Ngo, Yoshinari Kamakura, Dao Vu Truong Son, Anh Quang Nguyen, Edoardo Charbon, Chao Zhang, Piet De Moor, Paul Goetschalckx, Luc Haspeslagh, "Light-in-Flight imaging by a silicon image sensor: Toward the theoretical highest frame rate," Sensors, vol.19, no.10, Paper No.2247, pp.1-16, 2019.5.
  • Nguyen Ngo, Kazuhiro Morimoto, Kazuhiro Shimonomura, Takeharu Etoh, "On a BSI Image Signal Accumulation Sensor of 100 Mfps," 4th International Workshop on Image Sensors and Imaging Systems (IWISS2018), Tokyo, 2018.11.
  • Kazuhiro Morimoto, Nguyen Ngo, Kazuhiro Shimonomura, Takeharu Etoh, "Evolution of ultra-high-speed image sensors- Light-in-Flight imaging to Ultra-fast X-ray imaging," 4th International Workshop on Image Sensors and Imaging Systems (IWISS2018) Tokyo, 2018.11.
  • Ryo Miyazaki, Rui Jiang, Hannibal Paul, Koji Ono, Kazuhiro Shimonomura, "Airborne Docking for Multi-Rotor Aerial Manipulations," 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2018), Madrid, Spain, 2018.10. IROS2018 Best Paper Award Finalist
  • Vu Truon Son Dao, Nguyen Ngo, Anh Quang Nguyen, Kazuhiro Morimoto, Kazuhiro Shimonomura, Paul Goetschalckx, Luc Haspeclagh, Piet De Moor, Kohsei Takehara, Takeharu Goji Etoh, "An image signal accumulation multi-collection-gate image sensor operating at 25 Mfps with 32x32 pixels and 1,220 in-pixel frame memory," Sensors, vol.18, no.9, 2018.9.
  • Anh Quang Nguyen, Vu Truong Son Dao, Kazuhiro Shimonomura, Kohsei Takehara, Takeharu Goji Etoh, "Toward the ultimate-high-speed image sensor: from 10 ns to 50 ps," Sensors, vol.18, no.8, 2018.7.
  • Hannibal Paul, Koji Ono, Robert Ladig, Kazuhiro Shimonomura, "A Multirotor Platform Employing a Three-Axis Vertical Articulated Robotic Arm for Aerial Manipulation Tasks" 2018 IEEE International Conference on Advanced Intelligent Mechatronics (AIM 2018), Auckland, New Zealand, 2018.7. AIM-Machines Best Paper Award
  • Kentaro Nozu, Kazuhiro Shimonomura, "Robotic bolt insertion and tightening based on in-hand object localization and force sensing, " 2018 IEEE International Conference on Advanced Intelligent Mechatronics (AIM 2018), Auckland, New Zealand, 2018.7.
  • Anh Quang Nguyen, Vu Truong Son Dao, Kazuhiro Shimonomura, Takeharu Goji Etoh, "A 600 Kpixels Image Sensor Operates at 100Mfps for Multi-Framing Camera," 2018 IEEE Seventh International Conference on Communications and Electronics, Hue Imperial City, Vietnam, 2018.7.
  • Hannibal Paul, Koji Ono, Robert Ladig, Kazuhiro Shimonomura, "Deployment of a three-axis vertical articulated manipulator using an aerial robot," (Late breaking result abstract), 2018 IEEE International Conference on Robotics and Automation (ICRA2018), Brisbane, Australia, 2018.5.
  • Takeharu Goji Etoh, Kazuhiro Shimonomura, Quang A. Nguyen, Kosei Takehara, Yoshinari Kamakura, Paul Goetschalckx, Luc Haspeslagh, Piet De Moor, Vu Truong Son Dao, Dzung H. Nguyen, Naoki Hayashi, Yo Mitsui, Hideo Inumaru, "100 Mfps image sensor for biological applications," SPIE Photonics West 2018, San Francisco, CA, USA, 2018.1.
  • Kazuhiro Shimonomura, Anh Quang Nguyen, Kohsei Takehara, Luc Haspeslagh, Paul Goetschalckx, Piet De Moor, Naoki Hayashi, You Mitsui, Tomohiro Takahashi, Akihiko Iguchi, Tsutomu Mihara, Takeharu Goji Etoh, "Ultra-high-speed CCD image sensors for Imaging TOFMS," 11th International Symposium on Atomic Level Characterizations for New Materials and Devices'17(ALC17), Kauai, HI, USA, 2017.12.
  • Takeharu Goji Etoh, Kazuhiro Shimonomura, Katsushige Tsuno, Kazuki Hiraoka, "Simulation-based Feasibility Assessment of an Electron-Beam Array made with Multi-hole Permanent Magnets," 11th International Symposium on Atomic Level Characterizations for New Materials and Devices'17(ALC17), Kauai, HI, USA, 2017.12.
  • Robert Ladig, Suphachart Leewiwatwong, Kazuhiro Shimonomura, "FPGA based fast response image analysis for orientational control in aerial manipulation," Journal of Signal Processing Systems, 2017. (Published online)
  • Takeharu Goji Etoh, Anh Quang Nguyen, Yoshinari Kamakura, Kazuhiro Shimonomura, Yen Le Thi and Nobuya Mori, "The Temporal Resolution Limit of the Silicon Image Sensors," 2017 International Image Sensor Workshop (IISW), Hiroshima, Japan, 2017.5.
  • Takeharu Goji Etoh, Anh Quang Nguyen, Yoshinari Kamakura, Thi Yen Le, Kazuhiro Shimonomura, Nobuya Mori, "The theoretical highest frame rate of silicon image sensors," Sensors, vol.17, no.3, 2017.3.
  • A.Q.Nguyen, V.T.S.Dao, K.Shimonomura, Y.Kamakura, T.G.Etoh "Crosstalk in multi-collection-gate image sensors and its improvement," The 31st International Congress on High-Speed Imaging and Photonics (ICHSIP31), Osaka, Japan, 2016.11.
  • T.G.Etoh, Q.A.Nguyen, K.Shimonomura, Y.Le Thy, Y.Kamakura, "The Upper-bound Frame Rate of Silicon Image Sensors," The 31st International Congress on High-Speed Imaging and Photonics (ICHSIP31), Osaka, Japan, 2016.11.
  • K.Shimonomura, Q.A.Nguyen, Y.Le Thy, Y.Kamakura, T.G.Etoh, "Simulation analysis of temporal resolution in BSI MCG image sensor," The 31st International Congress on High-Speed Imaging and Photonics (ICHSIP31), Osaka, Japan, 2016.11.
  • Robert Ladig, Kazuhiro Shimonomura, "High precision marker based localization and movement on the ceiling employing an aerial robot with top mounted omni wheel drive system," 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2016), Daejeon, Korea, 2016.10.
  • Syohei Shimahara, Leewiwatwong Suphachart, Robert Ladig, Kazuhiro Shimonomura, "Aerial torsional manipulation employing multirotor flying robot," 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2016), Daejeon, Korea, 2016.10.
  • Anh Quang Nguyen, Vu Truong Son Dao, Kazuhiro Shimonomura, Yoshinari Kamakura, Takeharu Goji Etoh, "Crosstalk analysis and a cancellation method for an image sensor operating at 1Gfps," Mechanical Engineering Journal, 2016.7. (advance publication)
  • Suphachart Leewiwatwong, Shouhei Shimahara, Robert Ladig, Kazuhiro Shimonomura, "Vision based autonomous orientational control for aerial manipulation via on-board FPGA," The Twelfth IEEE Embedded Vision Workshop (held in conjunction with IEEE CVPR2016), Las Vegas, NV, USA, 2016.7.
  • Anh Quang Nguyen, Kazuhiro Shimonomura, Vu Truong Son Dao, Yoshinari Kamakura, Takeharu Goji Etoh, "Crosstalk analysis of an image sensor operating at 1 Gfps," 2016 IEEE Sixth International Conference on Communications and Electronics, Ha Long, Vietnam, 2016.7.
  • Kazuhiro Shimonomura, Hiroto Nakashima, Kentaro Nozu, "Robotic grasp control with high-resolution combined tactile and proximity sensing, " 2016 IEEE International Conference on Robotics and Automation (ICRA2016), Stockholm, Sweden, 2016.5.
  • Natsumi Minamitani, Vu Truong Son Dao, Kazuhiro Shimonomura, Takeharu G. Etoh, Yoshinari Kamakura, Nobuya Mori, "Analysis of ultra-high-speed image sensor with Monte Carlo simulation," International Symposium on Advanced Nanodevices and Nanotechnology (ISANN 2015), Waikoloa, Hawaii, 2015.11.
  • Hiroto Nakashima, Keiichiro Kagawa, Kazuhiro Shimonomura, "Combined tactile and proximity sensor employing compound-eye camera," ITE Transactions on Media Technology and Applications, 2015.10.
  • Vu Truong Son Dao, Anh Quang Nguyen, Kazuhiro Shimonomura, Yoshinari Kamakura, Natsumi Minamitani, Chao Zhang, Eduardo Charbon, Luc Haspeslagh, Paul Goetshhalckx, Piet De Moor, T. Goji Etoh, "A Structure of an Image Sensor Operating at 1 Gfps," International Conference on Advanced Technology in Experimental Mechanics (ATEM'15), Toyohashi, Japan, 2015.10.
  • S.Shimahara, R.Ladig, L.Suphachart, S.Hirai, and K.Shimonomura, "Aerial manipulation for the workspace above the airframe," 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2015), Hamburg, Germany, 2015.9.
  • V.T.S.Dao, T.G.Etoh, K.Shimonomura, Q.Nguyen, N.Hayashi, Y.Kamakura, C.Zhang, E.Charbon, P.Goetschalckx, L.Haspeslagh, P.De Moor, "Toward 10 Gfps: Factors limiting the frame rate of the BSI MCG image sensor," 2015 International Image Sensor Workshop (IISW), Vaals, The Netherlands, 2015.6.
  • H.Nakashima, K.Kagawa, K.Shimonomura, "A combined tactile and proximity sensor for adaptive grasping of a robot hand," 2nd Asian Image Sensors and Imaging Systems Symposium, Tokyo, Japan, 2014.12.
  • K.Shimonomura, K.Kitagawa, V.T.S.Dao, T.G.Etoh, Y.Kamakura, "Analysis of temporal resolution in a backside-illuminated multi-collection-gate image sensor employing Monte Carlo method," 2nd Asian Image Sensors and Imaging Systems Symposium, Tokyo, Japan, 2014.12.
  • T.G.Etoh, V.T.S.Dao, K.Shimonomura, E.Charbon, C.Zhang, Y.Kamakura and T.Matsuoka, "Toward 1Gfps: Evolution of Ultra-high-speed Image Sensors: ISIS, BSI, Multi-Collection Gates, and 3D-stacking," IEEE International Electron Devices Meeting (IEDM2014), San Francisco, CA, US, 2014.12.
  • K.Shimonomura, H.Nakashima, K.Kagawa, "A miniaturized compound-eye camera for combined position, proximity and tactile sensing," IEEE SENSORS 2014, Valencia, Spain, 2014.11.
  • K.Shimonomura, V.T.S.Dao, T.G.Etoh, Y.Kamakura, "A simulation analysis of backside-illuminated multi-collection-gate image sensor employing Monte Carlo method," 2014 International Conference on Simulation of Semiconductor Processes and Devices (SISPAD2014), Yokohama, Japan, 2014.9.
  • R.Ladig, K.Shimonomura, "FPGA-based fast response image analysis for autonomous or semi-autonomous indoor flight," 10th IEEE Embedded Vision Workshop (held in conjunction with IEEE CVPR 2014), Columbus, OH, USA, 2014.6.
  • V.T.S.Dao, K.Shimonomura, Y.Kamakura, T.G.Etoh, "Simulation analysis of a backside-illuminated multi-collection-gate image sensor," ITE Transactions on Media Technology and Applications, vol.2, no.2, pp.114-122, 2014.4.
  • K.Shimonomura, H.Nakashima, "A combined tactile and proximity sensing employing a compound-eye camera," IEEE SENSORS 2013, Baltimore, MD, USA, 2013.11.
  • R.Ladig, K.Shimonomura, "Autonomous indoor navigation of a quadrotor utilizing a FPGA based vision system," The SICE Annual Conference 2013, Nagoya, Japan, 2013.9.
  • M.Ishida, K.Shimonomura, "Marker based camera pose estimation for underwater robots," 2012 IEEE/SICE International Symposium on System Integration (SII2012), Fukuoka, Japan, 2012.12.
  • K.Shimonomura, S.Kameda, A.Iwata, and T.Yagi, "Wide-dynamic range APS-based silicon retina with brightness constancy," IEEE Transactions on Neural Networks, vol.22, no.9, pp.1482-1493, 2011.
  • K.Shimonomura, T.Yagi, "Neuromorphic vergence eye movement control of binocular robot vision," In Proc. of IEEE International Conference on Robotics and Biomimetics (ROBIO 2010), Tianjin, China, pp.1774-1779, 2010.
  • J.Hasegawa, K.Shimonomura, T.Yagi, "Real-time reconstruction of neural images for natural scenes with integrated circuits," Neuroscience 2009 (Society for Neuroscience 39th annual meeting), Chicago, Ill, USA, 2009.10.
  • K.Shimonomura, T.Yagi, "A silicon retina system for color constancy," World Automation Congress (WAC) 2010, 13th International Symposium on Robotics and Applications (ISORA2010), Kobe, Japan, 2010.9.
  • T.Yagi, K.Shimonomura, Y.OKazaki, H.Okuno, M.Osanai and H.Sawai, "Analog VLSI vision device for cortical implants," In Proc. of the XXXVI International Congress of Physiological Sciences (IUPS2009), Kyoto, Japan, 2009.7.
Top


Member
Professor Shimonomura, Kazuhiro
Assistant Professor Ladig, Robert Oliver
Administrative Assistant Sugahara, Yumiko
Graduate students
(Doctoral Program)
Hannibal Paul
Ngo, Nguyen Hoai
Miyazaki, Ryo
Sumetheeprasit, Borwonpob
Ricardo Rosales Martinez
Graduate students
(Master's Program)
Uda, Ryusuke
Kajino, Shogo
Kominami, Takamasa
Sato, Takao
Hosokawa, Yuya
Makita, Yoshiki
Miyamoto, Kazuma
Zhou Heng
Igarashi, Tatsuki
Miyamoto, Takaharu
Mori, Yuta
Yamashita, Syogo
Chang Ting Hsuan
Zhou Hao
Undergraduates Kido, Daichi
Cai Xiaoyu
Zhang Bouri
Tsuji, Takayoshi
Nagai, Ryota
Nur Asnizah Binti Datu Abd Sifat
Minagawa, Kazuki
Yamazaki, Shizuka
Yamada, Toshiki
Lu Yang
Top


Contact
Kazuhiro Shimonomura, Ph.D.
Dept. of Robotics, College of Science and Engineering,
Ritsumeikan University
1-1-1 Nojihigashi, Kusatsu, Shiga, 525-8577 Japan
E-mail skazufc.ritsumei.ac.jp

Office: EW410 (East Wing 4F)
Lab: Integrated Sensors and Intelligence Lab (East Wing 7F), Graduates Lab E71 (East Wing 7F)

Shimonomura Lab / Shimonomura Lab

Directions to BKC(Biwako-Kusatsu Campus), Ritsumeikan University
BKC Campus map
Top


Copy right (C) Shimonomura Lab. All rights reserved.
Last Update 5 December, 2020.