H. Nishizaki
Hiromitsu Nishizaki

Hiromitsu Nishizaki

西﨑 博光

Professor, Faculty of Engineering, University of Yamanashi
Chair, Department of Mechanical Engineering (Head, Mechatronics Course)
Director, Center for Promotion of Internationalization
Head of the Nishizaki-Leow Lab (ALPS Lab)

AI that understands people and works alongside them,
in classrooms, on farms and in everyday life.

69Journal papers
140International conferences
1,861Citations
19h-index

Paper counts from the lab publication database (November 2026); citation metrics from Google Scholar (checked November 16, 2026).

01

About

経歴

Born in Sayo, Hyogo. After Tsuyama National College of Technology, I transferred to Toyohashi University of Technology and received my Dr. Eng. in 2003. I joined the University of Yamanashi the same year and became a full professor in 2022 after serving as research associate, assistant professor and associate professor. In 2015–2016 I was a visiting researcher at National Taiwan University. Speech research at Yamanashi began with Dr. Minoru Shigenaga in 1955 and continued under Dr. Yoshihiro Sekiguchi; I have led the lab since 2013. My own research began with speech recognition and spoken document retrieval, expanded to image recognition and sensor-based sensing, and now focuses on physical AI that works in the real world.

Career

  • Chair, Department of Mechanical Engineering (Head, Mechatronics Course), University of Yamanashi
  • Director, Center for Promotion of Internationalization, University of Yamanashi
  • Professor, Graduate Faculty of Interdisciplinary Research, University of Yamanashi
  • Associate Professor, University of Yamanashi
  • Visiting Researcher, College of EECS, National Taiwan University
  • Assistant Professor, University of Yamanashi
  • Research Associate, University of Yamanashi

Education

  • Dr. Eng., Toyohashi University of TechnologyThesis on spoken-query information retrieval for spoken documents
  • M.Eng., Toyohashi University of Technology
  • B.Eng., Toyohashi University of Technology
  • Associate Degree in Engineering, Tsuyama National College of Technology (Information Engineering)

Memberships

02

Research

研究

I work on spoken language processing and multimedia pattern recognition. Starting from deep-learning-based speech recognition and natural language processing, my lab's work extends to LLM-based dialogue and education support, handwritten character recognition, and smart agriculture and physical AI (farm robots) for Yamanashi's Shine Muscat grapes. I have led the lab since 2013.

Speech recognition

Large-vocabulary continuous speech recognition, combining multiple recognizers, recognition of lecture, elderly and multilingual speech, lightweight end-to-end models for embedded devices, speech-to-braille and captioning.

143 papers & talks

Speech & audio signal processing

Speech enhancement for hearing aids, sound event and acoustic scene classification, speaker recognition and anti-spoofing, speech-based depression detection, waveform-based acoustic features.

68 papers & talks

Spoken document retrieval

Spoken term detection and spoken document retrieval, including organizing and taking part in NTCIR evaluation tasks and web-based document expansion for indexing.

105 papers & talks

NLP & dialogue

Applications of large language models, spoken dialogue systems and dialogue robots, paraphrasing and translation, text classification and topic estimation.

52 papers & talks

Education & accessibility

Lecture speech evaluation and speaking training, classroom analysis, information access for deaf and hard-of-hearing people, note-taking support, customer-service training and language-barrier-free classes.

70 papers & talks

Character & image recognition

Handwritten character generation and recognition, document OCR with vision-language models, similar-drawing search, face and pose estimation from fisheye images, 3D reconstruction.

28 papers & talks

Smart agriculture & physical AI

Centered on Yamanashi's Shine Muscat grapes: color and taste estimation from images, the berry-thinning app tsubura, and produce sorting, extending to physical AI that acts in the real world, such as harvesting, thinning and autonomous mobile robots using camera/LiDAR perception and multimodal LLMs.

49 papers & talks

Healthcare & sensing

Applications to healthcare and IoT: medical record and patient information systems, ALS diagnosis support, pose-based gait and motion assessment, swallowing assessment, speech-based depression detection, UWB-radar breathing monitoring, and air-quality and smart-home sensing.

51 papers & talks

JSPS KAKENHI (as Principal Investigator)

03

Publications

業績

At a glance

Publications & talks

69Journal papers
140International conference papers
52Internationally co-authored papers26 journal, 26 conference
228Domestic oral presentations
51Talks & seminarsincl. 2 invited talks
10PhD graduates supervised2014–2026

External funding

8KAKENHI as PI¥117.7M in total
16KAKENHI as co-investigator
6Other grants as PIfoundations, IPA, etc.

Google Scholar

1,861Citations1,043 since 2021
19h-index16 since 2021
51i10-index30 since 2021

Sources: lab publication database (papers, presentations, talks), KAKEN (KAKENHI), researchmap (other grants), Google Scholar (citations, checked November 16, 2026). Internationally co-authored papers are journal and conference papers with at least one author at a non-Japanese institution (affiliations checked on OpenAlex). Other figures as of November 2026.

Papers per fiscal year

JournalInt'l conference
05101520FY2003: Journal 4 / Int'l conference 32003FY2004: Journal 5 / Int'l conference 3FY2005: Journal 2 / Int'l conference 02005FY2006: Journal 2 / Int'l conference 0FY2007: Journal 0 / Int'l conference 1FY2008: Journal 2 / Int'l conference 4FY2009: Journal 0 / Int'l conference 2FY2010: Journal 2 / Int'l conference 52010FY2011: Journal 1 / Int'l conference 7FY2012: Journal 2 / Int'l conference 3FY2013: Journal 2 / Int'l conference 4FY2014: Journal 1 / Int'l conference 4FY2015: Journal 1 / Int'l conference 22015FY2016: Journal 1 / Int'l conference 4FY2017: Journal 0 / Int'l conference 5FY2018: Journal 1 / Int'l conference 3FY2019: Journal 1 / Int'l conference 11FY2020: Journal 2 / Int'l conference 122020FY2021: Journal 4 / Int'l conference 13FY2022: Journal 7 / Int'l conference 7FY2023: Journal 10 / Int'l conference 9FY2024: Journal 7 / Int'l conference 12FY2025: Journal 7 / Int'l conference 102025FY2026: Journal 5 / Int'l conference 11

* Japanese fiscal years run from April to March. FY2026 is in progress.

Show as a table
FYJournalInt'l conference
FY2026511
FY2025710
FY2024712
FY2023109
FY202277
FY2021413
FY2020212
FY2019111
FY201813
FY201705
FY201614
FY201512
FY201414
FY201324
FY201223
FY201117
FY201025
FY200902
FY200824
FY200701
FY200620
FY200520
FY200453
FY200343

Citations per year (Google Scholar)

0501001502002502002: 72003: 272004: 222005: 2120052006: 182007: 72008: 232009: 282010: 3620102011: 562012: 432013: 1202014: 962015: 4720152016: 722017: 522018: 212019: 402020: 5320202021: 902022: 1532023: 1712024: 2042025: 23520252026: 186186*

* 2026 is year-to-date (checked November 16, 2026)

Show as a table
YearCitations
2026186
2025235
2024204
2023171
2022153
202190
202053
201940
201821
201752
201672
201547
201496
2013120
201243
201156
201036
200928
200823
20077
200618
200521
200422
200327
20027
See the full publication list (470 items)

Recent journal papers (latest 10)

  1. 2027
    Dual-range vision-based cutting-point localization and end-effector positioning for robotic table grape inflorescence trimmingPanitan Muangkammuen, Prawit Buayai, Sopheapanha Bun, Sonthaya Buayai, Xiaoyang Mao, Hiromitsu NishizakiComputers and Electronics in Agriculture, vol. 257, Art. no. 112651IF 10.3SJR 2.165Q1Character & image recognitionSmart agriculture & physical AIdoi.org/10.1016/j.compag.2026.112651
  2. 2026.09
    A dual-stream spectral network for versatile full-band speech enhancementJunkang Yang, Hiromitsu Nishizaki, Chee Siang Leow, Hongqing Liu, Lu GanThe Journal of the Acoustical Society of America, vol. 160, no. 3, pp. 2272–2287IF 2.6SJR 0.670Q1Speech & audio signal processingdoi.org/10.1121/10.0046397
  3. 2026.09
    Lightweight streaming speech enhancement for AIoT-enabled wearable hearing aids using parallel spiking MambaJunkang Yang, Hiromitsu Nishizaki, Chee Siang Leow, Hongqing Liu, Lu GanInternet of Things, vol. 39, Art. no. 102046IF 7.6 (2024)SJR 1.557Q1Speech & audio signal processingHealthcare & sensingdoi.org/10.1016/j.iot.2026.102046
  4. 2026.09
    Adversarial audio inpainting with selective state space model, efficient attention, and large-scale pre-trained modelJunkang Yang, Hongqing Liu, Liming Shi, Lu Gan, Hiromitsu Nishizaki, Chee Siang LeowArchives of Acoustics, vol. 51, no. 3, pp. 515–532IF 1.1SJR 0.237Q3Speech & audio signal processingdoi.org/10.24423/archacoust.2026.4269
  5. 2026.04
    End-to-End Position Prediction for Robotic Grape Berry ThinningYin Suan Tan, Prawit Buayai, Dear Moeurn, Hiromitsu Nishizaki, Koji Makino, Xiaoyang MaoJournal of Robotics and Mechatronics, Vol.38, No.2, pp.513-524IF 1.0SJR 0.303Q3Smart agriculture & physical AIdoi.org/10.20965/jrm.2026.p0513
  6. 2025.12
    Enhancing the robustness of speech anti-spoofing countermeasures through joint optimization and transfer learningYikang Wang, Xingming Wang, Chee Siang Leow, Qishan Zhang, Ming Li, Hiromitsu NishizakiIEICE Transactions on Information and Systems, vol. E108-D, no. 12, pp. 1594–1604IF 0.8SJR 0.237Q3Speech & audio signal processingdoi.org/10.1587/transinf.2025EDP7044
  7. 2025.11
    ColabReaction: Accelerating transition state searches with machine learning potentials on Google ColaboratoryMasayuki Karasawa, Chee Siang Leow, Hideaki Yajima, Shuta Arai, Hiromitsu Nishizaki, Tohru Terada, Hajime SatoJournal of Chemical Information and Modeling, vol. 65, no. 21, pp. 11908–11914IF 6.4SJR 1.430Q1Deep learning & AI (general)doi.org/10.1021/acs.jcim.5c02398
  8. 2025.11
    Non-invasive estimation of Shine Muscat grape color and sensory evaluation from standard camera imagesRyosuke Shimazu, Chee Siang Leow, Prawit Buayai, Xiaoyang Mao, Wan-Young Chung, Hiromitsu NishizakiThe Visual Computer, vol. 41, no. 14, pp. 11705–11720IF 3.4SJR 0.599Q2Smart agriculture & physical AIdoi.org/10.1007/s00371-025-03925-6
  9. 2025.09
    Optimizing mRNA Vaccine Degradation Prediction via Penalized Dropout ApproachesHwai Ing Soon, Azian Azamimi Abdullah, Hiromitsu Nishizaki, Latifah Munirah KamarudinIEEE Access, Vol. 13, pp. 137561-137578, ISSN: 2169-3536IF 4.2SJR 0.884Q1Healthcare & sensingdoi.org/10.1109/ACCESS.2025.3595155
  10. 2025.08
    Handwritten character image generation for effective data augmentationChee Siang Leow, Tomoki Kitagawa, Hideaki Yajima, Hiromitsu NishizakiIEICE Transactions on Information and Systems, vol. E108-D, no. 8, pp. 967–976IF 0.8SJR 0.237Q3Character & image recognitiondoi.org/10.1587/transinf.2024EDP7201

IF = the journal's latest Journal Impact Factor (Clarivate Journal Citation Reports; 2025 value, or the previous year's value with the year shown). SJR = SCImago Journal Rank (2025); Q1–Q4 = the journal's best SCImago quartile across its subject categories (hover to see the category). None of these are values at the time of publication.

Recent conference papers (latest 10)

  1. 2027.01
    DMPNet: Versatile Speech Enhancement Based on Differential Mixing and Bidirectional Spectral PropagationJunkang Yang, Hiromitsu Nishizaki, Chee Siang Leow, Hongqing Liu, Lu GanProceedings of the 33rd International Conference on MultiMedia Modeling (MMM 2027), to appearSpeech & audio signal processing
  2. 2026.12
    Portable Lemon Grading System Featuring a Projection-Guided Free-Placement WorkspaceYe-Seul Jang, Prawit Buayai, Panitan Muangkammuen, Suit Mun Ng, Hiromitsu Nishizaki, Xiaoyang MaoProceedings of the 2026 International Conference on Cyberworlds (CW 2026), to appearSmart agriculture & physical AI
  3. 2026.10
    A Harmonic Denoising Approach for Non-Contact Breathing Rate Estimation Using Ultra-Wideband RadarSiti Mahfuzah Fauzi, Latifah Munirah Kamarudin, Intan Kartika Kamarudin, Hiromitsu Nishizaki, Chee Siang Leow, Ammar ZakariaProceedings of the 2026 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS 2026)Healthcare & sensing
  4. 2026.10
    Benchmarking and Validation of Pre-Trained 3D Pose Estimation Models for Sports Action ClassificationThenmoli Manogar, Ammar Zakaria, Ahmad Shakaff Ali Yeon, Shuhaida Yahud, Syed Muhammad Mamduh Syed Zakaria, Latifah Munirah Kamarudin, Hiromitsu Nishizaki, Chee Siang LeowProceedings of the 2026 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS 2026)Character & image recognition
  5. 2026.10
    Fisheye Geometry-Aware Egocentric 3D Human Pose Estimation with Patch Viewing DirectionsYinghao He, Chee Siang Leow, Hiromitsu NishizakiProceedings of the 2026 IEEE 15th Global Conference on Consumer Electronics (GCCE 2026)★ Excellent Poster Award, Gold PrizeCharacter & image recognition
  6. 2026.10
    AI-Driven Continuous Optimization of Particle Damper Fill Ratio for Hand-Transmitted Vibration Mitigation in Handheld Grass-Cutting MachineryMuhammad Aqiff Bin Masri, Muhajir Ab Rahim, Latifah Munirah Kamarudin, Hiromitsu Nishizaki, Ammar Zakaria, Syed Muhammad Mamduh Syed Zakaria, Muhamad Norhisham Abdul Rani, Mohd Azmi Yunus, Zheng ChewProceedings of the 2026 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS 2026)Deep learning & AI (general)
  7. 2026.10
    Performance Comparison of Multi-Layer Perceptron and Deep Multi-Layer Perceptron for RSSI-Based Device-Free LocalizationShaufikah Shukri, Latifah Munirah Kamarudin, Hiromitsu NishizakiProceedings of the 2026 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS 2026)Healthcare & sensing
  8. 2026.09
    Harmonic and entropy neural modeling with demographic fusion for speech-based depression detectionJunkang Yang, Hiromitsu Nishizaki, Chee Siang Leow, Lu Gan, Hongqing LiuProceedings of the 35th International Conference on Artificial Neural Networks (ICANN 2026), Lecture Notes in Computer Science, Vol. 17092, pp. 623–634★ Best Paper AwardSpeech & audio signal processingHealthcare & sensingdoi.org/10.1007/978-3-032-38407-2_49
  9. 2026.09
    Difficulty-Aware Curriculum and Token-Weighted Rationale Distillation from LLM for Sequential RecommendationJitong Jiang, Dongjin Yu, Changgeng Li, Dongjing Wang, Hiromitsu Nishizaki, Chee Siang LeowProceedings of the 2026 Joint European Conference on Machine Learning and Knowledge Discovery in Databases (ECML PKDD 2026), pp. 177–194NLP & dialoguedoi.org/10.1007/978-3-032-37670-1_11
  10. 2026.08
    Reference-free handwritten Japanese character generation via CLIP-conditioned diffusion modelsKoki Fujita, Hideaki Yajima, Chee Siang Leow, Hiromitsu NishizakiProceedings of the 2026 International Conference on Document Analysis and Recognition (ICDAR 2026), pp. 3–19Character & image recognitiondoi.org/10.1007/978-3-032-36039-7_1

Books (in Japanese)

  1. 2022.10
    Proceedings of the Dialogue Robot Competition 2022Ryuichiro Higashinaka, Takashi Minato, Hiromitsu Nishizaki, Takayuki Nagai(編)公式予稿集(arXiv:2210.12034)
  2. 2022.07
    あそべる! 通じ合う! てづくりAIロボット牧野浩二, 和田義久, 西崎博光 ほか誠文堂新光社
  3. 2021.06
    たのしくできる 深層学習&深層強化学習による電子工作 TensorFlow編牧野浩二, 西崎博光東京電機大学出版局
  4. 2021.02
    TensorFlowによる深層強化学習入門 — OpenAI Gym + PyBulletによるシミュレーション牧野浩二, 西崎博光オーム社
  5. 2020.03
    たのしくできる深層学習牧野浩二, 西崎博光東京電機大学出版局
  6. 2019
    実践!Chainerとロボットで学ぶディープラーニング丸山史郎, 牧野浩二, 西﨑博光アフレル
  7. 2018.08
    Pythonによる深層強化学習入門 — ChainerとOpenAI Gymではじめる強化学習牧野浩二, 西崎博光オーム社
  8. 2018.03
    人工知能を作る小池誠, 鎌田智也, 足立悠, 西崎博光, 牧野浩二 ほか(16名)CQ出版社
  9. 2018.02
    算数&ラズパイから始めるディープ・ラーニング牧野浩二, 西崎博光CQ出版社

Magazine articles (in Japanese)

  1. 2025.10
    ColabReaction:反応の核心に、誰でも飛び込める時代へ佐藤玄, 唐澤昌之, 寺田透, レオ・チー・シャン, 矢島英明, 荒井秀太, 西﨑博光酵素工学ニュース(酵素工学研究会誌), 第94号, pp.33-37, 酵素工学研究会
  2. 2024.01
    シャインマスカットの収穫時期をAIで判断牧野浩二, 西崎博光, Leow Chee Siang, Prawit Buayai, 茅暁陽Interface 2024年1月号, pp.218-219, CQ出版社
  3. 2023.09
    これからの自然言語処理西崎博光これからのコンピュータ技術555(第1部第2章人工知能), インターフェース(Interface), pp.52-56, CQ出版社
  4. 2022.03
    時系列データを分析・分類するための深層学習技術西崎博光化学工業 Vol.73, No.3, pp.167-173
  5. 2021.05
    音声認識の仕組みおよび現状と将来展望西崎博光月刊電気計算 2021年5月号, 電気書院
  6. 2021
    スマートグラスを用いたブドウ収穫支援システム西崎博光日本機械学会関東支部ニュースレター No.51, p.11
  7. 2020.02
    人工知能アルゴリズム探検隊 第35回 深層強化学習牧野浩二, 西崎博光Interface 2020年2月号, pp.156-160, CQ出版社
  8. 2020.02
    ディープラーニングの2大フレームワーク牧野浩二, 西崎博光Interface 2020年2月号, pp.22-23, CQ出版社
  9. 2020.02
    これまでの/これからの自然言語処理16+α西崎博光Interface 2020年2月号, pp.31-36, CQ出版社
  10. 2020.01
    人工知能アルゴリズム探検隊 第34回 AI走行ロボに別の学習データを追加で教える牧野浩二, 西崎博光Interface 2020年1月号, pp.144-152, CQ出版社
  11. 2018.12
    My人工知能の育て方 第1部第3章 My「音」認識人工知能のうまい育て方牧野浩二, 西崎博光, 澤田直輝Interface 2018年12月号, pp.38-55, CQ出版社
  12. 2017.12
    第3章 注目ディープ・ラーニング用ライブラリ百科牧野浩二, 西崎博光Interface 2017年12月号,pp.24--32,CQ出版社,2017年10月25日発売
  13. 2017.09
    人工知能アルゴリズム探検隊 第11回番外編 インテル人工知能向け小型コンピュータの実力チェック牧野浩二, 西崎博光Interface 2017年9月号,pp.130--134, CQ出版社,2017年7月25日発売
  14. 2017.08
    算数&ラズパイから始める人気AI ディープ・ラーニング牧野浩二, 西崎博光Interface 2017年8月号,pp.17--127, CQ出版社,2017年6月24日発売
  15. 2017.03
    3大人工知能ライブラリ+α牧野浩二, 西崎博光Interface 2017年3月号, pp.87-91, CQ出版社

Patents (Japan)

  1. 2025.11
    農作物処理システムレオ チーシャン, 堀川萌樹, 鈴木裕真, 西崎博光特願2025-199336, 2025年11月19日出願
  2. 2022.04
    色判定システム、色判定方法および、色判定プログラム西崎博光, 花田隆貴特許第7064201号, 2022年4月26日登録(特願2021-146701, 2021年9月9日出願)patents.google.com/patent/JP7064201B1/ja
  3. 2019.02
    信号変換システム、特徴出力システム、機械学習システムおよび信号変換プログラム西崎博光, 澤田直輝特願2019-020267, 2019年2月出願
  4. 2015.03
    言語モデル・音声認識辞書作成装置及びそれらにより作成された言語モデル・音声認識辞書を用いた情報処理装置西崎博光, 上平拓弥, 高岡充, 関口芳廣特許第5703491号, 2015年3月登録(特願2010-014372, 2010年1月26日出願)patents.google.com/patent/JP5703491B2/ja
  5. 2014.05
    電子ノート作成支援装置および電子ノート作成支援装置用プログラム西崎博光, 太田晃平, 関口芳廣特開2014-085998, 2014年5月12日公開(特願2012-236445, 2012年10月26日出願)patents.google.com/patent/JP2014085998A/ja

Awards

  • Excellent Poster Award (Gold Prize), IEEE GCCE 2026 (co-author)
  • Best Paper Award, ICANN 2026
  • Excellent Presentation Award, SICE (co-author)
  • IEICE Educational Contribution Award
  • Best Paper Award, Cyberworlds 2024
  • Outstanding Faculty Award, University of Yamanashi
  • Outstanding Faculty Award, University of Yamanashi
  • Excellent Presentation Award, SICE SI2021
  • IPSJ Excellent Teaching Material Award
  • Excellent Paper Award (Outstanding Prize), IEEE GCCE 2020
  • Best Paper Award, O-COCOSDA 2019
  • Haneda Robotics Lab Award, SoftBank
See the full publication list (470 items)
04

Teaching

授業

Courses in AY2026. Course names link to the university syllabus (in Japanese).

Undergraduate (Mechatronics)

Abroad

  • Deep Learning for Multimedia (Hangzhou Dianzi University, China)Intensive
05

Contact

連絡先
Affiliation
Faculty of Engineering, University of Yamanashi
Teaching
Undergraduate: Mechatronics Course, Faculty of Engineering
Master's: Mechatronics Engineering Course
Doctoral: System Integration Engineering Course
Address
Room A1-313, A-1 Building 3F, Faculty of Engineering
4-3-11 Takeda, Kofu, Yamanashi 400-8511, Japan
Access
About 15 min on foot or 5 min by bus from JR Kofu Station
Email
hnishi [at] yamanashi.ac.jp
Lab
www.alps-lab.org
X
@hiro32_n

Researcher IDs