Basic Information

Professional Memberships

• The Association of Computational LInguistics

Academic Degree

• (Nara Institute of Science and Technology)
• (Nara Institute of Science and Technology)

Research History

• From Apr. 2019, To Present

  Kyoto University, Graduate School of Informatics, Assistant Professor
• From Sep. 2016, To Mar. 2019

  National Institute of Informatics, Research Center for Smart Data, Post-doctoral Researcher
• From Apr. 2012, To Mar. 2016

  Nara Institute of Science and Technology, Graduate School of Information Science, Research Assistant
• From Jul. 2005, To Oct. 2009

  Shanghai Jiaoda Withub Information Industrial Co Ltd, Engineer

ID,URL

• J-Global ID

  201801009576919609

researchmap URL

• https://researchmap.jp/chengfei

Research

Research Topics, Overview of the research

• Research Topics

  Natural Language Processing, Information Extraction

• Overview of the research

  1. Information extraction, particularly temporal relation extraction, event time prediction 2. cross-lingual word representations 3. Chinese morphological analysis

Research Interests

• Temporal Reasoning
• Numerical Reasoning
• Morphological Analysis
• Information Extraction

Research Areas

• Informatics, Intelligent informatics, Natural Language Processing, Computational Linguistics

Papers

• Pushing the Limits of ChatGPT on NLP Tasks

  Xiaofei Sun; Linfeng Dong; Xiaoya Li; Zhen Wan; Shuhe Wang; Tianwei Zhang; Jiwei Li; Fei Cheng; Lingjuan Lyu; Fei Wu; Guoyin Wang

  16 Jun. 2023

  
• MultiTool-CoT: GPT-3 Can Use Multiple External Tools with Chain of Thought Prompting

  Tatsuro Inaba; Hirokazu Kiyomaru; Fei Cheng; Sadao Kurohashi

  Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023), Jul. 2023, Peer-reviewed

  
• Hierarchical Softmax for End-to-End Low-resource Multilingual Speech Recognition

  Qianying Liu; Zhuo Gong; Zhengdong Yang; Yuhang Yang; Sheng Li; Chenchen Ding; Nobuaki Minematsu; Hao Huang; Fei Cheng; Chenhui Chu; Sadao Kurohashi

  Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2023), Jun. 2023, Peer-reviewed

  
• Relation Extraction with Weighted Contrastive Pre-training on Distant Supervision

  Zhen Wan; Fei Cheng; Qianying Liu; Zhuoyuan Mao; Haiyue Song; Sadao Kurohashi

  Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2023). Findings Volume., May 2023, Peer-reviewed

  
• ComSearch: Equation Searching with Combinatorial Strategy for Solving Math Word Problems with Weak Supervision

  Qianying Liu; Wenyu Guan; Jianhao Shen; Fei Cheng; Sadao Kurohashi

  Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2023), May 2023, Peer-reviewed

  
• 大規模言語モデルに基づく複数の外部ツールを利用した推論フレームワーク

  Tatsuro Inaba; Hirokazu Kiyomaru; Fei Cheng; Sadao Kurohashi

  The 29th Annual Meeting of the Association for Natural Language Processing 2023, Mar. 2023

  
• Rescue Implicit and Long-tail Cases: Nearest Neighbor Relation Extraction

  Zhen Wan; Qianying Liu; Zhuoyuan Mao; Fei Cheng; Sadao Kurohashi; Jiwei Li

  Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022), Dec. 2022, Peer-reviewed

  
• Textual Enhanced Contrastive Learning for Solving Math Word Problems

  Yibin Shen; Qianying Liu; Zhuoyuan Mao; Fei Cheng; Sadao Kurohashi

  Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022), Findings Volume, Dec. 2022, Peer-reviewed

  
• Design of versatile annotation guidelines for clinical-medical text: starting from critical lung diseases

  Shuntaro Yada, Ribeka Tanaka, Fei Cheng, Eiji Aramaki and Sadao Kurohashi

  Journal of Natural Language Processing, Dec. 2022, Peer-reviewed

  
• Seeking Diverse Reasoning Logic: Controlled Equation Expression Generation for Solving Math Word Problems.

  Yibin Shen; Qianying Liu; Zhuoyuan Mao; Zhen Wan; Fei Cheng; Sadao Kurohashi

  Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (AACL-IJCNLP 2022), Online, (2022.11.21), Nov. 2022, Peer-reviewed

  
• 弱教師学習に基づく症例報告の構造的要約

  尾崎 立一; 清丸 寛一; Cheng Fei; 黒橋 禎夫; 佐藤 寿彦; 永井 良三

  第26回日本医療情報学会春季学術大会, Jul. 2022, Peer-reviewed

  
• Attention-Focused Adversarial Training for Robust Temporal Reasoning

  Lis Kanashiro Pereira; Kevin Duh; Fei Cheng; Masayuki Asahara; Ichiro Kobayashi

  Proceedings of the 13th International Conference on Language Resources and Evaluation (LREC 2022), Jun. 2022, Peer-reviewed

  
• Improving Event Duration Question Answering by Leveraging Existing Temporal Information Extraction Data

  Felix Giovanni Virgo; Fei Cheng; Sadao Kurohashi

  Proceedings of the 13th International Conference on Language Resources and Evaluation (LREC 2022), Jun. 2022, Peer-reviewed

  
• JaMIE: A Pipeline Japanese Medical Information Extraction System with Novel Relation Annotation

  Fei Cheng; Shuntaro Yada; Ribeka Tanaka; Eiji ARAMAKI; Sadao Kurohashi

  Proceedings of the 13th International Conference on Language Resources and Evaluation (LREC 2022), Jun. 2022, Peer-reviewed, Lead author

  
• Improving Medical Relation Extraction with Distantly Supervised Pre-training

  Zhen Wan; Fei Cheng; Zhuoyuan Mao; Qianying Liu; Haiyue Song; Sadao Kurohashi

  言語処理学会第28回年次大会, Mar. 2022

  
• 時間的常識理解へ向けた効果的なマスク言語モデルの検証

  木村 麻友子; Lis Kanashiro Pereira; 浅原 正幸; Fei Cheng; 越智 綾子; 小林 一郎

  言語処理学会第28回年次大会, Mar. 2022

  
• RODA: Reverse Operation based Data Augmentation for Solving Math Word Problems

  Qianying Liu; Wenyu Guan; Sujian Li; Fei Cheng; Daisuke Kawahara; Sadao Kurohashi

  IEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP), Nov. 2021, Peer-reviewed

  
• ALICE++: Adversarial Training for Robust and Effective Temporal Reasoning

  Lis Kanashiro Pereira; Fei Cheng; Masayuki Asahara; Ichiro Kobayashi

  The 35th Pacific Asia Conference on Language, Information and Computation (PACLIC35), Nov. 2021, Peer-reviewed

  
• Dependency Enhanced Contextual Representations for Japanese Temporal Relation Classification

  Chenjing Geng; Fei Cheng; Masayuki Asahara; Lis Kanashiro Pereira; Ichiro Kobayashi

  The 35th Pacific Asia Conference on Language, Information and Computation (PACLIC35), Nov. 2021, Peer-reviewed

  
• JaMIE: A Pipeline Japanese Medical Information Extraction System.

  Fei Cheng; Shuntaro Yada; Ribeka Tanaka; Eiji Aramaki; Sadao Kurohashi

  CoRR, 2021

  
• OCHADAI-KYOTO at SemEval-2021 Task 1: Enhancing Model Generalization and Robustness for Lexical Complexity Prediction

  Yuki Taya; Lis Kanashiro Pereira; Fei Cheng; Ichiro Kobayashi

  Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021), 2021, Peer-reviewed

  
• A System for Worldwide COVID-19 Information Aggregation

  Akiko Aizawa; Frederic Bergeron; Junjie Chen; Fei Cheng; Katsuhiko Hayashi; Kentaro Inui; Hiroyoshi Ito; Daisuke Kawahara; Masaru Kitsuregawa; Hirokazu Kiyomaru; Masaki Kobayashi; Takashi Kodama; Sadao Kurohashi; Qianying Liu; Masaki Matsubara; Yusuke Miyao; Atsuyuki Morishima; Yugo Murawaki; Kazumasa Omura; Haiyue Song; Eiichiro Sumita; Shinji Suzuki; Ribeka Tanaka; Yu Tanaka; Masashi Toyoda; Nobuhiro Ueda; Honai Ueoka; Masao Utiyama; Ying Zhong

  NLP COVID-19 Workshop (Part 2) at the 2020 Conference on Empirical Methods in Natural Language Processing., Nov. 2020, Peer-reviewed

  
• Minimize Exposure Bias of Seq2Seq Models in Joint Entity and Relation Extraction

  Haoran Zhang; Qianying Liu; Aysa Xuemo Fan; Heng Ji; Daojian Zeng; Fei Cheng; Daisuke Kawahara; Sadao Kurohashi

  Findings of the 2020 Conference on Empirical Methods in Natural Language Processing, Nov. 2020, Peer-reviewed

  
• Predicting Event Time by Classifying Sub-Level Temporal Relations Induced from a Unified Representation of Time Anchors

  Fei Cheng; Yusuke Miyao

  arXiv, Jul. 2020

  
• A System for Worldwide COVID-19 Information Aggregation

  Akiko Aizawa; Frederic Bergeron; Junjie Chen; Fei Cheng; Katsuhiko Hayashi; Kentaro Inui; Hiroyoshi Ito; Daisuke Kawahara; Masaru Kitsuregawa; Hirokazu Kiyomaru; Masaki Kobayashi; Takashi Kodama; Sadao Kurohashi; Qianying Liu; Masaki Matsubara; Yusuke Miyao; Atsuyuki Morishima; Yugo Murawaki; Kazumasa Omura; Haiyue Song; Eiichiro Sumita; Shinji Suzuki; Ribeka Tanaka; Yu Tanaka; Masashi Toyoda; Nobuhiro Ueda; Honai Ueoka; Masao Utiyama; Ying Zhong

  Poster of NLP-COVID19 Workshop at the 58th Annual Meeting of the Association for Computational Linguistics, Jul. 2020

  
• Pre-training via Leveraging Assisting Languages for Neural Machine Translation

  Haiyue Song; Raj Dabre; Zhuoyuan Mao; Fei Cheng; Sadao Kurohashi; Eiichiro Sumita

  Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop, Jul. 2020, Peer-reviewed

  
• Adversarial Training for Commonsense Inference

  Lis Pereira; Xiaodong Liu; Fei Cheng; Masayuki Asahara; Ichiro Kobayashi

  Proceedings of the 5th Workshop on Representation Learning for NLP, Jul. 2020, Peer-reviewed

  
• Japanese Temporal Relation Classification with Joint Dependency and Contextual Representations

  Chenjing Geng; Fei Cheng,Lis; Kanashiro Pereira; Masayuki Asahara; Ichiro Kobayashi

  人工知能学会全国大会（第34回）, Jun. 2020

  
• Towards a Versatile Medical-Annotation Guideline Feasible Without Heavy Medical Knowledge: Starting From Critical Lung Diseases

  Shuntaro Yada; Ayami Joh; Ribeka Tanaka; Fei Cheng; Eiji Aramaki; Sadao Kurohashi

  Proceedings of The 12th Language Resources and Evaluation Conference, May 2020, Peer-reviewed

  
• Dependency Enhanced Contextual Representations for Japanese Temporal Relation Classification

  Chenjing Geng; Lis Kanashiro; Pereira; Fei Cheng; Masayuki Asahara; Ichiro Kobayashi

  ⾔語処理学会第26 回年次⼤会, Mar. 2020

  
• Dynamically Updating Event Representations for Temporal Relation Classification with Multi-category Learning

  Fei Cheng; Masayuki Asahara; Ichiro Kobayashi; Sadao Kurohashi

  Findings of the Association for Computational Linguistics: EMNLP 2020, 2020, Peer-reviewed, Lead author

  
• Automatic Error Correction on Japanese Functional Expressions Using Character-based Neural Machine Translation

  Jun Liu; Fei Cheng; Yiran Wang; Yuji Matsumoto

  The 32nd Pacific Asia Conference on Language, Information and Computation (PACLIC), oral presentation, Dec. 2018, Peer-reviewed

  
• Inducing Temporal Relations from Time Anchor Annotation

  Fei Cheng; Yusuke Miyao

  Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologie (NAACL 2018), Volumn 1, Jun. 2018, Peer-reviewed

  
• Studies on improving two fundamental steps for Chinese natural language processing: word segmentation and spelling check

  Fei Cheng

  Nara Institute of Science and Technology, Ph.D. Dissertation, 23 Mar. 2018, Peer-reviewed

  
• 経済記事からの不祥事報道検知

  Jason Bennett; 野原崇史; Fei Cheng; 石田隆; 宮尾祐介

  言語処理学会 第24回年次大会, Mar. 2018

  
• 時刻アノテーションから導出した時間順序関係による時間情報解析

  Fei Cheng; Yusuke Miyao

  言語処理学会 第24回年次大会, Mar. 2018

  
• Towards a Consistent Segmentation Level Across Multiple Chinese Word Segmentation Corpora

  Fei Cheng; Kevin Duh; Yuji Matsumoto

  Journal of Natural Language Processing, Dec. 2017, Peer-reviewed

  
• Classifying temporal relations by bidirectional LSTM over dependency paths

  Fei Cheng; Yusuke Miyao

  Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (ACL 2017), 2017, Peer-reviewed

  
• A Hybrid Ranking Approach to Chinese Spelling Check

  Xiaodong Liu*; Fei Cheng*; Kevin Duh; Yuji Matsumoto; (*)qual contribution

  ACM Trans. Asian Low-Resour. Lang. Inf. Process., Nov. 2015, Peer-reviewed

  
• Synthetic word parsing improves chinese word segmentation

  Fei Cheng; Kevin Duh; Yuji Matsumoto

  Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (ACL 2015), Volume 2, 2015, Peer-reviewed

  
• Parsing Chinese Synthetic Words with a Character-based Dependency Model

  Fei Cheng; Kevin Duh; Yuji Matsumoto

  LREC 2014 - NINTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2014, Peer-reviewed

  
• A Hybrid Chinese Spelling Correction Using Language Model and Statistical Machine Translation with Reranking

  Xiaodong Liu; Fei Cheng; Yanyan Luo; Kevin Duh; Yuji Matsumoto

  Proceedings of the Seventh SIGHAN Workshop on Chinese Language Processing, Oct. 2013, Peer-reviewed

  
• Using Large-scale unlabeled data for parsing internal structure of Chinese synthetic words

  Fei Cheng

  22 Mar. 2013, Peer-reviewed

  

Misc.

• 時間的常識理解へ向けた言語モデル構築への取り組み

  木村 麻友子; KANASHIRO Pereira Lis; 浅原 正幸; CHENG Fei; 越智 綾子; 小林 一郎

  2022年度人工知能学会全国大会（第36回）, Jun. 2022

  

Industrial Property Rights

• 特開2019-149072, 特願2018-034224, イベント時間情報特定システム

  宮尾祐介; 程飛; ジェイスンベネット; 野原崇史

  

Awards

• 16 Mar. 2023

  The Association for Natural Language Processing, Outstanding paper

  大規模言語モデルに基づく複数の外部ツールを利用した推論フレームワーク

  Tatsuro Inaba,Hirokazu Kiyomaru, Fei Cheng, Sadao Kurohashi
• 05 Aug. 2021

  The 15th International Workshop on Semantic Evaluation (SemEval-2021), Best System Paper Award (Honorable Mention)

  OCHADAI-KYOTO at SemEval-2021 Task 1: Enhancing Model Generalization and Robustness for Lexical Complexity Prediction

  Yuki Taya, Lis Kanashiro Pereira, Fei Cheng, and Ichiro Kobayashi

External funds: Kakenhi

• Temporal knowledge supervision for pre-training tranfer learning models

  Grant-in-Aid for Scientific Research on Innovative Areas (Research in a proposed research area)

  Complex systems

  Kyoto University

  程 飛

  From 01 Apr. 2021, To 31 Mar. 2023, Granted

  temporal knowledge;deep neural networks;transfer learning;temporal reasoning;knowledge pre-training;contrastive learning;Temporal Knowledge;Natural Language;Neural Networks;Deep Learning

  https://kaken.nii.ac.jp/grant/KAKENHI-PUBLICLY-21H00308/
• Exploring Deep Neural Networks for Temporal Information Extraction

  Grant-in-Aid for Scientific Research on Innovative Areas (Research in a proposed research area)

  Complex systems

  Kyoto University

  程 飛

  From 01 Apr. 2019, To 31 Mar. 2021, Project Closed

  Information extraction;Neural networks;Language processing;Temporal Information;Natural Language;Deep Learning;Information Extraction;Relation Extraction;Temporal Relation;Neural Networks;Multilingual Data

  https://kaken.nii.ac.jp/grant/KAKENHI-PUBLICLY-19H05318/
• Is "2019" Earlier than "2022"? Unsupervised Temporal Representation Learning via Contrastive Learning.

  Grant-in-Aid for Early-Career Scientists

  Basic Section 61030:Intelligent informatics-related

  Kyoto University

  程 飛

  From 01 Apr. 2023, To 31 Mar. 2025, Granted

  自然言語処理;大規模言語モデル;常識推論;時間的常識推論

  https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-23K16946/

Academic, Social Contribution

Committee Memberships

• From 2015, To Present

  Program Committee Member, Review Committee Member, TALLIP, ACL, NAACL, EMNLP, EACL, AAAI