Basic Information

Faculty

• Faculty of Engineering

Email Address

• Email Address

  kastner.marc.2zkyoto-u.ac.jp

Professional Memberships

• From May 2023, To Present

  Institute of Electronics, Information and Communication Engineers (IEICE)
• From Apr. 2022, To Present

  IEEE Computer Society
• From Apr. 2022, To Present

  Institute of Electrical and Electronics Engineers (IEEE)
• From Apr. 2021, To Present

  ACM Special Interest Group on Multimedia (ACM SIGMM)
• From Apr. 2021, To Present

  Association for Computing Machinery (ACM)
• From Apr. 2020, To Present

  Information Processing Society of Japan

Academic Degree

• 25 Mar. 2020

  Nagoya University, Ph.D. (Informatics)
• 28 Feb. 2016

  TU Braunschweig, Master of Science (Computer Science)

Academic Resume (Graduate Schools)

• TU Braunschweig, Department of Computer Science, Computer Science, Master Program, Graduated
• Nagoya University, Graduate School of Informatics, Department for Intelligent Systems, Doctoral program, Graduated

Academic Resume (Undergraduate School/Majors)

• TU Braunschweig, Department of Computer Science, Graduated

High School

• High School

  Bismarckschule Hannover, Germany

Research History

• From Apr. 2022, To Present

  Kyoto University, Graduate School of Informatics Department of Intelligence Science and Technology, Assistant Professor
• From Apr. 2020, To Mar. 2022

  National Institute of Informatics, Digital Content and Media Sciences Research Division, Postdoctoral researcher

Language of Instruction

• English
• Japanese

ID,URL

• ORCID ID

  0000-0002-9193-5973

• J-Global ID

  202001005019885117

• Researcher number

  30966700

• External link

  https://www.marc-kastner.com/

researchmap URL

• https://researchmap.jp/mkastner

Research

Research Interests

• Computer Vision
• Perceptual information processing
• Multi-modal content processing
• Data mining
• Sentiment analysis
• Psycholinguistics
• Text processing
• Image analysis
• Multi-modal analysis

Research Areas

• Informatics, Human interfaces and interactions
• Informatics, Intelligent informatics
• Informatics, Perceptual information processing

Papers

• MVA2023 Small Object Detection Challenge for Spotting Birds: Dataset, Methods, and Results.

  Yuki Kondo; Norimichi Ukita; Takayuki Yamaguchi; Hao-Yu Hou; Mu-Yi Shen; Chia-Chi Hsu; En-Ming Huang; Yu-Chen Huang; Yu-Cheng Xia; Chien-Yao Wang; Chun-Yi Lee; Da Huo; Marc A. Kastner 0001; Tingwei Liu; Yasutomo Kawanishi; Takatsugu Hirayama; Takahiro Komamizu; Ichiro Ide; Yosuke Shinya; Xinyao Liu; Guang Liang; Syusuke Yasui

  CoRR, 2023

  
• MVA2023 Small Object Detection Challenge for Spotting Birds: Dataset, Methods, and Results

  Yuki Kondo; Norimichi Ukita; Takayuki Yamaguchi; Hao-Yu Hou; Mu-Yi Shen; Chia-Chi Hsu; En-Ming Huang; Yu-Chen Huang; Yu-Cheng Xia; Chien-Yao Wang; Chun-Yi Lee; Da Huo; Marc A. Kastner; Tingwei Liu; Yasutomo Kawanishi; Takatsugu Hirayama; Takahiro Komamizu; Ichiro Ide; Yosuke Shinya; Xinyao Liu; Guang Liang; Syusuke Yasui

  arXiv:2307.09143, Jul. 2023

  
• Small object detection for bird with swin transformer

  Da Huo; Marc A. Kastner; Tingwei Liu; Yasutomo Kawanishi; Takatsugu Hirayama; Takahiro Komamizu; Ichiro Ide

  18th Int. Conf. Machine Vision and Applications (MVA) Workshop, Jul. 2023, Peer-reviewed

  
• Computational measurement of perceived pointiness from pronunciation

  Chihaya Matsuhira; Marc A. Kastner; Takahiro Komamizu; Ichiro Ide; Takatsugu Hirayama; Yasutomo Kawanishi; Keisuke Doman; Daisuke Deguchi

  Multim. Tools Appl., Apr. 2023, Peer-reviewed

  
• Towards Captioning an Image Collection from a Combined Scene Graph Representation Approach

  Itthisak Phueaksri; Marc A. Kastner; Yasutomo Kawanishi; Takahiro Komamizu; Ichiro Ide

  MultiMedia Modeling, 29 Mar. 2023, Peer-reviewed

  
• Detection of Birds in a 3D Environment Referring to Audio-Visual Information

  Yasutomo Kawanishi; Ichiro Ide; Baidong Chu; Chihaya Matsuhira; Marc A. Kastner; Takahiro Komamizu; Daisuke Deguchi

  2022 18th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), 29 Nov. 2022

  
• Action Semantic Alignment for Image Captioning

  Da Huo; Marc A. Kastner; Takahiro Komamizu; Ichiro Ide

  2022 IEEE 5th International Conference on Multimedia Information Processing and Retrieval (MIPR), Aug. 2022, Peer-reviewed

  
• On Assisting Diagnoses of Pareidolia by Emulating Patient Behavior

  Zhaohui Zhu; Marc A. Kastner; Shin’ichi Satoh

  MultiMedia Modeling, 15 Mar. 2022, Peer-reviewed

  
• Personalized Fashion Recommendation Using Pairwise Attention

  Donnaphat Trakulwaranont; Marc A. Kastner; Shin’ichi Satoh

  MultiMedia Modeling, 15 Mar. 2022, Peer-reviewed

  
• Pose-aware Outfit Transfer between Unpaired in-the-wild Fashion Images.

  Donnaphat Trakulwaranont; Marc A. Kastner; Shin'ichi Satoh

  MMAsia, Dec. 2021, Peer-reviewed

  
• Imageability- and Length-Controllable Image Captioning.

  Marc A. Kastner; Kazuki Umemura; Ichiro Ide; Yasutomo Kawanishi; Takatsugu Hirayama; Keisuke Doman; Daisuke Deguchi; Hiroshi Murase; Shin'ichi Satoh

  IEEE Access, Nov. 2021, Peer-reviewed

  
• Reproducibility Companion Paper: Describing Subjective Experiment Consistency by p-Value P-P Plot.

  Jakub Nawala; Lucjan Janowski; Bogdan Cmiel; Krzysztof Rusek; Marc A. Kastner; Jan Zahálka

  MM '21: ACM Multimedia Conference, Oct. 2021, Peer-reviewed

  
• Reproducibility Companion Paper: Kalman Filter-Based Head Motion Prediction for Cloud-Based Mixed Reality.

  Serhan Gül; Sebastian Bosse; Dimitri Podborski; Thomas Schierl; Cornelius Hellge; Marc A. Kastner; Jan Zahálka

  MM '21: ACM Multimedia Conference, Oct. 2021, Peer-reviewed

  
• A multi-modal dataset for analyzing the imageability of concepts across modalities

  Marc A. Kastner; Chihaya Matsuhira; Ichiro Ide; Shin’ichi Satoh

  4th IEEE Int. Conf. on Multimedia Information Processing and Retrieval (MIPR2021), Sep. 2021, Peer-reviewed

  
• Pointedness of an image: Measuring how pointy an image is perceived

  Chihaya Matsuhira; Marc Aurel Kastner; Ichiro Ide; Yasutomo Kawanishi; Takatsugu Hirayama; Keisuke Doman; Daisuke Deguchi; Hiroshi Murase

  23rd Int. Conf. on Human-Computer Interaction (HCII2021), Jul. 2021, Peer-reviewed

  
• Tell as You Imagine: Sentence Imageability-Aware Image Captioning.

  Kazuki Umemura; Marc A. Kastner; Ichiro Ide; Yasutomo Kawanishi; Takatsugu Hirayama; Keisuke Doman; Daisuke Deguchi; Hiroshi Murase

  MultiMedia Modeling -27th Int. Conf., MMM2021, Prague, Czech Republic, June 22-24, 2021, Procs., Part II, Jakub Lokoč, Tomáš Skopal, Klaus Schoeffmann, Vasileios Mezaris, Xirong Li, Stefanos Vrochidis, Ioannis Patras eds., Lecture Notes in Computer Science, vol.12573, Jun. 2021, Peer-reviewed

  
• FashionGraph: understanding fashion data using scene graph generation

  Shabnam Sadegharmaki; Marc A. Kastner; Shin'ichi Satoh

  International Conference on Pattern Recognition (ICPR) 2020, Jan. 2021, Peer-reviewed

  
• Imageability Estimation using Visual and Language Features.

  Chihaya Matsuhira; Marc A. Kastner; Ichiro Ide; Yasutomo Kawanishi; Takatsugu Hirayama; Keisuke Doman; Daisuke Deguchi; Hiroshi Murase

  Proc ACM Int. Conf. on Multimedia Retrieval (ICMR), Oct. 2020, Peer-reviewed

  
• Estimating the imageability of words by mining visual characteristics from crawled image data.

  Marc A. Kastner; Ichiro Ide; Frank Nack; Yasutomo Kawanishi; Takatsugu Hirayama; Daisuke Deguchi; Hiroshi Murase

  Multim. Tools Appl., 2020, Peer-reviewed

  
• Browsing Visual Sentiment Datasets Using Psycholinguistic Groundings.

  Marc A. Kastner; Ichiro Ide; Yasutomo Kawanishi; Takatsugu Hirayama; Daisuke Deguchi; Hiroshi Murase

  MultiMedia Modeling -26th Int. Conf., MMM 2020, Daejeon, South Korea, Jan. 5-8, 2020, Procs., Part II, W.-H. Cheng, J. Kim, W.-T. Chu, P. Cui, J.-W. Choi, M.-C. Hu, W. De Neve eds., Lecture Notes in Computer Science, vol.11962, 2020, Peer-reviewed

  
• On Quantizing the Mental Image of Concepts for Visual Semantic Analyses

  Marc A. Kastner

  Proceedings of the 27th ACM International Conference on Multimedia, 15 Oct. 2019, Peer-reviewed

  
• Estimating the visual variety of concepts by referring to Web popularity.

  Marc A. Kastner; Ichiro Ide; Yasutomo Kawanishi; Takatsugu Hirayama; Daisuke Deguchi; Hiroshi Murase

  Multim. Tools Appl., 2019, Peer-reviewed

  
• Dependable Non-Volatile Memory.

  Arthur Martens; Rouven Scholz; Phil Lindow; Niklas Lehnfeld; Marc A. Kastner; Rüdiger Kapitza

  Proceedings of the 11th ACM International Systems and Storage Conference(SYSTOR), 2018, Peer-reviewed

  
• The Split Grid - A Hierarchical 1D-Grid-based Acceleration Data Structure for Ray Tracing.

  Pablo Bauszat; Marc Aurel Kastner; Martin Eisemann; Marcus A. Magnor

  35th Annual Conference of the European Association for Computer Graphics, 2014, Peer-reviewed

  

Misc.

• 類音語の連想性を考慮した未知語の発音に対する画像生成

  松平茅隼; カストナーマークアウレル; 駒水孝裕; 平山高嗣; 道満恵介; 井手一郎

  第26回画像の認識・理解シンポジウム(MIRU 2023),, Jul. 2023

  
• Image collection scene graph summarization enhancing relation predictor with external knowledge

  Itthisak Phueaksri; Marc A. Kastner; Yasutomo Kawanishi; Takahiro Komamizu; Ichiro Ide

  第26回画像の認識・理解シンポジウム(MIRU 2023), Jul. 2023

  
• Leverage semantic alignment of object relations for image captioning

  Da Huo; Marc A. Kastner; Takatsugu Hirayama; Takahiro Komamizu; Ichiro Ide

  第26回画像の認識・理解シンポジウム(MIRU 2023), Jul. 2023

  
• 固定視点映像からの会話注意行動理解

  松田有登; カストナーマークアウレル; 延原章平; 西野恒

  情報処理学会研究報告, 2023-CVIM-234(11), May 2023

  
• IPA-CLIP: Integrating Phonetic Priors into Vision and Language Pretraining

  Chihaya Matsuhira; Marc A. Kastner; Takahiro Komamizu; Takatsugu Hirayama; Keisuke Doman; Yasutomo Kawanishi; Ichiro Ide

  arXiv pre-print 2303.03144, 06 Mar. 2023

  
• Evoked emotion distribution learning through analysis of temporal user comments in social media videos

  Yiming Wang; Marc A. Kastner; Da Huo; Takahiro Komamizu; Takatsugu Hirayama; Ichiro Ide

  電子情報通信学会技術研究報告, MVE2022-92, Mar. 2023

  
• On estimating evoked emotions of social media videos through user comments analysis

  Yiming Wang; Marc A. Kastner; Takahiro Komamizu; Yasutomo Kawanishi; Takatsugu Hirayama; Ichiro Ide

  第25回画像の認識・理解シンポジウム(MIRU 2022), Jul. 2022

  
• 画像生成を介した語感から受ける印象の可視化の検討

  松平茅隼; カストナーマークアウレル; 駒水孝裕; 平山高嗣; 道満恵介; 川西康友; 井手一郎

  第25回画像の認識・理解シンポジウム(MIRU 2022), Jul. 2022

  
• Towards captioning an image collection using scene graph

  Itthisak Phueaksri; Marc A. Kastner; Yasutomo Kawanishi; Takahiro Komamizu; Ichiro Ide

  第25回画像の認識・理解シンポジウム(MIRU 2022), Jul. 2022

  
• Towards detecting birds from panorama video aided by Sound Source Localization

  Baidong Chu; Chihaya Matsuhira; Yasutomo Kawanishi; Marc A. Kastner; Takahiro Komamizu; Ichiro Ide; Daisuke Deguchi

  電子情報通信学会技術研究報告, MVE2021-50, Mar. 2022

  
• On modelling viewer sentiment of social media videos for attractive computing

  Marc A. Kastner; Shin'ichi Satoh

  電子情報通信学会技術研究報告, MVE2020-14, Sep. 2020

  
• 俯瞰支援のための文書彩色方法の検討 —単語から連想される色に基づく文書内容の可視化—

  松平茅隼; カストナーマークアウレル; 井手一郎; 川西康友; 平山高嗣; 道満恵介; 出口大輔; 村瀬洋

  電子情報通信学会技術研究報告, MVE2020-17, Sep. 2020

  
• A preliminary study on viewer sentiment analysis of social media videos

  Marc A. Kastner; Shin'ichi Satoh

  第23回画像の認識・理解シンポジウム(MIRU 2020), IS3-2-2, Aug. 2020

  
• 心像性を考慮した画像キャプショニングの検討

  梅村和紀; カストナーマークアウレル; 井手一郎; 川西康友; 平山高嗣; 道満恵介; 出口大輔; 村瀬洋

  第23回画像の認識・理解シンポジウム(MIRU 2020), IS3-2-1, Aug. 2020

  
• On the quantification of the mental image of visual concepts for multi-modal applications

  Marc A. Kastner; Ichiro Ide; Yasutomo Kawanishi; Takatsugu Hirayama; Daisuke Deguchi; Hiroshi Murase

  報処理学会研究報告, 2020-CVIM-222 (28), May 2020

  
• On visualizing psycholinguistic groundings for sentiment image datasets

  Marc A. Kastner; Ichiro Ide; Yasutomo Kawanishi; Takatsugu Hirayama; Daisuke Deguchi; Hiroshi Murase

  第22回画像の認識・理解シンポジウム(MIRU 2019), Jul. 2019

  
• A preliminary study on estimating word imageability labels using Web image data mining

  Marc A. Kastner; Ichiro Ide; Yasutomo Kawanishi; Takatsugu Hirayama; Daisuke Deguchi; Hiroshi Murase

  言語処理学会第25回年次大会, A4-7, Mar. 2019

  
• A survey on psychology - connecting perception, language, and memory studies with computer vision

  Marc A. Kastner; Yukitaka Tsuchiya; Kosuke Osumi; Ryo Akiyama; Lisa Kawai; Hiroya Ikeda

  第21回画像の認識・理解シンポジウム(MIRU 2018) 若手プログラム, Aug. 2018

  
• On understanding visual relationships of concepts by visualizing bag-of-visual-words models

  Marc A. Kastner; Ichiro Ide; Yasutomo Kawanishi; Takatsugu Hirayama; Daisuke Deguchi; Hiroshi Murase

  第21回画像の認識・理解シンポジウム(MIRU 2018), PS3-34, Aug. 2018

  
• Web画像の分布に基づく単語概念の視覚的な多様性の推定

  カストナーマークアウレル; 井手一郎; 川西康友; 平山高嗣; 出口大輔; 村瀬洋

  情報処理学会研究報告, 2018-CVIM-211(4), Mar. 2018

  
• A study on image captioning considering its imageability

  梅村 和紀; カストナー マーク アウレル; 井手 一郎; 川西 康友; 平山 高嗣; 道満 恵介; 出口 大輔; 村瀬 洋

  電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 (メディアエクスペリエンス・バーチャル環境基礎), 05 Mar. 2020

  
• 視覚特徴と言語特徴を用いた単語の心像性推定の検討

  松平茅隼; カストナー マークアウレル; 井手一郎; 川西康友; 平山高嗣; 道満恵介; 道満恵介; 出口大輔; 村瀬洋

  言語処理学会年次大会発表論文集(Web), 2020

  
• 画像キャプションの質的評価に向けた文の心像性推定手法の検討

  梅村和紀; カストナー マークアウレル; 井手一郎; 川西康友; 平山高嗣; 道満恵介; 出口大輔; 村瀬洋

  言語処理学会年次大会発表論文集(Web), 2019

  

Presentations

• Towards connecting multimedia contents with human impressions

  Marc A. Kastner

  Invited Talk, Ring lecture on Information Retrieval, Hiroshima City University, 01 Jun. 2023, Invited

  
• Towards human impressions of multimedia contents

  Marc A. Kastner

  Invited Talk, ERC Demoseries Workshop, 14 Mar. 2023, Invited

  

Awards

• 05 Mar. 2020

  「心像性に基づく画像キャプショニングの検討」によるMVE賞（電子情報通信学会）

External funds: Kakenhi

• Toward describing fine-grained details in computer vision through visual discrimination learning

  Grant-in-Aid for Early-Career Scientists

  Basic Section 61030:Intelligent informatics-related

  Kyoto University

  KASTNER MarcAurel

  From 01 Apr. 2023, To 31 Mar. 2025, Granted

  Computer Vision;Vision & Language;Fine-grained Data;Discrimination Learning

  https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-23K16945/

Education

Teaching subject(s)

• From 01 Apr. 2023, To 31 Mar. 2024

  Practice of Electrical and Electronic Engineering

  6201, Spring, Faculty of Engineering, 2
• From 01 Apr. 2023, To 31 Mar. 2024

  Computer Vision

  3175, Spring, Graduate School of Informatics, 2
• From 01 Apr. 2022, To 31 Mar. 2023

  Computer Vision

  3175, Spring, Graduate School of Informatics, 2

Academic, Social Contribution

Committee Memberships

• From May 2023, To Present

  Advisory Committee, IEICE PRMU
• From 2021, To Present

  Area Chair, ACM Multimedia