Skip to Main content Skip to Navigation
Conference papers

Categorisation of spoken social affects in Japanese: human vs. machine

Abstract : In this paper, we investigate the abilities of both human listeners and computers to categorise social affects using only speech. The database used is composed of speech recorded by 19 native Japanese speakers. It is first evaluated perceptually to rank speakers according to their perceived performance. The four best speakers are then selected to be used in a categorisation experiment in nine social affects spread across four broad categories. An automatic classification experiment is then carried out using prosodic features and voice quality related features. The automatic classification system takes advantages of a feature selection algorithm and uses Linear Discriminant Analysis. The results show that the performance obtained by automatic classification using only eight features is comparable to the performance produced by our set of listeners: three out of four broad categories are quite well identified whereas the seduction affect is poorly recognised either by the listeners or the computer.
Document type :
Conference papers
Complete list of metadata

Cited literature [13 references]  Display  Hide  Download
Contributor : Jean-Luc Rouas <>
Submitted on : Friday, October 16, 2020 - 9:43:53 AM
Last modification on : Sunday, May 2, 2021 - 3:30:16 AM


Publisher files allowed on an open archive


  • HAL Id : hal-02317743, version 1


Jean-Luc Rouas, Takaaki Shochi, Marine Guerry, Albert Rilliard. Categorisation of spoken social affects in Japanese: human vs. machine. International Congress of Phonetic Sciences ICPhS, Aug 2019, Melbourne, Australia. ⟨hal-02317743⟩



Record views


Files downloads