Automatic scoring of a sentence repetition task from voice recordings

Meysam Asgari; Allison Sliter; Jan Van Santen

doi:10.1007/978-3-319-45510-5_54

Automatic scoring of a sentence repetition task from voice recordings

Meysam Asgari, Allison Sliter, Jan Van Santen

Institute on Development and Disability

Research output: Chapter in Book/Report/Conference proceeding › Chapter

Abstract

In this paper, we propose an automatic scoring approach for assessing the language deficit in a sentence repetition task used to evaluate children with language disorders. From ASR-transcribed sentences, we extract sentence similarity measures, including WER and Levenshtein distance, and use them as the input features in a regression model to predict the reference scores manually rated by experts. Our experimental analysis on subject-level scores of 46 children, 33 diagnosed with autism spectrum disorders (ASD), and 13 with specific language impairment (SLI) show that proposed approach is successful in prediction of scores with averaged product-moment correlations of 0.84 between observed and predicted ratings across test folds.

Original language	English (US)
Title of host publication	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Publisher	Springer-Verlag
Pages	470-477
Number of pages	8
DOIs	https://doi.org/10.1007/978-3-319-45510-5_54
State	Published - 2016

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	9924 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/978-3-319-45510-5_54

Cite this

Asgari, M., Sliter, A., & Van Santen, J. (2016). Automatic scoring of a sentence repetition task from voice recordings. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (pp. 470-477). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9924 LNCS). Springer-Verlag. https://doi.org/10.1007/978-3-319-45510-5_54

Automatic scoring of a sentence repetition task from voice recordings. / Asgari, Meysam; Sliter, Allison; Van Santen, Jan.
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Springer-Verlag, 2016. p. 470-477 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9924 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Chapter

Asgari, M, Sliter, A & Van Santen, J 2016, Automatic scoring of a sentence repetition task from voice recordings. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9924 LNCS, Springer-Verlag, pp. 470-477. https://doi.org/10.1007/978-3-319-45510-5_54

Asgari M, Sliter A, Van Santen J. Automatic scoring of a sentence repetition task from voice recordings. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Springer-Verlag. 2016. p. 470-477. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-45510-5_54

Asgari, Meysam ; Sliter, Allison ; Van Santen, Jan. / Automatic scoring of a sentence repetition task from voice recordings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Springer-Verlag, 2016. pp. 470-477 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inbook{1f1569b386624ecbbebae9de81b96150,

title = "Automatic scoring of a sentence repetition task from voice recordings",

abstract = "In this paper, we propose an automatic scoring approach for assessing the language deficit in a sentence repetition task used to evaluate children with language disorders. From ASR-transcribed sentences, we extract sentence similarity measures, including WER and Levenshtein distance, and use them as the input features in a regression model to predict the reference scores manually rated by experts. Our experimental analysis on subject-level scores of 46 children, 33 diagnosed with autism spectrum disorders (ASD), and 13 with specific language impairment (SLI) show that proposed approach is successful in prediction of scores with averaged product-moment correlations of 0.84 between observed and predicted ratings across test folds.",

author = "Meysam Asgari and Allison Sliter and {Van Santen}, Jan",

note = "Publisher Copyright: {\textcopyright} Springer International Publishing Switzerland 2016.",

year = "2016",

doi = "10.1007/978-3-319-45510-5_54",

language = "English (US)",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer-Verlag",

pages = "470--477",

booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - CHAP

T1 - Automatic scoring of a sentence repetition task from voice recordings

AU - Asgari, Meysam

AU - Sliter, Allison

AU - Van Santen, Jan

PY - 2016

Y1 - 2016

N2 - In this paper, we propose an automatic scoring approach for assessing the language deficit in a sentence repetition task used to evaluate children with language disorders. From ASR-transcribed sentences, we extract sentence similarity measures, including WER and Levenshtein distance, and use them as the input features in a regression model to predict the reference scores manually rated by experts. Our experimental analysis on subject-level scores of 46 children, 33 diagnosed with autism spectrum disorders (ASD), and 13 with specific language impairment (SLI) show that proposed approach is successful in prediction of scores with averaged product-moment correlations of 0.84 between observed and predicted ratings across test folds.

AB - In this paper, we propose an automatic scoring approach for assessing the language deficit in a sentence repetition task used to evaluate children with language disorders. From ASR-transcribed sentences, we extract sentence similarity measures, including WER and Levenshtein distance, and use them as the input features in a regression model to predict the reference scores manually rated by experts. Our experimental analysis on subject-level scores of 46 children, 33 diagnosed with autism spectrum disorders (ASD), and 13 with specific language impairment (SLI) show that proposed approach is successful in prediction of scores with averaged product-moment correlations of 0.84 between observed and predicted ratings across test folds.

UR - http://www.scopus.com/inward/record.url?scp=85008411859&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85008411859&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-45510-5_54

DO - 10.1007/978-3-319-45510-5_54

M3 - Chapter

AN - SCOPUS:85008411859

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 470

EP - 477

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

PB - Springer-Verlag

ER -

Automatic scoring of a sentence repetition task from voice recordings

Abstract

Publication series

ASJC Scopus subject areas

Access to Document

Other files and links

Cite this