Medical image retrieval and automatic annotation: OHSU at ImageCLEF 2007

Jayashree Kalpathy-Cramer, William Hersh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations


Oregon Health and Science University participated in the medical retrieval and medical annotation tasks of ImageCLEF 2007. In the medical retrieval task, we created a web-based retrieval system built on a full-text index of both image and case annotations. The text-based search engine was implemented in Ruby using Ferret, a port of Lucene and a custom query parser. In addition to this textual index of annotations, supervised machine learning techniques using visual features were used to classify the images based on image acquisition modality. All images were annotated with the purported modality. Purely textual runs as well as mixed runs using the purported modality were submitted, with the latter performing among the best of all participating research groups. In the automatic annotation task, we used the 'gist' technique to create the feature vectors. Using statistics derived from a set of multi-scale oriented filters, we created a 512-dimensional vector. PCA was then used to create a 100-dimensional vector. This feature vector was fed into a two layer neural network. Our error rate on the 1000 test images was 67.8 using the hierarchical error calculations.

Original languageEnglish (US)
Title of host publicationAdvances in Multilingual and Multimodal Information Retrieval - 8th Workshop of the Cross-Language Evaluation Forum, CLEF 2007, Revised Selected Papers
Number of pages8
ISBN (Print)3540857591, 9783540857594
StatePublished - 2008
Event8th Workshop of the Cross-Language Evaluation Forum, CLEF 2007 - Budapest, Hungary
Duration: Sep 19 2007Sep 21 2007

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5152 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Other8th Workshop of the Cross-Language Evaluation Forum, CLEF 2007

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)


Dive into the research topics of 'Medical image retrieval and automatic annotation: OHSU at ImageCLEF 2007'. Together they form a unique fingerprint.

Cite this