Improving retrieval using external annotations: OHSU at imageCLEF 2010

Steven Bedrick, Jayashree Kalpathy-Cramer

Research output: Contribution to journalConference articlepeer-review

1 Scopus citations


Over the past several years, our team has focused its efforts on improving retrieval precision performance by mixing visual and textual information. This year, we chose to explore ways in which we could use external data to enrich our retrieval system's data set; specifically, we annotated each image in the test collection with a set of MeSH headings from two different sources: human-assigned MEDLINE index terms, and automatically-assigned MeSH headings (via the National Library of Medicine's MetaMap software). In addition to exploring these different data enrichment techniques, we also revamped the architecture of our retrieval system itself. In past years, we have used a two-tiered approach wherein the data is stored in a relational database (RDBMS), but the indexing and searching are done using Lucene-like system. This year, we took advantage of our RDBMS's full-text search capabilities and performed both storage and searching in the RDBMS. This turned out to have both positive and negative effects at a practical level. On the one hand, using the database's built-in text retrieval subsystem resulted in improved retrieval speed and easier query analysis; however, these gains came at the cost of reduced exibility and increased code complexity. Our experiments investigated the effects of using various combinations of human- and automatically-assigned MeSH terms, along with several of the techniques that have proved useful in previous years. We found that including automatically-assigned MeSH terms sometimes provided a small amount of improvement (in terms of bpref, MAP, and early precision) and sometimes hurt performance, whereas including the humanassigned MEDLINE index headings consistently yielded a sizable improvement in those same metrics.

Original languageEnglish (US)
JournalCEUR Workshop Proceedings
StatePublished - 2010
Event2010 Cross Language Evaluation Forum Conference, CLEF 2010 - Padua, Italy
Duration: Sep 22 2010Sep 23 2010

ASJC Scopus subject areas

  • Computer Science(all)


Dive into the research topics of 'Improving retrieval using external annotations: OHSU at imageCLEF 2010'. Together they form a unique fingerprint.

Cite this