The Comparison of efficiency of Thesaurus vs. Ontology in Concepts Retrieval

Document Type : Research Article

Authors

• azam sanatjoo ¹
• Akram Fathian ²

¹ Assistant Professor of Library and Information Department, Ferdowsi University of Mashhad

² Doctoral student in the field of librarianship and information, Ferdowsi University of Mashhad

10.22067/riis.v1i2.10005

Abstract

The aim of the current research is to compare the capabilities of a thesaurus and an ontology for retrieval of concepts. The research also develops the methodology of ontology construction by implementing domain analysis methodology.
The present work by applying the domain analysis approach developed a prototype ontology named ASFAOnt in the domain of Indexing by reengineering a current thesaurus in Persian language named ASFA.
The ontology was evaluated by a retrieval test in which the usability and the performance of the ontology were investigated. Usability and performance were compared with a baseline, a classic-type thesaurus with the conventional thesaurus structure, ASFA thesaurus. The evaluation was carried out as a controlled experiment in which a group of information searchers, LIS master students, used the thesaurus and ontology to extract three keywords according to their in mind search queries. The evaluative study was followed by a qualitative analysis of the nature of concepts, individual relationships and the textual and visual display so as to provide an understanding of and insight into the quality of the ontology as well as to gather ideas for further development. In order to gather more validated data on users’ performance and satisfaction, thinking aloud technique was used. Also the experimental retrieval test in the usability test was followed by a questionnaire survey, constructed on the basis of ONTOMETRIC approach.
The result of the study indicates that ontology structure is useful and provides valuable inspiration for the user. Providing enriched conceptual content and specific relationships have stimulated users to do more interaction with the ontology and to achieve more satisfaction with the applicability and potential of the ontology in comparison with the thesaurus in the traditional structure.

Keywords

• ASFA thesaurus
• ASFAOnt
• Ontology
• Concepts Information Retrieval

---

References

 

Albrechtsen, H.; Pejtersen, A. M.(2003). Cognitive work analysis and work centered design of classification schemes. Knowledge Organization, 30 (3-4), 213-227.

Alonso, M. A. L. (1999). Conceptual thesauri as precision tools in scientific organization systems. Revista Interamericana de bibliotecologia , 22 (1),  21- 35. Retrieved July 5, 2011, from http://bibliotecologia.udea.edu.co/revinbi/Numeros/2201/abstract02.htm

Betts, R.; Marrable, D. (1991). Free text vs. controlled vocabulary- retrieval precision and recall over large databases. In D. I. Raitt (Ed.), Online information 91. Proceedings  of  the  Fifteeth  International  Online Information Meeting, December 10- 12, (pp. 153- 165). London: Oxford & New Hersey, Learned Information Ltd. Retrieved July 5, 2011, from http://cat.inist.fr/?aModele=afficheN&cpsidt=4594181

Castells, P.; Fernandez, M.; Vallet, D.; Mylonas, P.; Avrithis, Y (2005). Self-tuning Personalized Information Retrieval in an Ontology-Based Framework. In 1st IFIP WG 2.12 & WG 12.4 International Workshop on Web Semantics (SWWS 2005), 31 October - 4 November. Agia Napa, Cyprus. Retrieved July 5, 2011, from http://ir.ii.uam.es/~acemedia/publications/swws05.pdf

Chen, H.; Martinez, J.; Kirchhoff, A.; Schatz, B. R. (1998). Alleviating search uncertainty through concept associations: automatic indexing, co- occurance analysis, and parallel computing. Journal of the American Society for Information Science, 49 (3), 206- 216. Retrieved July 5, 2011, from http://onlinelibrary.wiley.com/doi/10.1002/(SICI)1097-4571(199803)49:3%3C206::AID-ASI3%3E3.0.CO;2-K/abstract

Chen, H.; Yim, T.; Fye, D. (1995). Automatic thesaurus generation for an electronic community system. Journal of the American Society for Information Science, 46 (3), 175- 193. Retrieved July 5, 2011, from http://onlinelibrary.wiley.com/doi/10.1002/(SICI)1097-4571(199504)46:3%3C175::AID-ASI3%3E3.0.CO;2-U/abstract

Ding, Y. (2001). IR and AI: The role of ontology. In Proceedings  of  the 4^th International Conference of Asian Digital Libraries (ICADL), December 10-12. Bangalore, India. Retrieved July 5, 2011, from http://www.ncsi.iisc.ernet.in/raja/opendl/cdrom/test-collections/eas/Papers-Ding.pdf

Fenichel, C. H. (1980). An examination of the relationship between searching behaviour and searcher background. Online Information Review, 4(4), 341- 347. Retrieved July 5, 2011, from http://www.emeraldinsight.com/journals.htm?articleid=1652944

Gauch, S.; Chaffee, J.; Pretschner, A. (2003). Ontology-based personalized search and browsing. Web Intelligence and Agent Systems, 1 (3- 4), 219-234. Retrieved July 5, 2011, from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.114.8208&rep=rep1&type=pdf

Guha, R. V.; McCool, R.; Miller, E. (2003). Semantic search. In Proceeding of the 12^th International World Wide Web Conference (WWW 2003), May 20-24, (pp. 700-709). Budapest, Hungary. Retrieved July 5, 2011, from http://portal.acm.org/citation.cfm?doid=775152.775250 

Hodge, G. (2000). Systems of Knowledge Organization for Digital Libraries: Beyond Traditional Authority Files. Retrieved April 25, 2010, from      http://www.clir.org/pubs/reports/pub91/contents.html

Kawtrakul, A.; Imsombut, A.; Thunyakijjanukit, A.; Soergel, D.; Liang, A.; Sini, M.; Johannsen, G.; Keizer, J. (2005). Automatic term relationship cleaning and refinement for AGROVOC. In Workshop on The Sixth Agricultural Ontology Service, Workshop "Ontologies: the more practical issues and experiences", July 25-28. Vila Real, Portugal. Retrieved November 2, 2009, from ftp://ftp.fao.org/docrep/fao/008/af240e/af240e00.pdf 

Khosravi, F.; Vazifedoost, A. (2007). Creating a Persian Ontology through Thesaurus: Reengineering for Organizing the Digital Library of the National Library of Iran. In Building An Information Society For All: Proceedings of the International Conference on Libraries, Information and Society, ICOLIS 2007, June 26-27. Petaling Jaya, Malaysia: 41-53. Retrieved 2009, from http://dspace.fsktm.um.edu.my/xmlui/handle/1812/285

Kiryakov, A.; Popov, B.; Terziev, I.; Manov, D.; Ognyanoff, D. (2004). Semantic Annotation, Indexing, and Retrieval. Journal of Web Sematics, 2 (1), 49-79. Retrieved July 5, 2011, from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.122.2996&rep=rep1&type=pdf

Kristiensen, J.; Jarvelin, K. (1990). The effectiveness of a searching thesaurus on free- text searching in a full- text database. International classification, 17 (2), 77- 84. Retrieved July 5, 2011, from http://www.uta.fi/~lijakr/ic.html

Lozano-Tello, A.;Gomez-Perez,A.(2004).ONTOMETRIC:A method to choose the appropriate ontology.Journal of database management,15(2),1- 18.

Markey, K., Atherton, P. & Newton, C. (1980). An analysis of controlled vocabulary and free text search statements in online searches. Online Review, 4(3), 225- 236. Retrieved July 5, 2011, from http://www.emeraldinsight.com/journals.htm?issn=1468-4527&volume=4&issue=3&articleid=1652936&show=html

Nielsen, M. L. (2000). Domain analysis, an important part of thesaurus construction. Methodologies and approaches. In D. Soergel, P. Srinivasan & B. Kwasnik (Eds.), Proceedings of the 11th  ASIS&T SIG/CR Classification Research Workshop, November 12, (pp. 9- 50).

Nielsen, M. L. (2001). A framework for work task  based  thesaurus  design.  Journal of Documentation, 57 (6), 774- 797.

Pejtersen, A.M. (1980). Design of a classification scheme for fiction based on an analysis of actual user-librarian communication, and use of the scheme for control of librarians’ search strategies. In O. Harbo & L. Kajberg (Eds.), Theory and application of information research. Proceedings of the 2^nd International Research Forum on Information Science, (pp. 146–159). London: Mansell.

Sanatjoo, A. (2007). Improvement of thesaurus design- through a work-task oriented methodology. Unpublished doctoral dissertation, Royal School of Library and Information Science, Denmark.

Shiri, A.A. & Revie, C. (2003) The Effects of Topic Complexity and Familiarity on Cognitive and Physical Moves in a Thesaurus-enhanced Search Environment. Journal of Information Science, 29(6), 517-526

Soergel, D.; Lauser, B.; Liang, A.; Fisseha, F.; Keizer, J.; Katz, S. (2004). Reengineering Thesauri for New Applications: the AGROVOC Example. Journal of Digital Information, 4 (4). Retrieved September 17, 2009, from    http://jodi.ecs.soton.ac.uk/Articles/v04/i04/Soergel

Spyridakis, Jan H. (1992). Conducting research in technical communication: the application of true experimental designs. Technical communications, 39 (4), 607-624.

Stojanovic, N. (2005). Ontology-based information retrieval: methods and tools for cooperative query answering. Unpublished doctoral dissertation, University of Karlsruhe, Germany. Retrieved July 5, 2011, from http://deposit.ddb.de/cgi-bin/dokserv?idn=1002399394&dok_var=d1&dok_ext=pdf&filename=1002399394.pdf

Stojanovic, N.; Studer, R.; Stojanovic, L. (2003). An Approach for the Ranking of Query Results in the Semantic Web. In D. Fensel, K. P. Sycara & J. Mylopoulos (Eds.), The Semantic Web – ISWC 2003, 2^nd International Semantic Web Conference. Lecture Notes in Computer Science, Vol. 2870. Springer Verlag, Berlin Heidelberg New York, (pp. 500-516), Retrieved July 5, 2011, from http://km.aifb.kit.edu/projects/semiport/Shared/Folder.2002-11-14.3032/bibliography_entry.2005-01-18.2289413216

Tudhope, D.; Alani, H.; Jones, C. (2001). Augmenting thesaurus relationships: possibilities for retrieval.  The Journal of Digital Information, 1(8). Retrieved September 17, 2009, from http://jodi.tamu.edu/Articles/v01/i08/Tudhope/%20visited%207-10-2004

Vallet, D.; Fernandez, M.; Castells, P. (2005). An Ontology-Based Information Retrieval Model. In 2^nd European Semantic Web Conference (ESWC 2005). Lecture Notes in Computer Science, Vol. 3532. Springer Verlag, Berlin Heidelberg New York, 455-470. Retrieved July 5, 2011, from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.66.4633&rep=rep1&type=pdf

Viinikkala, M. (2003). Ontology in information systems. Disponible en: < http://www.cs.tut.fi/~kk/webstuff/Ontology.pdf >. Fecha de acceso: 10 de Junio de 2005.