CLEF 2013 Evaluation Labs and Workshop

Online Working Notes
23 - 26 September, Valencia - Spain

Introduction to the Labs
  • Introduction to the CLEF2013 Labs and Workshop
    Roberto Navigli and Dan Tufis

Cultural Heritage in CLEF – CHiC
  • Cultural Heritage in CLEF (CHiC) 2013 – Multilingual Task Overview
    Vivien Petras, Toine Bogers, Nicola Ferro and Ivano Masiero

  • The Polish Task within Cultural Heritage in CLEF (CHiC) 2013. Torun Runs
    Piotr Malak

  • The CHiC Interactive Task (CHiCi) at CLEF2013
    Elaine G. Toms and Mark M. Hall


  • CHiC - Multilingual ad-hoc and Semantic Enrichment
    • Pseudo-Relevance Feedback for CLEF-CHiC Adhoc
      Ray R. Larson
    • UniNE at CLEF - CHiC 2013
      Mitra Akasereh, Nada Naji and Jacques Savoy
    • Multimedia Information Modeling and Retrieval (MRIM) /Laboratoire d'Informatique de Grenoble (LIG) at CHiC2013
      Kian Lam Tan, Mohannad ALMasri, Jean-Pierre Chevallet, Philippe Mulhem and Catherine Berrut
    • CEA LIST's Participation at the CLEF CHiC 2013
      Adrian Popescu
    • Identifying the Most Suitable Stemmer for the CHiC Multilingual Ad-hoc Task
      Thomas Wilhelm-Stein, Benjamin Schurer and Maximilian Eibl
    • Using the Divergence Framework for Randomness: CHiC 2013 Lab Report
      Diana Tanase

    CHiC - Polish Task
    • Polish Monolingual Task within Cultural Heritage in CLEF (CHiC) 2013. Wrocław Runs.
      Adam Pawłowski

    CHiC - Interactive Task
    • Sheffield Submission to the CHiC Interactive Task: Exploring Digital Cultural Heritage
      Mark Hall, Robert Villa, Sophie A Rutter, Daniel Bell, Paul Clough, and Elaine Toms
    • RSLIS/AAU at CHiC 2013
      Mette Skov, Toine Bogers, Haakon Lund, Maj Lauge Ward Jensen, Erik Wistrup and Birger Larsen
CLEFeHealth 2013
  • Task 1: ShARe/CLEF eHealth Evaluation Lab 2013
    Sameer Pradhan, Noemie Elhadad, Brett R. South, David Martinez, Lee Christensen, Amy Vogel, Hanna Suominen, Wendy W. Chapman and Guergana Savova

  • Task 2: ShARe/CLEF eHealth Evaluation Lab 2013
    Danielle L. Mowery, Brett R. South, Lee Christensen, Laura-Maria Murtola, Sanna Salantera, Hanna Suominen, David Martinez, Noemie Elhadad, Sameer Pradhan, Guergana Savova and Wendy W. Chapman

  • ShARe/CLEF eHealth Evaluation Lab 2013, Task 3: Information Retrieval to Address Patients' Questions when Reading Clinical Reports
    Lorraine Goeuriot, Gareth J.F. Jones, Liadh Kelly, Johannes Leveling, Allan Hanbury, Henning Müller, Sanna Salanterä, Hanna Suominen and Guido Zuccon


  • CLEFeHealth 2013 - Task 1: Identification and Normalization of Disorders in Clinical Reports
    • A Supervised Named-Entity Extraction System for Medical Text
      Andreea Bodnari, Louise Deleger, Thomas Lavergne, Aurelie Neveol and Pierre Zweigenbaum
    • Medical Disorder Recognition with Structural Support Vector Machines
      James Cogley, Nicola Stokes and Joe Carthy
    • Disorder Concept Identification from Clinical Notes: an Experience with the ShARe/CLEF 2013 Challenge
      Jung-wei Fan, Navdeep Sood and Yang Huang
    • Using Relations for Identi cation and Normalization of Disorders: Team CLEAR in the ShARe/CLEF 2013 eHealth Evaluation Lab
      James Gung
    • UCM at CLEF eHealth 2013 Shared Task1
      Lucia Hervas, Victor Martinez, Irene Sanchez and Alberto Diaz
    • NCBI at 2013 ShARe/CLEF eHealth Shared Task: Disorder Normalization in Clinical Notes with Dnorm
      Robert Leaman, Ritu Khare and Zhiyong Lu
    • Integrated cTAKES for Concept Mention Detection and Normalization
      Hongfang Liu, Kavishwar Wagholikar, Siddhartha Jonnalagadda and Sunghwan Sohn
    • Evaluation of YTEX and MetaMap for Clinical Concept Recognition
      John David Osborne, Binod Gyawali and Thamar Solorio
    • ShARe/CLEF eHealth 2013 Named Entity Recognition and Normalization of Disorders Challenge
      Jon D. Patrick, Leila Safari and Ying Ou
    • Performance of a Multi-class Biomedical Tagger on Clinical Records
      S. V. Ramanan, Shereen Broido and P. Senthil Nathan
    • Recognizing and Encoding Discorder Concepts in Clinical Text using Machine Learning and Vector Space Model
      Buzhou Tang, Yonghui Wu, Min Jiang, Joshua C. Denny and Hua Xu
    • UCSC’s System for CLEF eHealth 2013 Task 1
      Chunye Wang and Ramakrishna Akella
    • Combining MetaMap and cTAKES in Disorder Recognition: THCIB at CLEF eHealth Lab 2013 Task 1
      Yunqing Xia, Xiaoshi Zhong, Peng Liu, Cheng Tan, Sen Na, Qinan Hu and Yaohai Huang
    • Identify Disorders in Health Records using Conditional Random Fields and Metamap AEHRC at ShARe/CLEF 2013 eHealth Evaluation Lab Task 1
      Guido Zuccon, Alexander Holloway, Bevan Koopman and Anthony Nguyen

    CLEFeHealth 2013 - Task 2: Normalisation of Abbreviations and Acronyms in Clinical Reports
    • WVU NLP Class Participation in ShARe/CLEF Challenge
      V. Jagannathan, D. Ganesan, A. Jagannathan, R. Kavi, A. Lamb, F. Peters and S. Seeger
    • ShARe/CLEF eHealth 2013 Normalization of Acronyms/Abbreviations Challenge
      Jon D. Patrick, Leila Safari and Ying Ou
    • Clinical Acronym/Abbreviation Normalization using a Hybrid Approach
      Yonghui Wu, Buzhou Tang, Min Jiang, Sungrim Moon, Joshua C. Denny and Hua Xu
    • Normalization of Abbreviations/Acronyms: THCIB at CLEF eHealth 2013 Task 2
      Yunqing Xia, Xiaoshi Zhong, Peng Liu, Cheng Tan, Sen Na, Qinan Hu and Yaohai Huang
    • A Supervised Abbreviation Resolution System for Medical Text
      Pierre Zweigenbaum, Louise Deleger, Thomas Lavergne, Aurelie Neveol and Andreea Bodnari

    CLEFeHealth 2013 - Task 3: Information Retrieval Targeting Patient Information Needs
    • Lucene, MetaMap, and Language Modeling: OHSU at CLEF eHealth 2013
      Steven Bedrick and Golnar Sheikshabbafghi
    • Incorporating Statistical Topic Models in the Retrieval of Healthcare Documents
      Karla L Caballero Barajas and Ram Akella
    • Working Notes for TopSig at ShARe/CLEF eHealth 2013
      Timothy Chappell and Shlomo Geva
    • SNUMedinfo at CLEFeHealth2013 Task 3
      Sungbin Choi and Jinwook Choi
    • University of Glasgow at CLEF 2013: Experiments in eHealth Task 3 with Terrier
      Nut Limsopatham, Craig Macdonald and Iadh Ounis
    • Evaluation of Vector Space Models for Medical Disorders Information Retrieval
      Yaoyun Zhang, Trevor Cohen, Min Jiang, Buzhou Tang and Hua Xu
    • Concept-based Medical Document Retrieval: THCIB at CLEF eHealth Lab 2013 Task 3
      Xiaoshi Zhong, Yunqing Xia, Zhongda Xie, Sen Na, Qinan Hu and Yaohai Huang
    • Retrieval of Health Advice on the Web AEHRC at ShARe/CLEF eHealth Evaluation Lab Task 3
      G. Zuccon, B. Koopman and A. Nguyen
    • Using Discharge Summaries to Improve Information Retrieval in Clinical Domain
      Dongqing Zhu, Wu Stephen, Masanz James, Ben Carterette and Hongfang Liu

    CLEFeHealth 2013 - Student Mentoring Track
    • Using Text Mining to Explore Factors Associated with Acute Confusion in Cardiac Patients Documentation
      Laura-Maria Murtola, Lotta Kauhanen, Hans Moen, Heljä Lundgrén-Laine, Tapio Salakoski and Sanna Salanterä
Retrieval in the Intellectual Property Domain - CLEF-IP
  • Passage Retrieval Starting from Patent Claims A Clef-Ip 2013 Task Overview
    Florina Piroi, Mihai Lupu and Allan Hanbury

  • Report on the CLEF-IP 2013 Experiments: Multilayer Collection Selection on Topically Organized Patents
    Anastasia Giachanou, Michail Salampasis, Maya Satratzemi and Nikolaos Samaras

  • Query Formulation for Prior Art Search - Georgetown University at CLEF-IP 2013
    Jiyun Luo and Hui Yang

  • Innovandio S.A. at CLEF-IP 2013
    Andreas Eiselt and Gabriel Oberreuter

Cross Language Image Annotation and Retrieval - ImageCLEF
  • Overview of the ImageCLEF 2013 Scalable Concept Image Annotation Subtask
    Mauricio Villegas, Roberto Paredes and Bart Thomee

  • Overview of the ImageCLEF 2013 Personal Photo Retrieval Subtask
    David Zellhofer

  • The ImageCLEF 2013 Plant Identification Task
    Hervé Goeau, Pierre Bonnet, Alexis Joly, Vera Bakic, Daniel Barthelemy, Nozha Boujemaa and Jean-Francois Molino

  • Overview of the ImageCLEF 2013 Robot Vision Task
    Jesus Martinez-Gomez, Ismael Garcia-Varea, Miguel Cazorla and Barbara Caputo

  • Overview of the ImageCLEF 2013 Medical Tasks
    Alba G. Seco de Herrera, Jayashree Kalpathy Cramer, Dina Demner Fushman, Sameer Antani and Henning Müller


  • ImageCLEF - Photo Annotation and Retrieval
    • Renmin University of China at ImageCLEF 2013 Scalable Concept Image Annotation
      Xirong Li, Shuai Liao, Binbin Liu, Gang Yang, Qin Jin, Jieping Xu and Xiaoyong Du
    • URJC&UNED at ImageCLEF 2013 Photo Annotation Task
      Jesús Sánchez-Oro, Soto Montalvo, Antonio Sanz Montemayor, Juan José Pantrigo, Abraham Duarte, Victor Fresno and Raquel Martínez
    • CNRS - TELECOM ParisTech at ImageCLEF 2013 Scalable Concept Image Annotation Task: Winning Annotations with Context Dependent SVMs
      Hichem Sahbi
    • A Multimedia IR-based System for the Photo Annotation Task at ImageCLEF2013
      X. Benavent, A. Castellanos, E. de Ves, D. Hernández-Aranda, R. Granados and A. Garcia-Serrano
    • CEA LIST@ImageCLEF 2013: Scalable Concept Image Annotation
      Hervé Le Borgne, Adrian Popescu and Amel Znaidia
    • UNIMORE at ImageCLEF 2013: Scalable Concept Image Annotation
      Costantino Grana, Giuseppe Serra, Marco Manfredi, Rita Cucchiara, Riccardo Martoglia and Federica Mandreoli
    • MIL at ImageCLEF 2013: Personal Photo Retrieval
      Masaru Mizuochi, Takayuki Higuchi, Chie Kamada and Tatsuya Harada
    • BTU DBIS' Personal Photo Retrieval Runs at ImageCLEF 2013
      Thomas Bottcher, David Zellhofr, and Ingo Schmitt
    • MICC-UNIFI at ImageCLEF 2013 Scalable Concept Image Annotation
      Tiberio Uricchio, Marco Bertini, Lamberto Ballan and Alberto Del Bimbo
    • KDEVIR at ImageCLEF 2013 Image Annotation Subtask
      Ismat Ara Reshma, Md Zia Ullah, and Masaki Aonoy
    • MIL at ImageCLEF 2013: Scalable System for Image Annotation
      Masatoshi Hidaka, Naoyuki Gunji and Tatsuya Harada

    ImageCLEF - Plant identification
    • Inria's Participation at ImageCLEF 2013 Plant Identification Task
      Vera Bakic, Sofiene Mouine, Saloua Ouertani-Litayem, Anne Verroust-Blondet, Itheri Yahiaoui, Hervé Goeau and Alexis Joly
    • Has an Image Classification Approach any Chance at all (in Plant classification)?...
      Christoph Rasche, Laura Florea and Constantin Vertan
    • Late Information Fusion for Multi-modality Plant Species Identification
      Guillaume Cerutti, Laure Tougne, Celine Sacca, Thierry Joliveau, Pierre-Olivier Mazagol, Didier Coquin and Antoine Vacavant
    • SIFT, BoW Architecture and one-against-all Support Vector Machine
      Mohamed Issolah, Diane Lingrand and Frederic Precioso
    • AgSPPR at ImageCLEF 2013 Plant Identification Task
      Lu Zhang and Cheng Cai
    • Sabanci-Okan System at ImageClef 2013 Plant Identification Competition
      Berrin Yanikoglu, Erchan Aptoula, and S. Tolga Yildiran
    • NLab-UTokyo at ImageCLEF 2013 Plant Identification Task
      Hideki Nakayama
    • Combining Image Retrieval, Metadata Processing and Naive Bayes Classification at Plant Identification 2013
      Cristina Şerban, Alexandra Siriţeanu, Claudia Gheorghiu, Adrian Iftene, Lenuţa Alboaie and Mihaela Breabăn
    • BTU DBIS at ImageCLEF2013 Plant Identification Task
      Sascha Saretz and Thomas Böttcher
    • MICA at ImageClef 2013 Plant Identification Task
      Thi-Lan Le and Ngoc-Hai Pham

    ImageCLEF - Robot Vision
    • MIAR ICT Participation at Robot Vision 2013
      Ruihan Xu, Shuqiang Jiang, Xinhang Song, Shuang Wang, Yi Xie, Fang Wang and Xiong Lv
    • REGIMRobvid: Objects and Scenes Detection for Robot Vision 2013
      Amel Ksibi, Boudour Ammar, Anis Ben Ammar, Chokri Ben Amar and Adel M. Alimi

    ImageCLEF - Joint Task with Other Evaluation Initiatives : The ImageCLEF 2013 Medical Tasks
    • DEMIR at ImageCLEFMed 2013: The Effects of Modality Classification to Information Retrieval
      Okan Ozturkmenoglu, Nefise Meltem Ceylan and Adil Alpkocak
    • The medGIFT Group in ImageCLEFmed 2013
      Alba G. Seco de Herrera, Dimitrios Markonis, Roger Schaer, Ivan Eggel and Henning Müller
    • FCSE at Medical Tasks of ImageCLEF 2013
      Ivan Kitanovski, Ivica Dimitrovski and Suzana Loskovska
    • SNUMedinfo at ImageCLEF 2013: Medical Retrieval Task
      Sungbin Choi, Jeongeun Lee and Jinwook Choi
    • Fast Filtering Techniques in Medical Image Classification and Retrieval
      Xin Zhou, Miaofei Han, Yanli Song and Qiang Li
    • NovaSearch on Medical ImageCLEF 2013
      André Mourão, Flavio Martins and Joao Magalhaes
    • IPL at CLEF 2013 Medical Retrieval Task
      Spyridon Stathopoulos, Ismini Lourentzou, Antonia Kyriakopoulou and Theodore Kalamboukis
    • ITI's Participation in the 2013 Medical Track of ImageCLEF
      Matthew S. Simpson, Daekeun You, Md Mahmudur Rahman, Dina Demner-Fushman, Sameer Antani and George Thoma
    • Text-Based Medical Case Retrieval Using MeSH Ontology
      Mario Taschwer
INitiative for the Evaluation of XML retrieval – INEX
  • Overview of the INEX 2013 Linked Data Track
    Sairam Gurajada, Jaap Kamps, Arunav Mishra, Ralf Schenkel, Martin Theobald and Qiuyue Wang

  • Overview of the INEX 2013 Social Book Search Track
    Marijn Koolen, Gabriella Kazai, Michael Preminger and Antoine Doucet

  • Overview of the INEX 2013 Snippet Retrieval Track
    Matthew Trappett, Shlomo Geva, Andrew Trotman, Falk Scholer and Mark Sanderson

  • Overview of INEX Tweet Contextualization 2013 Track
    Patrice Bellot, Veronique Moriceau, Josiane Mothe, Eric SanJuan and Xavier Tannier


  • INEX - Searching Structured or Semantic Data
    • SPAR-Key: Processing SPARQL-Fulltext Queries to Solve Jeopardy! Clues
      Arunav Mishra, Sairam Gurajada and Martin Theobald

    INEX - Searching Professional and User Generated Data
    • RSLIS at INEX 2013: Social Book Search Track
      Toine Bogers and Birger Larsen
    • Comparing Topic Representations for Social Book Search
      Marijn Koolen, Hugo Huurdeman and Jaap Kamps
    • Social Feature Re-ranking in INEX 2013 Social Book Search Track
      Wei-Lun Xiao, Shih-Hung Wu, Liang-Pu Chen, Hung-Sheng Chiu, and Ren-Dar Yang
    • Book Recommendation based on Social Information
      Chahinez Benkoussasy and Patrice Belloty
    • OUC's Participation in the 2012 INEX Book and Linked-Data Tracks
      Michael Preminger and David Massey

    INEX - Focused Retrieval
    • Ultra-stemming and Statistical Summarization at INEX 2013 Tweet Contextualization Track
      Juan-Manuel Torres-Moreno and Patricia Velazquez-Morales
    • Tweet Contextualization: a Strategy Based on Document Retrieval Using Query Enrichment and Automatic Summarization
      Jorge Vivaldi and Iria da Cunha
    • An Automatic Greedy Summarization System at INEX 2013 Tweet Contextualization Track
      Andrea Carneiro Linhares
    • Effective Tweet Contextualization with Hashtags Performance Prediction and Multi-Document Summarization
      Romain Deveaud and Florian Boudin
    • A Pipeline Tweet Contextualization System at INEX 2013
      Khaled Hossain Ansary, Anh Tuan Tran and Nam Khanh Tran
    • IRIT at INEX 2013: Tweet Contextualization Track
      Liana Ermakova and Josiane Mothe
    • Refining Methodologies for the INEX 2013 Snippet Generation and Tweet Contextualization Tracks
      Carolyn J. Crouch, Donald B. Crouch, Swapnil Nawale, Mihir Atmakuri, Kiran Bushireddy and Sameer Kulkarni
    • Tweet Contextualization (Answering Tweet Question) – the Role of Multi-document Summarization
      Pinaki Bhaskar, Somnath Banerjee and Sivaji Bandyopadhyay
Uncovering Plagiarism, Authorship, and Social Software Misuse – PAN
  • Overview of the 5th International Competition on Plagiarism Detection
    Martin Potthast, Matthias Hagen, Tim Gollub, Martin Tippmann, Johannes Kiesel, Paolo Rosso, Efstathios Stamatatos and Benno Stein

  • Overview of the Author Identification Task at PAN 2013
    Patrick Juola and Efstathios Stamatatos

  • Overview of the Author Profiling Task at PAN 2013
    Francisco Rangel, Paolo Rosso, Moshe Koppel, Efstathios Stamatatos and Giacomo Inches


  • PAN - Plagiarism Detection
    • Text Alignment Module in CoReMo 2.1 Plagiarism Detector Notebook for PAN at CLEF 2013
      Diego A. Rodríguez Torrejón and José Manuel Martín Ramos
    • Guess Again and See if They Line up: Surrey’s Runs at Plagiarism Detection Notebook for PAN at CLEF 2013
      Lee Gillam
    • Unsupervised Ranking for Plagiarism Source Retrieval Notebook for PAN at CLEF 2013
      Kyle Williams, Hung-Hsuan Chen, Sagnik Ray Choudhury and C. Lee Giles
    • Approaches for Source Retrieval and Text Alignment of Plagiarism Detection Notebook for PAN at CLEF 2013
      Kong Leilei, Qi Haoliang, Du Cuixia,Wang Mingxing and Han Zhongyuan
    • Plagiarism Candidate Retrieval Using Selective Query Formulation and Discriminative Query Scoring Notebook for PAN at CLEF 2013
      Osama Haggag and Samhaa El-Beltagy
    • Diverse Queries and Feature Type Selection for Plagiarism Discovery Notebook for PAN at CLEF 2013
      Šimon Suchomel, Jan Kasprzak and Michal Brandejs
    • Using a Variety of n-Grams for the Detection of Different Kinds of Plagiarism Notebook for PAN at CLEF 2013
      Prasha Shrestha and Thamar Solorio
    • CopyCaptor : Plagiarized Source Retrieval System using Global Word Frequency and Local Feedback Notebook for PAN at CLEF 2013
      Taemin Lee, Jeongmin Chae, Kinam Park and Soonyoung Jung
    • Using Statistic and Semantic Analysis to Detect Plagiarism Notebook for PAN at CLEF 2013
      Victoria Elizalde
    • Source Retrieval via Naïve Approach and Passage Selection Heuristics Notebook for PAN at CLEF2013
      Ondřej Veselý, Tomáš Foltýnek and Jiří Rybička
    • Using Hybrid Similarity Methods for Plagiarism Detection Notebook for PAN at CLEF 2013
      Yurii Palkovskii and Alexei Belov

    PAN - Author Identification
    • Authorship Verification via k-Nearest Neighbor Estimation Notebook for PAN at CLEF 2013
      Oren Halvani, Martin Steinebach and Ralf Zimmermann
    • Lexical-Syntactic and Graph-Based Features for Authorship Verification Notebook for PAN at CLEF 2013
      Darnes Vilariño, David Pinto, Helena Gómez Saúl León and Esteban Castillo
    • A Textual Modus Operandi: Surrey’s Simple System for Author Identification Notebook for PAN at CLEF 2013
      Anna Vartapetiance and Lee Gillam
    • Intrinsic Author Identification Using Modified Weighted KNN Notebook for PAN at CLEF 2013
      M.R. Ghaeini
    • Distance Learning for Author Verification Notebook for PAN at CLEF 2013
      Paola Ledesma, Gibran Fuentes, Gabriela Jasso, Angel Toledo and Ivan Meza
    • Authorship Verification with Compression Features
      Cor J. Veenman and Zhenshi Li
    • Authorship Verification with Entity Coherence and Other Rich Linguistic Features Notebook for PAN at CLEF 2013
      Vanessa Wei Feng and Graeme Hirst
    • Local n-grams for Author Identification Notebook for PAN at CLEF 2013
      Robert Layton, Paul Watters and Richard Dazeley
    • Vector Space Model and Overlap Metric for Author Identification Notebook for PAN at CLEF 2013
      Arun Jayapal and Binayak Goswami
    • Authorship Identification Using Correlations of Frequent Features Notebook for PAN at CLEF 2013
      Timo Petmanson
    • Proximity Based One-class Classification with Common N-Gram Dissimilarity for Authorship Verification Task Notebook for PAN at CLEF 2013
      Magdalena Jankowska, Vlado Kešelj and Evangelos Milios
    • Authorship Detection with PPM Notebook for PAN at CLEF 2013
      Victoria Bobicev
    • Grammar Checker Features for Author Identification and Author Profiling Notebook for PAN at CLEF 2013
      Roman Kern
    • Style-based Distance Features for Author Verification Notebook for PAN at CLEF 2013
      Erwan Moreau and Carl Vogel
    • Authorship Verification Using the Impostors Method Notebook for PAN at CLEF 2013
      Shachar Seidman
    • A Basic Character N-gram Approach to Authorship Verification Notebook for PAN at CLEF 2013
      Michiel van Dam

    PAN - Author Profiling
    • Automatic Author Profiling Based on Linguistic and Stylistic Features Notebook for PAN at CLEF 2013
      Braja Gopal Patra, Somnath Banerjee, Dipankar Das, Tanik Saikh and Sivaji Bandyopadhyay
    • Content-centric Age and Gender Profiling Notebook for PAN at CLEF 2013
      Wee-Yong Lim, Jonathan Goh and Vrizlynn L. L. Thing
    • Author Profiling Using Style-based Features Notebook for PAN at CLEF 2013
      Seifeddine Mechti, Maher Jaoua and Lamia Hadrich Belguith
    • Author Pro ling Using Corpus Statistics, Lexicons and Stylistic Features Notebook for PAN at CLEF-2013
      Maria De-Arteaga, Sergio Jimenez, George Dueñas, Sergio Mancera and Julia Baquero
    • Experiments with SMS Translation and Stochastic Gradient Descent in Spanish Text Author Profiling Notebook for PAN at CLEF 2013
      Andrés Alfonso Caurcel Díaz and José María Gómez Hidalgo
    • Ensemble-based Classification for Author Profiling Using Various Features Notebook for PAN at CLEF 2013
      Michal Meina, Karolina Brodzinska, Bartosz Celmer, Maja Czoków, Martyna Patera, Jakub Pezacki and Mateusz Wilk
    • CanWe Hide in theWeb? Large Scale Simultaneous Age and Gender Author Profiling in Social Media Notebook for PAN at CLEF 2013
      Lucie Flekova and Iryna Gurevych
    • Two Methodologies Applied to the Author Profiling Task
      Yuridiana Aleman, Nahun Loya, Darnes Vilariño and David Pinto
    • Readability for Author Profiling? Notebook for PAN at CLEF 2013
      Lee Gillam
    • ITALICA at PAN 2013: An Ensemble Learning Approach to Author Profiling Notebook for PAN at CLEF 2013
      Fermín L. Cruz, Rafa Haro R. and F. Javier Ortega
    • INAOE’s Participation at PAN’13: Author Profiling Task Notebook for PAN at CLEF 2013
      A. Pastor López-Monroy, Manuel Montes-y-Gómez, Hugo Jair Escalante, Luis Villaseñor-Pineda and Esaú Villatoro-Tello
    • Using Simple Content Features for the Author Profiling Task Notebook for PAN at CLEF 2013
      Edson R. D. Weren, Viviane P. Moreira and José P. M. de Oliveira
    • A Framework for Plagiarism Detection Based on Author Profiling Notebook for PAN at CLEF 2013
      Seifeddine Mechti, Maher Jaoua and Lamia Hadrich Belguith
    • CNG Text Classification for Authorship Profiling Task Notebook for PAN at CLEF 2013
      Magdalena Jankowska, Vlado Kešelj, and Evangelos Milios
    • Author Profiling: Predicting Age and Gender from Blogs Notebook for PAN at CLEF 2013
      K Santosh, Romil Bansal, Mihir Shekhar and Vasudeva Varma
    • Author Profiling using LDA and Maximum Entropy Notebook for PAN at CLEF 2013
      Aditya Pavan, Aditya Mogadala and Vasudeva Varma
    • Style-based Distance Features for Author Profiling Notebook for PAN at CLEF 2013
      Erwan Moreau and Carl Vogel
    • Semantic-based Features for Author Profiling Identification: First insights Notebook for PAN at CLEF 2013
      Delia-Irazú Hernández, Rafael Guzmán-Cabrera, Antonio Reyes and Martha-Alicia Rocha
    • Author Profiling for English and Spanish Text Notebook for PAN at CLEF 2013
      Upendra Sapkota, Thamar Solorio, Manuel Montes-y-Gómez and Gabriela Ramírez-de-la-Rosa
Question Answering for Machine Reading Evaluation - QA4MRE
  • Overview of QA4MRE Main Task at CLEF 2013
    Richard Sutcliffe, Anselmo Peñas, Eduard Hovy, Pamela Forner, Álvaro Rodrigo, Corina Forascu, Yassine Benajiba and Petya Osenova

  • Machine Reading of Biomedical Texts about Alzheimer's Disease
    Roser Morante, Martin Krallinger, Alfonso Valencia, and Walter Daelemans

  • Overview of QA4MRE 2013 Entrance Exams Task
    Anselmo Peñas, Yusuke Miyao, Eduard Hovy, Pamela Forner and Noriko Kando


  • QA4MRE - Main task
    • VENSES GetAsk: a System for Hybrid Question Answering And Answer Recovery using Text Entailment
      Rodolfo Delmonte
    • Inter-Sentence Features and Thresholded Minimum Error Rate Training: NAIST at CLEF 2013 QA4MRE
      Philip Arthur, Graham Neubig, Sakriani Sakti, Tomoki Toda and Satoshi Nakamura
    • Question Answering System Using Query Expansion and Heuristic Features
      Yolanda Sjafrizal, Indra Budi, Mirna Adriani and Philip Arthur
    • Two Approaches for QA4MRE: Information Retrieval and Graph-based Knowledge Representation
      Helena Gomez-Adorno, David Pinto and Darnes Vilarino
    • Towards Knowledge-enriched Cross-Lingual Answer Validation
      Valentin Zhikov and Georgi Georgiev
    • An Approach to the Main Task of QA4MRE-2013
      Marilia Santos, Jose Saias and Paulo Quaresma
    • Using Anaphora Resolution in a Question Answering System for Machine Reading Evaluation
      Adrian Iftene, Alex Moruz and Eugen Ignat
    • A Hybrid Question Answering System for Multiple Choice Question (MCQ)
      Pinaki Bhaskar, Somnath Banerjee, Partha Pakray, Samadrita Banerjee, Sivaji Bandyopadhyay and Alexander Gelbukh
    • Selecting Answers with Structured Lexical Expansion and Discourse Relations LIMSI's Participation at QA4MRE 2013
      Martin Gleize, Brigitte Grau, Van-Minh Pho, Anne-Laure Ligozat, Gabriel Illouz, Frédéric Gianetti and Loïc Lahondes
    • Combining Text Mining Techniques for QA4MRE 2013
      Guilherme de Oliveira da Costa Marques and Mathias Verbeke

    QA4MRE - Machine Reading of Biomedical Texts about Alzheimer
    • Using a Question-Answering Approach in Machine Reading Task of Biomedical Texts about the Alzheimer Disease
      Dina Vishnyakova, Julien Gobeill and Patrick Ruch
    • Building Optimal Question Answering System Automatically using Configuration Space Exploration (CSE) for QA4MRE 2013 Tasks
      Alkesh Patel, Zi Yang, Eric Nyberg and Teruko Mitamura

    QA4MRE - Entrance Exams
    • Question Answering System for Entrance Exams in QA4MRE
      Xinjian Li, Tian Ran, Ngan L.T. Nguyen, Yusuke Miyao, and Akiko Aizawa
    • Multiple Choice Question (MCQ) Answering System for Entrance Examination
      Somnath Banerjee, Pinaki Bhaskar, Partha Pakray, Sivaji Bandyopadhyay and Alexander Gelbukh
    • NAIST at the CLEF 2013 QA4MRE Pilot Task
      Philip Arthur, Graham Neubig, Sakriani Sakti, Tomoki Toda and Satoshi Nakamura
Question Answering over Linked Data - QALD-3
  • QALD-3: Multilingual Question Answering over Linked Data
    Elena Cabrio, Philipp Cimiano, Vanessa Lopez, Axel-Cyrille Ngonga Ngomo, Christina Unger, and Sebastian Walter

  • CASIA@QALD-3: A Question Answering System over Linked Data
    Shizhu He, Shulin Liu, Yubo Chen, Guangyou Zhou, Kang Liu and Jun Zhao

  • squall2sparql: a Translator from Controlled English to Full SPARQL 1.1
    Sébastien Ferré

  • Scalewelis: a Scalable Query-based Faceted Search System on Top of SPARQL Endpoints
    Joris Guyonvarch and Sébastien Ferré

  • A HMM-based Approach to Question Answering against Linked Data
    Cristina Giannone, Valentina Bellomaria and Roberto Basili

  • Intui2: A Prototype System for Question Answering over Linked Data
    Corina Dima

  • SWIP at QALD-3: Results, Criticisms and Lesson Learned
    Camille Pradel, Guillaume Peyet, Ollivier Haemmerl e and Nathalie Hernandez

Online Reputation Management - RepLab
  • RepLab 2013: Comparative Evaluation of Online Reputation Monitoring Systems and Components
    Enrique Amigo, Jorge Carrillo-de-Albornoz, Irina Chugur, Adolfo Corujo, Julio Gonzalo, Tamara Martin, Edgar Meij, Maarten de Rijke and Damiano Spina

  • Modelling Techniques for Twitter Contents: A Step beyond Classification based Approaches
    Angel Castellanos, Juan Cigarrán and Ana García-Serrano

  • REINA at RepLab2013 Topic Detection Task: Community Detection
    José Luis Alonso Berrocal, Carlos G. Figuerola and Ángel Zazo Rodríguez

  • UAMCLyR at Replab2013: Monitoring Task
    Christian Sanchez-Sanchez, Hector Jimenez-Salazar, and Wulfrano Arturo Luna-Ramirez

  • Filtering and Polarity Detection for Reputation Management on Tweets
    Viktor Hangya and Richárd Farkas

  • LIA@RepLab 2013
    Jean-Valere Cossu, Benjamin Bigot, Ludovic Bonnefoy, Mohamed Morchid, Xavier Bost, Gregory Senay, Richard Dufour, Vincent Bouvier, Juan-Manuel Torres-Moreno and Marc El-Beze

  • UNED Online Reputation Monitoring Team at RepLab 2013
    Damiano Spina, Jorge Carrillo-de-Albornoz, Tamara Martin, Enrique Amigo, Julio Gonzalo and Fernando Giner

  • Semantic Space Models for Profiling Reputation of Corporate Entities
    Jussi Karlgren and Linus Ericsson

  • UAMCLyR at RepLab 2013: Profiling Task
    Esau Villatoro-Tello, Carlos Rodrıguez-Lucatero, Christian Sanchez-Sanchez and A. Pastor Lopez-Monroy

  • POPSTAR at RepLab 2013: Polarity for Reputation Classification
    Joao Filgueiras and Silvio Amir

  • In Search of Reputation Assessment: Experiences with Polarity Classification in RepLab 2013
    José Saias

  • DLSI-Volvam at RepLab 2013: Polarity Classification on Twitter Data
    Alejandro Mosquera, Javi Fernandez, Jose M. Gomez, Patricio Martinez-Barco and Paloma Moreda

  • Towards an Active Learning System for Company Name Disambiguation in Microblog Streams
    Maria-Hendrike Peetz, Damiano Spina, Julio Gonzalo and Maarten de Rijke

  • POPSTAR at RepLab 2013: Name Ambiguity Resolution on Twitter
    Pedro Saleiro, Luis Rei, Arian Pasquali, Carlos Soares, Jorge Teixeira, Fabio Pinto, Mohammad Nozari, Catarina Felix and Pedro Strecht

  • CIRG IRGDISCO at RepLab2013 Filtering Task: Use of Wikipedia's Graph Structure for Entity Name Disambiguation in Tweets
    Muhammad Atif Qureshi, Arjumand Younus, Daniel Abril, Colm O'Riordan and Gabriella Pasi

  • UNED-READERS: Filtering Relevant Tweets using Probabilistic Signature Models
    Henry Anaya-Sanchez, Anselmo Penas, and Bernardo Cabaleiro

  • Using Linked Open Data Sources for Entity Disambiguation
    Esther Villar Rodríguez, Ana I. Torre Bastida, Ana García Serrano and Marta González Rodríguez

Entity Recognition @ CLEF - CLEF-ER 2013
  • Multilingual Semantic Resources and Parallel Corpora in the Biomedical Domain: the CLEF-ER Challenge
    Dietrich Rebholz-Schuhmann, Simon Clematide, Fabio Rinaldi, Senay Kafkas, Erik M. van Mulligen, Chinh Bui, Johannes Hellrich, Ian Lewin, David Milward, Michael Poprat, Antonio Jimeno-Yepes, Udo Hahn and Jan A. Kors.

  • Multilingual Named-Entity Recognition from Parallel Corpora
    Andreea Bodnari, Aurélie Névéol, Ozlem Uzuner, Pierre Zweigenbaum, and Peter Szolovits

  • Exploiting BabelNet for Multilingual Biomedical Synonym Expansion
    Simon Clematide, Martin Davtyan, Fabio Rinaldi, and Dietrich Rebholz-Schuhmann

  • Machine Translation of Bio-Thesauri
    Erik M. van Mulligen, Quoc-Chinh Bui, Jan A. Kors

  • An Evaluation of the Concept Retrieval Annotation for Spanish-English CLEFER Parallel Corpora
    Rafael Berlanga, Antonio Jimeno-Yepes, María Pérez-Catalán and Dietrich Rebholz-Schuhmann

  • Creating Multilingual Gold Standard Corpora for Biomedical Concept Recognition
    Jan A. Kors, Simon Clematide, Saber A. Akhondi, Erik M. van Mulligen and Dietrich Rebholz-Schuhmann

  • Deriving an English Biomedical Silver Standard Corpus for CLEF-ER
    Ian Lewin and Simon Clematide

  • The JULIE LAB MANTRA System for the CLEF-ER 2013 Challenge
    Johannes Hellrich and Udo Hahn

  • A Dutch Treat for Healthcare Terminology
    Ronald Cornet

  • A Semi-Automatically Enriched Multi-Lingual Terminology in Commercial Products
    P. Daumke, M. Poprat, D. Milward and I. Lewin

  • German-Language Content in Biomedical Vocabularies
    Stefan Schulz, Josef Ingenerf, Sylvia Thun and Philipp Daumke

  • An Overview of Terminological Resources available for French bioNLP
    Aurélie Névéol, Dietrich Rebholz-Schuhmann and Pierre Zweigenbaum

  • Multi-lingual Features of the Unified Medical Language System
    Olivier Bodenreider

  • Machine Translation for Entity Recognition across Languages in Biomedical Documents
    Giuseppe Attardi, Andrea Buzzelli and Daniele Sartiano


ISBN 978-88-904810-5-5
ISSN 2038-4963

editors: Pamela Forner, Roberto Navigli, Dan Tufis