Call for Participation in the PIR-CLEF 2018 Task
The goal of the PIR-CLEF 2018 Task is to investigate methods to enable comparative evaluations of PIR.
For the PIR-CLEF 2018 Pilot Task we are making available user profile data and raw search data produced by guided search sessions undertaken by 10 volunteer users. The data provided include the submitted queries, baseline ranked lists of documents retrieved using a standard search system in response to each query, the items clicked by the user in response to this list, and document relevance information provided by the user on a 4-grade scale. Each session was performed by the users on a topic of their choosing, and search was carried out over a subset of the ClueWeb12 web collection.
The aim of the task is to use to use the provided personal and prior search information to improve over a baseline ranking of documents judged relevant to the query by the user who entered the query.
We encourage participants to attempt the task using existing algorithms and to explore new ideas. We also welcome contributions examining details of the task and dataset.
Participants in any aspect of the PIR-TASK are encouraged to submit a paper up to 6 pages in length describing their work for inclusion in the proceedings as part of the CLEF 2018 Labs. The workshop is open to the submission of papers reporting on feedback on the task. Further details of paper submission instructions and deadlines are available at the submission page.
Participants are encouraged to attend the PIR-CLEF workshop to be held at CLEF 2018.
The Pilot Task data will be provided in csv format. Access to the indexed ClueWeb12 collection will be provided by the Dublin CIty University via API.
The links for ClueWeb API are:
http://clueweb.adaptcentre.ie/WebSearcher/search?query=“query String”&page=pagenumber
http://clueweb.adaptcentre.ie/WebSearcher/search?query=”query String”&selection=[selection numbers separated by comma]