From August 1st until August 31st, 2017, the second and last round of TREC OpenSearch 2017 will run. TREC OpenSearch is a platform which allows information retrieval researchers to receive feedback on their rankings from real, unsuspecting users. It is still possible until August 1st to sign up, submit rankings and take part in the competition!
Signing up as participant
- The participant guide describes step-by-step how to take part in TREC OpenSearch.
- The Guidelines page on the website gives guidelines for the 2017 edition.
- Signing up directly is possible here.
The timeline for TREC OpenSearch 2017 is as follows:
- Trial round: July 1st – July 15, 2017
- Real round: August 1st – August 31st, 2017
We will be using a new data collection from SSOAR, which is now online. You can register your teams via http://dashboard.trec-open-search.org/user/register/ and you submit your runs.
We present the results for Round #1 and #2 of the TREC 2016 Open Search track.
Continue reading Round #1 and #2 results
The detailed guidelines have been made available. Consider this document a living draft, which may be updated with clarifications or additional explanations, if needed.
There will be three evaluation rounds (Jun 1 – July 15, Aug 1 – Sep 15, and Oct 1 – Nov 15).
The first round should be seen as a “trial” round, mainly meant to test the whole infrastructure and to allow participants familiarize themselves with the procedure. Only CiteSeerX and SOAR are participating in this round; their test queries are already available.
We just received news that Microsoft Academic Search will join TREC OpenSearch, next to SSOAR and CiteSeerX. See our information on sites for more information.
Great news, we just got word that CiteSeerX will join TREC OpenSearch. Their queries, documents and clicks will come your way soon!
Today, we had our first TREC OpenSearch planning session. These slides provoked a lively discussion. We will work on incorporating the things that came up! We will be back soon with a timeline.
We are happy to announce that our OpenSearch proposal has been accepted to run as a track at TREC. Read about the TREC OpenSearch track and stay tuned for updates!
Anne Schuth, University of Amsterdam
Krisztian Balog, University of Stavanger