I received yesterday an email from Dr. Ellen Voorhees, Chair, TREC Program Committee, informing us of the new track proposal for TREC 2009. For those not familiar with TREC, as part of NIST, is where proponents gather to explore new IR and search technologies, retrieval models, frameworks, etc.

Sorry, but SEO non sense or hearsays are not allowed at TREC.

For additional information, visit http://trec.nist.gov/overview.html.

To disseminate the good news to our IR audience, I am reproducing the call below.

Dear TREC community,

TREC uses a track proposal mechanism to select the set of tracks to be run in a given TREC. We are currently soliciting proposals for tracks to include in TREC 2009. All candidate tracks (both existing and newly proposed) must submit a proposal by September 15, 2008. The submission deadline is in mid-September so that the TREC program committee will have time to make track selections before the TREC 2008 meeting in November. This allows the track discussions held at the TREC meeting to be informed as to the status of the track for the following year.

The criteria for judging a track proposal are as before: a strong advocate who is willing to be the track coordinator (track coordinator is a volunteer position); a large enough core of interested researchers to make the track viable; the availability of sufficient resources such as appropriate corpora and assessors with expertise in the area; and the fit with other tracks.

Proposals need to contain enough information for the PC to assess the criteria above. Proposals should contain an explicit statement of the goals of the track (i.e., what is expected to be learned and/or what infrastructure would be created if the track were run). If relevance judging (or some similar sort of annotation) is required, the proposal needs to include where the judging would occur (NIST or elsewhere?), any special qualifications the assessors would need (special domain expertise required?), as well as an estimate of the amount of time such assessing would will require. Any special constraints on the document sets needed should also be noted. Finally, proposals must contain full contact details of the proposer.

Proposals should be sent as either a postscript, PDF, or ASCII document to trec@nist.gov.

Ellen Voorhees
Chair, TREC program committee

Advertisements