submission file

Q&A related to the challenge: JRS 2012 DM Competition: Topical Classification of Biomedical Research Papers

submission file

Postby sofos » Tue Jan 10, 2012 3:46 am

Is it possible to predict 0 labels for some test instances? In some cases the algorithm gives low scores for all labels..
sofos
 
Posts: 3
Joined: Sat Jun 25, 2011 5:02 pm

Re: submission file

Postby sofos » Tue Jan 10, 2012 3:55 am

I actually just tried to submit a prediction containing some empty rows and I got an error. I believe that empty rows should be allowed!
sofos
 
Posts: 3
Joined: Sat Jun 25, 2011 5:02 pm

Re: submission file

Postby NosferatoCorp » Tue Jan 10, 2012 10:01 am

Hello,

The empty rows were prohibited for practical reasons. In many cases it may help participants to realize that there is something wrong with their solution.

Every document in the both data sets has at least one label. If your algorithm does not assign any topic to some cases, it is actually better for you to give them some randomly selected labels. It will never make your score worse than it would be in a case of leaving an empty row (precision equal to zero).

Best regards,
Andrzej Janusz
NosferatoCorp
 
Posts: 15
Joined: Tue Jul 13, 2010 5:44 pm


Return to JRS 2012 Data Mining Competition: Topical Classification of Biomedical Research Papers

Who is online

Users browsing this forum: No registered users and 2 guests

cron