Last days of the QSAR Challenge

Questions, answers, discussions related to SIAM SDM'11 Contest

Last days of the QSAR Challenge

Postby robertf » Sat Jan 22, 2011 2:20 am

Dear Contestants,

The SIAM SDM'11 contest is approaching its deadline. This is a friendly reminder that last possible time of submitting a solution is January 24th, 2011, at 23:00:00 CET (Central European Time). Please translate it to your time zone. If in doubt, observe the countdown clock in the Status panel next to "Left" - it's 2 days 21 hours and 39 minutes at the time of writing this reminder.

Let us take this opportunity to also remind of other contest rules:

1) Only the Final Test predictions will be taken into account in deciding the contest winner.
2) Only the *last* submission will be considered.
3) In the case of ties, earlier submissions will have higher preference.

Wishing you all the good luck, Organizers.
robertf
 
Posts: 32
Joined: Wed Oct 13, 2010 7:27 pm

Re: Last days of the QSAR Challenge

Postby j_scheibel » Mon Jan 24, 2011 8:06 pm

will you be sharing the final standing? I'm just curious how I did with the final submission (not really expecting to win, but wondered how well the algorithm worked and how well others did)
j_scheibel
 
Posts: 8
Joined: Fri Jan 08, 2010 11:18 pm

Re: Last days of the QSAR Challenge

Postby robertf » Mon Jan 24, 2011 9:27 pm

Yes, final results will be posted on the Leaderboard after they are calculated, checked, and re-checked.
robertf
 
Posts: 32
Joined: Wed Oct 13, 2010 7:27 pm

Re: Last days of the QSAR Challenge

Postby jamesxli » Wed Jan 26, 2011 6:12 pm

It suprised me that the two classes in the final test dataset are ordered into two consecutive sections.
Some algorithms/participants could have by chance used/exploited this ordering information.
jamesxli
 
Posts: 19
Joined: Wed Dec 09, 2009 6:55 pm

Re: Last days of the QSAR Challenge

Postby robertf » Wed Jan 26, 2011 7:45 pm

The probability of this occurring _by_chance_ is 1 / 1.28151258464689E+46
robertf
 
Posts: 32
Joined: Wed Oct 13, 2010 7:27 pm

Re: Last days of the QSAR Challenge

Postby jamesxli » Sat Jan 29, 2011 8:58 pm

It is hardly a mathmatical problem to estimate such probability.
Just like I write down my password on a pice of paper and put
it behind the monitor. What is the probablity that somebody looked there?
I do believe that the simple correlation between the sequence indexes
and output in the final test data compremised the integrety of this
contest, in a significant way.
jamesxli
 
Posts: 19
Joined: Wed Dec 09, 2009 6:55 pm

Re: Last days of the QSAR Challenge

Postby robertf » Mon Jan 31, 2011 11:09 pm

Dear James,

Please read my responses on "test labels".

Best regards,
Robert
robertf
 
Posts: 32
Joined: Wed Oct 13, 2010 7:27 pm


Return to SIAM SDM'11 Contest: Prediction of Biological Properties of Molecules from Chemical Structure

Who is online

Users browsing this forum: No registered users and 4 guests

cron