Milestones

Questions, answers, discussions related to the FIND Technologies Inc. challenge

Milestones

Postby franklabella » Thu May 26, 2011 7:24 pm

Dear Participants,

Thank you for your valuable insights and comments. Because of apparent difficulty of the task, we decided to introduce milestones, at 50, 60, 70, 80 and 90% accuracy. The first team or participant who achieves a given milestone will receive $1,000 prize (no intellectual property transfer). The grand prize, awarded for 95% accuracy, will be decreased to $40,000, so that the prize pool stays at $45,000.

If the results continue to be unsatisfactory, we will consider providing more newly collected data.

Thank you for participation.

Frank LaBella
The Organizers
franklabella
 
Posts: 13
Joined: Thu May 12, 2011 12:08 am

Re: Milestones

Postby sanchom » Thu May 26, 2011 8:12 pm

What does your algorithm achieve on this competition dataset?
sanchom
 
Posts: 4
Joined: Sat May 14, 2011 12:14 am

Re: Milestones

Postby richchan » Mon May 30, 2011 9:30 am

Since we now have multiple milestones, can we keep a page updated to see which milestones have already been achieved?
richchan
 
Posts: 1
Joined: Fri May 13, 2011 8:19 am

Re: Milestones

Postby Jafar » Mon May 30, 2011 5:53 pm

Is the current state of the leaderboard valid? If yes I'd like to congratulate Ravishankar Sivalingam :)
Jafar
 
Posts: 3
Joined: Tue May 17, 2011 7:39 am

Re: Milestones

Postby jake » Tue May 31, 2011 4:29 pm

richchan wrote:Since we now have multiple milestones, can we keep a page updated to see which milestones have already been achieved?


I also think this would be a good idea. As has been pointed out elsewhere in the forums, the way the leaderboard is calculated is not ideal, and can lead to significant over- and underestimation of the true performance on the complete set (which is what the milestones are actually based on).
jake
 
Posts: 6
Joined: Sat May 14, 2011 12:30 am

Re: Milestones

Postby TunedIT » Tue May 31, 2011 5:54 pm

No milestone has been passed till now. When a milestone is achieved, information about this will be posted immediately in this thread and on the main challenge web page.
TunedIT
 
Posts: 26
Joined: Fri Oct 09, 2009 6:45 pm

Re: Milestones

Postby jake » Tue May 31, 2011 7:59 pm

TunedIT wrote:No milestone has been passed till now. When a milestone is achieved, information about this will be posted immediately in this thread and on the main challenge web page.

Clearly the leaderboard system needs an overhaul...
jake
 
Posts: 6
Joined: Sat May 14, 2011 12:30 am

Re: Milestones

Postby William_Cukierski » Fri Jun 03, 2011 2:31 pm

I second the leaderboard overhaul. The whole reason to have a contest is to spur competition among participants. When nobody else knows how well anybody else is actually doing, it takes a big chunk of the incentive out of it.
William_Cukierski
 
Posts: 2
Joined: Fri May 13, 2011 8:08 pm

Re: Milestones

Postby tritical » Wed Jun 22, 2011 6:04 am

Any plans for a new data set? Or other changes? Right now this contest seems to be finished since it appears impossible to even reach 40% on the current data.
tritical
 
Posts: 4
Joined: Wed Dec 23, 2009 9:13 am


Return to Materials Identification Based on Measurements of Electromagnetic Radiation

Who is online

Users browsing this forum: No registered users and 1 guest

cron