Instruments final test set

Questions, answers, discussions related to ISMIS 2011 Contest

Instruments final test set

Postby CNSlab » Sat Mar 05, 2011 5:15 am

Were the preliminary test set (35%) and final test (65%) sets selected randomly from the same dataset? Or were they separated into these 2 subsets from different data pools?
CNSlab
 
Posts: 4
Joined: Wed Jan 26, 2011 10:39 pm

Re: Instruments final test set

Postby TunedIT » Sat Mar 05, 2011 1:18 pm

The selection wasn't purely random. The set was divided so that the training and test sets didn't both contain the same pair of instruments. E.g. if the training set contains pairs (Instrument1, Instrument2) and (Instrument2, Instrument3), the test set may contain (Instrument1, Instrument3), but not any of the previous pairs. However, the division of pairs into two sets was random.

Best,
Joanna, TunedIT
TunedIT
 
Posts: 26
Joined: Fri Oct 09, 2009 6:45 pm

Re: Instruments final test set

Postby dslate » Sat Mar 05, 2011 8:13 pm

Joanna,

I think CNSlab was asking how the test set was itself divided into leaderboard and final portions, not how the test set was divided from the training set.

Regards,

-- dslate
dslate
 
Posts: 15
Joined: Mon Jul 05, 2010 4:35 am

Re: Instruments final test set

Postby CNSlab » Sat Mar 05, 2011 8:57 pm

yes, dslate, that was our question. Joanna, would you please clarify?

Also, does anyone know what the frameID covariate is? The description does not make any sense. Further, I dont even think it is a proper English phrase.
CNSlab
 
Posts: 4
Joined: Wed Jan 26, 2011 10:39 pm

Re: Instruments final test set

Postby jamesxli » Sun Mar 06, 2011 6:22 am

I am not sure that it is appropriate to expose too much new information here and now.
Since not every contestant will check this forum regularily, it might not be fair for some
of participants.
jamesxli
 
Posts: 19
Joined: Wed Dec 09, 2009 6:55 pm

Re: Instruments final test set

Postby TunedIT » Tue Mar 08, 2011 2:08 am

Oh, right, apologies for that! The division between preliminary and final test set is random.
TunedIT
 
Posts: 26
Joined: Fri Oct 09, 2009 6:45 pm

Re: Instruments final test set

Postby dslate » Sun Mar 13, 2011 7:08 am

Could you clarify one more thing: is the division between preliminary and final test sets based on a random selection of pairs of instruments, or a random selection of individual records? A similar question for the genres track: is the separation based on whole music pieces or individual records?

Thanks,

-- dslate
dslate
 
Posts: 15
Joined: Mon Jul 05, 2010 4:35 am

Re: Instruments final test set

Postby TunedIT » Sun Mar 13, 2011 2:49 pm

In both cases it is based on individual records.

Regards,
Joanna
TunedIT
 
Posts: 26
Joined: Fri Oct 09, 2009 6:45 pm


Return to ISMIS 2011 Contest: Music Information Retrieval

Who is online

Users browsing this forum: No registered users and 1 guest

cron