Partition of genre pieces into segments

[dslate]

The description of the genre data says that "All music pieces are partitioned into 20 segments and parameterized." However, the numbers of records in the training data for the 6 genres do not seem to be multiples of 20. Does that mean that not all segments for each piece are present in the data?

Please clarify,

Thanks,

-- dslate

[Marcin]

All segments are present in the data.

Regards,
Marcin Wojnarski

[jw81]

So then the statement "All music pieces are partitioned into [exactly] 20 segments and parameterized" is not correct?

What should should it say?

[Marcin]

Both are correct:
* the pieces were partitioned into 20 segments, and ...
* the number of records is NOT a multiplicity of 20.

I'm sure some guys here can explain this miracle... Anybody to help?

[wahoo]

I remember finding duplicates and wondering if any other surprises were lurking in data that weren't described in the overview!

[Marcin]

Yep, there were duplicates. This wasn't intended, initially it was just a bug in data generation process. We discovered it shortly before contest launch and wanted to fix the data, but later on we decided to leave it as it is, because in a real-world setting the data are never clean, rather opposite - they contain all different kinds of impurities and without laborious investigation and cleansing one have no chances to get any close to optimal accuracy. So, this was a kind of an exercise. Do you know if duplicates had any influence on model building and results?

As to other surprises - we'd be surprised ourselves if there are any. Or maybe you found something?

-m