Page 1 of 1

Answer of this competition

PostPosted: Mon Jul 11, 2011 10:37 am
by Natalja
Dear organizers,

Is there any plan to publish the answer of this competition? Namely the lists of lectures that are relevant to the query lectures.

Would be good if we can further test our algorithms and perform some further results for the paper.

Best regards
Natalja

Re: Answer of this competition

PostPosted: Mon Jul 11, 2011 5:31 pm
by ninoaf2
Dear contestant,

File are now available at http://tunedit.org/challenge/VLNetChallenge?m=summary

Best regards,
Organisers

Re: Answer of this competition

PostPosted: Mon Jul 11, 2011 10:57 pm
by haibin
Dear Organizers,

I guess I'm not the only one to have problem in running evaluation jar. Are we supposed to run those jars directly? I believe those jars should contain some more classes to be executed. Or should we use them in some other way? Could you please clarify its usage? Thanks.

Re: Answer of this competition

PostPosted: Tue Jul 12, 2011 11:39 am
by Natalja
Dear Organizers,
Since the format of the solution files differs from the ones we had could you please provide more information about the new format and what are the arguments to run the .jar file?

Best regards
Natalja

Re: Answer of this competition

PostPosted: Tue Jul 12, 2011 3:52 pm
by dddnnn
I think the jar file is used as plugin for the tunedit.org website's leaderboard program and may not be executed directly without modification.

Re: Answer of this competition

PostPosted: Tue Jul 12, 2011 5:05 pm
by ninoaf2
Dear contestants,

Yes , this jar file is a plugin-class for tunedit evalutaion engine.
We will put explanation how to use this evaluation file asap.

Best regards,
Organisers

Re: Answer of this competition

PostPosted: Tue Jul 12, 2011 6:46 pm
by ninoaf2
Dear contestants,

We have uploaded the standalone eclipse projects in java for evaluation functions for task1 and task2 on http://tunedit.org/challenge/VLNetChallenge?m=summary

You can also download and instructions for import:
How to run our evaluation function in eclipse:

1. Download files:
eval_function_task1.zip
eval_function_task2.zip

2. Open eclipse

3. Go to File, Import, Existing project into workspace,
select archice file and click finish.

4. Download the test files for task1 and task2:
task1_target_test_leaderboard.txt
task2_target_test_leaderboard.txt

The next steps are for task1:

5. Configure paths to the submission file and task1_target_test_leaderboard.txt by
opening the source file: TestMeasure.java and changing two lines in the source:

//put the path to your submission
ResourceName userLabelsName = new ResourceName("D:\\challenge files\\task_1\\baseline_random_solution_track1.txt");

//put here the path to the file "task1_target_test_leaderboard.txt"
ResourceName targetLabelsName = new ResourceName("D:\\challenge files\\task_1\\task1_target_test_leaderboard.txt");

6. If you want score from leaderboard set change variable in source file ClassificationEvalSimple.java:

boolean final_eval = false;

If you want score from test set put the variable:
boolean final_eval = true;

6. Run the project, score will be printed in console.

Do the same thing for task2 ...

Best regards

Re: Answer of this competition

PostPosted: Tue Jul 12, 2011 7:11 pm
by ninoaf2
Dear contestants,

We have also uploaded the:
solution_file_format.txt - is a explanation of solution file formats (task1_target_test_leaderboard.txt and task2_target_test_leaderboard.txt) on http://tunedit.org/challenge/VLNetChallenge?m=summary

Here is the c/p:

Task1 solution:

Each line has the following format:

ID:isInLeaderBoardSet:ID1|NUM1,ID2|NUM2,...,ID30|NUM30

ID - represents the lecture for which the recommendations are made
isInLeaderBoardSet - can have the value of 1 or 0, if the value is 1, then this
line is in leaderboard set. Note, that all lines are in test set.
ID1 - is the first recommendation
NUM1 - is the number of times that the lectures (ID,ID1) have been together in clickstream.
ID2 - is the second recommendation
NUM2 - is the number of times that the lectures (ID,ID2) have been together in clickstream.
...

Note, that some line can be empty, or have less than 30 recommendations (real data).

Task2 solution:

Each line has the following format:

ID:isInLeaderBoardSet:ID1|NUM1,ID2|NUM2,...,ID10|NUM10

ID - represents the triplet id for which the recommendations are made
isInLeaderBoardSet - can have the value of 1 or 0, if the value is 1, then this
line is in leaderboard set. Note, that all lines are in test set.
ID1 - is the first recommendation for triplet
NUM1 - is the number of times that the lecture ID1 have been with the triplet ID in
pooled viewing sequences
ID2 - is the second recommendation for triplet
NUM2 - is the number of times that the lecture ID2 have been with the triplet ID in
pooled viewing sequences
...

Note, that some line can be empty, or have less than 10 recommendations (real data).

Best regards

Re: Answer of this competition

PostPosted: Wed Jul 27, 2011 9:27 am
by miazhang
Dear organizers´╝î

I wonder if it's possible to access the whole-data-set while this challenge is aleady closed. Thanks for your assistance.

mia

Re: Answer of this competition

PostPosted: Wed Jul 27, 2011 9:49 am
by ninoaf2
Dear visitor,

Whole dataset is available at: http://tunedit.org/challenge/VLNetChallenge?m=summary

Best regards,
Organizers

Re: Answer of this competition

PostPosted: Mon Aug 01, 2011 5:50 am
by miazhang
Hi organizers,

I try to download the dataset from summary page, it comes out with "Resource 'ninoaf2/challenges/VLNetChallenge/public/whole_dataset.rar' doesn't exist or you don't have access rights. If this is a challenge resource, please register as the challenge participant."

And then I noticed that I can not apply as challenge particpant, since this challenge is closed. I wonder if you would help me out. Thank you so much!


mia

Re: Answer of this competition

PostPosted: Mon Aug 01, 2011 8:31 am
by ninoaf2
Dear visitor,

We changed access rights so that the dataset can be downloaded by user that hove account on tunedIT (you do not have to be challenge participant).
Try it now :)

Best regards,
Organisers

Re: Answer of this competition

PostPosted: Tue Aug 02, 2011 5:54 am
by miazhang
It works, thanks for your assistant.