Answer of this competition

Questions, answers, discussions related to VideoLectures.Net Recommender System Challenge

Answer of this competition

Postby Natalja » Mon Jul 11, 2011 10:37 am

Dear organizers,

Is there any plan to publish the answer of this competition? Namely the lists of lectures that are relevant to the query lectures.

Would be good if we can further test our algorithms and perform some further results for the paper.

Best regards
Natalja
Natalja
 
Posts: 2
Joined: Thu Apr 28, 2011 4:33 pm

Re: Answer of this competition

Postby ninoaf2 » Mon Jul 11, 2011 5:31 pm

Dear contestant,

File are now available at http://tunedit.org/challenge/VLNetChallenge?m=summary

Best regards,
Organisers
ninoaf2
 
Posts: 25
Joined: Tue Mar 08, 2011 2:53 pm

Re: Answer of this competition

Postby haibin » Mon Jul 11, 2011 10:57 pm

Dear Organizers,

I guess I'm not the only one to have problem in running evaluation jar. Are we supposed to run those jars directly? I believe those jars should contain some more classes to be executed. Or should we use them in some other way? Could you please clarify its usage? Thanks.
haibin
 
Posts: 3
Joined: Thu Apr 21, 2011 7:58 pm

Re: Answer of this competition

Postby Natalja » Tue Jul 12, 2011 11:39 am

Dear Organizers,
Since the format of the solution files differs from the ones we had could you please provide more information about the new format and what are the arguments to run the .jar file?

Best regards
Natalja
Natalja
 
Posts: 2
Joined: Thu Apr 28, 2011 4:33 pm

Re: Answer of this competition

Postby dddnnn » Tue Jul 12, 2011 3:52 pm

I think the jar file is used as plugin for the tunedit.org website's leaderboard program and may not be executed directly without modification.
dddnnn
 
Posts: 1
Joined: Sun Jul 03, 2011 12:03 am

Re: Answer of this competition

Postby ninoaf2 » Tue Jul 12, 2011 5:05 pm

Dear contestants,

Yes , this jar file is a plugin-class for tunedit evalutaion engine.
We will put explanation how to use this evaluation file asap.

Best regards,
Organisers
ninoaf2
 
Posts: 25
Joined: Tue Mar 08, 2011 2:53 pm

Re: Answer of this competition

Postby ninoaf2 » Tue Jul 12, 2011 6:46 pm

Dear contestants,

We have uploaded the standalone eclipse projects in java for evaluation functions for task1 and task2 on http://tunedit.org/challenge/VLNetChallenge?m=summary

You can also download and instructions for import:
How to run our evaluation function in eclipse:

1. Download files:
eval_function_task1.zip
eval_function_task2.zip

2. Open eclipse

3. Go to File, Import, Existing project into workspace,
select archice file and click finish.

4. Download the test files for task1 and task2:
task1_target_test_leaderboard.txt
task2_target_test_leaderboard.txt

The next steps are for task1:

5. Configure paths to the submission file and task1_target_test_leaderboard.txt by
opening the source file: TestMeasure.java and changing two lines in the source:

//put the path to your submission
ResourceName userLabelsName = new ResourceName("D:\\challenge files\\task_1\\baseline_random_solution_track1.txt");

//put here the path to the file "task1_target_test_leaderboard.txt"
ResourceName targetLabelsName = new ResourceName("D:\\challenge files\\task_1\\task1_target_test_leaderboard.txt");

6. If you want score from leaderboard set change variable in source file ClassificationEvalSimple.java:

boolean final_eval = false;

If you want score from test set put the variable:
boolean final_eval = true;

6. Run the project, score will be printed in console.

Do the same thing for task2 ...

Best regards
ninoaf2
 
Posts: 25
Joined: Tue Mar 08, 2011 2:53 pm

Re: Answer of this competition

Postby ninoaf2 » Tue Jul 12, 2011 7:11 pm

Dear contestants,

We have also uploaded the:
solution_file_format.txt - is a explanation of solution file formats (task1_target_test_leaderboard.txt and task2_target_test_leaderboard.txt) on http://tunedit.org/challenge/VLNetChallenge?m=summary

Here is the c/p:

Task1 solution:

Each line has the following format:

ID:isInLeaderBoardSet:ID1|NUM1,ID2|NUM2,...,ID30|NUM30

ID - represents the lecture for which the recommendations are made
isInLeaderBoardSet - can have the value of 1 or 0, if the value is 1, then this
line is in leaderboard set. Note, that all lines are in test set.
ID1 - is the first recommendation
NUM1 - is the number of times that the lectures (ID,ID1) have been together in clickstream.
ID2 - is the second recommendation
NUM2 - is the number of times that the lectures (ID,ID2) have been together in clickstream.
...

Note, that some line can be empty, or have less than 30 recommendations (real data).

Task2 solution:

Each line has the following format:

ID:isInLeaderBoardSet:ID1|NUM1,ID2|NUM2,...,ID10|NUM10

ID - represents the triplet id for which the recommendations are made
isInLeaderBoardSet - can have the value of 1 or 0, if the value is 1, then this
line is in leaderboard set. Note, that all lines are in test set.
ID1 - is the first recommendation for triplet
NUM1 - is the number of times that the lecture ID1 have been with the triplet ID in
pooled viewing sequences
ID2 - is the second recommendation for triplet
NUM2 - is the number of times that the lecture ID2 have been with the triplet ID in
pooled viewing sequences
...

Note, that some line can be empty, or have less than 10 recommendations (real data).

Best regards
ninoaf2
 
Posts: 25
Joined: Tue Mar 08, 2011 2:53 pm

Re: Answer of this competition

Postby miazhang » Wed Jul 27, 2011 9:27 am

Dear organizers,

I wonder if it's possible to access the whole-data-set while this challenge is aleady closed. Thanks for your assistance.

mia
miazhang
 
Posts: 3
Joined: Wed Jul 27, 2011 8:02 am

Re: Answer of this competition

Postby ninoaf2 » Wed Jul 27, 2011 9:49 am

Dear visitor,

Whole dataset is available at: http://tunedit.org/challenge/VLNetChallenge?m=summary

Best regards,
Organizers
ninoaf2
 
Posts: 25
Joined: Tue Mar 08, 2011 2:53 pm

Re: Answer of this competition

Postby miazhang » Mon Aug 01, 2011 5:50 am

Hi organizers,

I try to download the dataset from summary page, it comes out with "Resource 'ninoaf2/challenges/VLNetChallenge/public/whole_dataset.rar' doesn't exist or you don't have access rights. If this is a challenge resource, please register as the challenge participant."

And then I noticed that I can not apply as challenge particpant, since this challenge is closed. I wonder if you would help me out. Thank you so much!


mia
miazhang
 
Posts: 3
Joined: Wed Jul 27, 2011 8:02 am

Re: Answer of this competition

Postby ninoaf2 » Mon Aug 01, 2011 8:31 am

Dear visitor,

We changed access rights so that the dataset can be downloaded by user that hove account on tunedIT (you do not have to be challenge participant).
Try it now :)

Best regards,
Organisers
ninoaf2
 
Posts: 25
Joined: Tue Mar 08, 2011 2:53 pm

Re: Answer of this competition

Postby miazhang » Tue Aug 02, 2011 5:54 am

It works, thanks for your assistant.
miazhang
 
Posts: 3
Joined: Wed Jul 27, 2011 8:02 am


Return to VideoLectures.Net Recommender System Challenge

Who is online

Users browsing this forum: No registered users and 1 guest

cron