about_evaluation_functions.txt

Name:
Owner:
Access:
Size:
Modified:

ninoaf2/challenges/VLNetChallenge/public/about_evaluation_functions.txt
ninoaf2

public
1.2 KB
2011-07-12 18:37:51

No file description

File contents

How to run our evaluation function in eclipse:

1. Download files: 
eval_function_task1.zip
eval_function_task2.zip

2. Open eclipse

3. Go to File, Import, Existing project into workspace,
select archice file and click finish.

4. Download the test files for task1 and task2:
task1_target_test_leaderboard.txt
task2_target_test_leaderboard.txt

The next steps are for task1:

5. Configure paths to the submission file and task1_target_test_leaderboard.txt by
opening the source file: TestMeasure.java and changing two lines in the source:

//put the path to your submission
ResourceName userLabelsName = new ResourceName("D:\\challenge files\\task_1\\baseline_random_solution_track1.txt");
		
//put here the path to the file "task1_target_test_leaderboard.txt"
ResourceName targetLabelsName = new ResourceName("D:\\challenge files\\task_1\\task1_target_test_leaderboard.txt");

6. If you want score from leaderboard set change variable in source file ClassificationEvalSimple.java:

boolean final_eval = false;

If you want score from test set put the variable:
boolean final_eval = true;
		
6. Run the project, score will be printed in console.

Do the same thing for task2 ...


Home - Contact Us - In Media - Challenges List - Create - About Challenges - R&D Outsourcing - Wiki - Blog - Forum Research - Repository - Knowledge Base - TunedTester	Copyright © 2008-2011 by TunedIT Design by luksite