scriptData missing in Dropbox upload

[jonaschn]

I could not find the data which is expected to be in the scriptDataPath.
The Dropbox upload contains (to my knowledge) only the training ( originalDataPath) and test data (testDataPath).

TopicExpertiseModel/src/tem/conf/PathConfig.java

Line 5 in 0f918d7

public static String scriptDataPath = "data/scriptData/ThreeM09/";

[ifonema]

scriptDataPath is used only within some of the classes in tem.script package and in SimpleEvaluate class of tem.main package. In particular scriptDataPath is utilized to read the userID file. To me, the export step and the training set creation step are both clear, but I can't figure out how to create the test set. Any ideas?

[jonaschn]

@ifonema Did you noticed my fork https://github.com/jonaschn/TopicExpertiseModel?
I refactored a little bit and improved the code documentation.
Therein, I also mention how the test set is created:

TopicExpertiseModel/src/tem/main/SimpleEvaluate.java

Lines 43 to 45 in 0f918d7

	testDocSet.readQATestDocs(testDataFolder, trainDocSet);
	String testDocfile = testDataFolder + "QATest.data";
	FileUtil.saveClass(testDocSet, testDocfile);

[ifonema]

@jonaschn Thank you for your fork, I am using it now.

TopicExpertiseModel/src/tem/main/SimpleEvaluate.java

Line 43 in 0f918d7

testDocSet.readQATestDocs(testDataFolder, trainDocSet);

Method readQATestDocs in line 43 reads questions from testData.question file as it can be seen from the following code snippet:

TopicExpertiseModel/src/tem/main/Documents.java

Line 77 in 0f918d7

String questionFile = testDataFolder + "testData.questions";

TopicExpertiseModel/src/tem/main/Documents.java

Line 91 in 0f918d7

FileUtil.readLines(questionFile, questionLines);

testData.question file is created in the main method of ExportTestDataForRank class

TopicExpertiseModel/src/tem/script/ExportTestDataForRank.java

Lines 35 to 36 in 0f918d7

	String questionIDFile = testDataFolder + "testDataQuestions.id";
	FileUtil.readLines(questionIDFile, questionIDs);

where testDataQuestions.id file is used in order to export data from the database, but I don't know where the testDataQuestions.id file is created.
A naive solution consists of creating a tab separated text file in which the second column contains the ids of questions belonging to the test set, but I'd like to know if there is in the repository the code for the automatic generation of the test set.

[jonaschn]

To be honest: I don't know.
I didn't try to generate any test data for myself.