Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

added in DcgTruncationLevel to AutoML api #5433

Merged
merged 9 commits into from
Dec 12, 2020
Merged

added in DcgTruncationLevel to AutoML api #5433

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
1783415
added in DcgTruncationLevel to automl api
michaelgsharp Oct 13, 2020
b734acc
changed default to 10
michaelgsharp Oct 13, 2020
d2502f9
updated basline output
michaelgsharp Oct 14, 2020
7c0bb31
fixed failing tests and baselines
michaelgsharp Dec 11, 2020
70989b6
Changes from PR comments.
michaelgsharp Dec 11, 2020
d43e58b
Update src/Microsoft.ML.AutoML/Experiment/MetricsAgents/RankingMetric…
michaelgsharp Dec 11, 2020
ed6885d
Changes based on PR comments.
michaelgsharp Dec 12, 2020
0a06b24
Merge branch 'auto-ml-dcgtruncation' of https://github.com/michaelgsh…
michaelgsharp Dec 12, 2020
97478ea
Fix ranking test.
michaelgsharp Dec 12, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
46 changes: 44 additions & 2 deletions test/BaselineOutput/Common/Command/CommandCrossValidationKeyLabelWithFloatKeyValues-out.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,38 +4,80 @@ Making per-feature arrays
Changing data from row-wise to column-wise
Processed 40 instances
Binning and forming Feature objects
Reserved memory for tree learner: 10764 bytes
Reserved memory for tree learner: %Number% bytes
Starting to train ...
Not training a calibrator because it is not needed.
Not adding a normalizer.
Making per-feature arrays
Changing data from row-wise to column-wise
Processed 32 instances
Binning and forming Feature objects
Reserved memory for tree learner: 6396 bytes
Reserved memory for tree learner: %Number% bytes
Starting to train ...
Not training a calibrator because it is not needed.
NDCG@1: 0.000000
NDCG@2: 0.000000
NDCG@3: 0.000000
NDCG@4: 0.000000
NDCG@5: 0.000000
NDCG@6: 0.000000
NDCG@7: 0.000000
NDCG@8: 0.000000
NDCG@9: 0.000000
NDCG@10: 0.000000
DCG@1: 0.000000
DCG@2: 0.000000
DCG@3: 0.000000
DCG@4: 0.000000
DCG@5: 0.000000
DCG@6: 0.000000
DCG@7: 0.000000
DCG@8: 0.000000
DCG@9: 0.000000
DCG@10: 0.000000
NDCG@1: 0.000000
NDCG@2: 0.000000
NDCG@3: 0.000000
NDCG@4: 0.000000
NDCG@5: 0.000000
NDCG@6: 0.000000
NDCG@7: 0.000000
NDCG@8: 0.000000
NDCG@9: 0.000000
NDCG@10: 0.000000
DCG@1: 0.000000
DCG@2: 0.000000
DCG@3: 0.000000
DCG@4: 0.000000
DCG@5: 0.000000
DCG@6: 0.000000
DCG@7: 0.000000
DCG@8: 0.000000
DCG@9: 0.000000
DCG@10: 0.000000

OVERALL RESULTS
---------------------------------------
NDCG@1: 0.000000 (0.0000)
NDCG@2: 0.000000 (0.0000)
NDCG@3: 0.000000 (0.0000)
NDCG@4: 0.000000 (0.0000)
NDCG@5: 0.000000 (0.0000)
NDCG@6: 0.000000 (0.0000)
NDCG@7: 0.000000 (0.0000)
NDCG@8: 0.000000 (0.0000)
NDCG@9: 0.000000 (0.0000)
NDCG@10: 0.000000 (0.0000)
DCG@1: 0.000000 (0.0000)
DCG@2: 0.000000 (0.0000)
DCG@3: 0.000000 (0.0000)
DCG@4: 0.000000 (0.0000)
DCG@5: 0.000000 (0.0000)
DCG@6: 0.000000 (0.0000)
DCG@7: 0.000000 (0.0000)
DCG@8: 0.000000 (0.0000)
DCG@9: 0.000000 (0.0000)
DCG@10: 0.000000 (0.0000)

---------------------------------------
Physical memory usage(MB): %Number%
Expand Down
1,002 changes: 501 additions & 501 deletions test/BaselineOutput/Common/Command/CommandTrainRanking-3-metrics.txt
View file
Open in desktop

Large diffs are not rendered by default.

28 changes: 28 additions & 0 deletions test/BaselineOutput/Common/Command/CommandTrainRanking-3-out.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,17 +1,45 @@
NDCG@1: 0.313492
NDCG@2: 0.328916
NDCG@3: 0.342168
NDCG@4: 0.342168
NDCG@5: 0.343530
NDCG@6: 0.343158
NDCG@7: 0.343158
NDCG@8: 0.343537
NDCG@9: 0.344631
NDCG@10: 0.344631
DCG@1: 1.356820
DCG@2: 1.562708
DCG@3: 1.657170
DCG@4: 1.664567
DCG@5: 1.677855
DCG@6: 1.677855
DCG@7: 1.677855
DCG@8: 1.683273
DCG@9: 1.693614
DCG@10: 1.693614

OVERALL RESULTS
---------------------------------------
NDCG@1: 0.313492 (0.0000)
NDCG@2: 0.328916 (0.0000)
NDCG@3: 0.342168 (0.0000)
NDCG@4: 0.342168 (0.0000)
NDCG@5: 0.343530 (0.0000)
NDCG@6: 0.343158 (0.0000)
NDCG@7: 0.343158 (0.0000)
NDCG@8: 0.343537 (0.0000)
NDCG@9: 0.344631 (0.0000)
NDCG@10: 0.344631 (0.0000)
DCG@1: 1.356820 (0.0000)
DCG@2: 1.562708 (0.0000)
DCG@3: 1.657170 (0.0000)
DCG@4: 1.664567 (0.0000)
DCG@5: 1.677855 (0.0000)
DCG@6: 1.677855 (0.0000)
DCG@7: 1.677855 (0.0000)
DCG@8: 1.683273 (0.0000)
DCG@9: 1.693614 (0.0000)
DCG@10: 1.693614 (0.0000)

---------------------------------------
28 changes: 28 additions & 0 deletions test/BaselineOutput/Common/Command/CommandTrainRanking-4-out.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,17 +1,45 @@
NDCG@1: 0.313492
NDCG@2: 0.328916
NDCG@3: 0.342168
NDCG@4: 0.342168
NDCG@5: 0.343530
NDCG@6: 0.343158
NDCG@7: 0.343158
NDCG@8: 0.343537
NDCG@9: 0.344631
NDCG@10: 0.344631
DCG@1: 1.356820
DCG@2: 1.562708
DCG@3: 1.657170
DCG@4: 1.664567
DCG@5: 1.677855
DCG@6: 1.677855
DCG@7: 1.677855
DCG@8: 1.683273
DCG@9: 1.693614
DCG@10: 1.693614

OVERALL RESULTS
---------------------------------------
NDCG@1: 0.313492 (0.0000)
NDCG@2: 0.328916 (0.0000)
NDCG@3: 0.342168 (0.0000)
NDCG@4: 0.342168 (0.0000)
NDCG@5: 0.343530 (0.0000)
NDCG@6: 0.343158 (0.0000)
NDCG@7: 0.343158 (0.0000)
NDCG@8: 0.343537 (0.0000)
NDCG@9: 0.344631 (0.0000)
NDCG@10: 0.344631 (0.0000)
DCG@1: 1.356820 (0.0000)
DCG@2: 1.562708 (0.0000)
DCG@3: 1.657170 (0.0000)
DCG@4: 1.664567 (0.0000)
DCG@5: 1.677855 (0.0000)
DCG@6: 1.677855 (0.0000)
DCG@7: 1.677855 (0.0000)
DCG@8: 1.683273 (0.0000)
DCG@9: 1.693614 (0.0000)
DCG@10: 1.693614 (0.0000)

---------------------------------------
28 changes: 28 additions & 0 deletions test/BaselineOutput/Common/Command/CommandTrainRanking-5-out.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,18 +11,46 @@ Not training a calibrator because it is not needed.
NDCG@1: 0.313492
NDCG@2: 0.328916
NDCG@3: 0.342168
NDCG@4: 0.342168
NDCG@5: 0.343530
NDCG@6: 0.343158
NDCG@7: 0.343158
NDCG@8: 0.343537
NDCG@9: 0.344631
NDCG@10: 0.344631
DCG@1: 1.356820
DCG@2: 1.562708
DCG@3: 1.657170
DCG@4: 1.664567
DCG@5: 1.677855
DCG@6: 1.677855
DCG@7: 1.677855
DCG@8: 1.683273
DCG@9: 1.693614
DCG@10: 1.693614

OVERALL RESULTS
---------------------------------------
NDCG@1: 0.313492 (0.0000)
NDCG@2: 0.328916 (0.0000)
NDCG@3: 0.342168 (0.0000)
NDCG@4: 0.342168 (0.0000)
NDCG@5: 0.343530 (0.0000)
NDCG@6: 0.343158 (0.0000)
NDCG@7: 0.343158 (0.0000)
NDCG@8: 0.343537 (0.0000)
NDCG@9: 0.344631 (0.0000)
NDCG@10: 0.344631 (0.0000)
DCG@1: 1.356820 (0.0000)
DCG@2: 1.562708 (0.0000)
DCG@3: 1.657170 (0.0000)
DCG@4: 1.664567 (0.0000)
DCG@5: 1.677855 (0.0000)
DCG@6: 1.677855 (0.0000)
DCG@7: 1.677855 (0.0000)
DCG@8: 1.683273 (0.0000)
DCG@9: 1.693614 (0.0000)
DCG@10: 1.693614 (0.0000)

---------------------------------------
Physical memory usage(MB): %Number%
Expand Down
Loading