-
Notifications
You must be signed in to change notification settings - Fork 9
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improving Recommendations #55
Comments
Recommendations came out for some new tasks and I'm starting to think that it actually a bug. There's a ton of "1% matches" which seems extremely unlikely. 1%
1% & 0%
0% |
The recommendation of |
I set up another task for that so keep me posted there for scraping. |
Cool to see it always recommends at least one person but it is very much not relevant.
Whats the timeline looking like to populate the database by scraping the existing closed issues and their assignees @sshivaditya2019?
repo/org/global Context Matching
I think we should optimize our logic. Tasks that may look similar but posted in two different repositories may in reality be quite different. Normally I would prefer to matchmake against those who completed similar tasks within the same repository, but we can "fallback" to org context (try to matchmake against any repository's task in the org) and then a final "fallback" to global context.
Perhaps the simplest way to calculate this could be to subtract relevance "points"
Example:
Meaning for an identical task posted in three different locations:
Just an idea but open to discussing to make this more accurate and simple to implement.
Recent Code Changes Fallback
Another idea to always try and match somebody is to check how much of the codebase was authored by whom. If nobody hits a relevance of greater than 25% we can fallback to assigning whoever wrote most of the code in the repository. Surely we can find the stats somewhere.
Future Considerations
Because we want the system to always be assigning the right contributor at the right time in the future, we should consider the output of the
/start
command as well, with all its checks. If UbiquityOS is able to run/start
on behalf of others this can solve most of the problems I can think of.Specifically, imagine the scenario where the same top contributor is always recommended to work on the newly posted tasks. With a concurrent task limit of 2, they will quickly be saturated with work. We should be able to detect this and fallback/recommend/assign the next best.
Original Context
Note
The following contributors may be suitable for this task:
gentlementlegen
1% Match
ubiquity-os/ubiquity-os-kernel#125Originally posted by @ubiquity-os-beta[bot] in ubiquity-os-marketplace/daemon-disqualifier#57 (comment)
The text was updated successfully, but these errors were encountered: