Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add metric: area under global precision-recall curve #588

Open
AlekseySh opened this issue Jun 10, 2024 · 1 comment
Open

Add metric: area under global precision-recall curve #588

AlekseySh opened this issue Jun 10, 2024 · 1 comment
Labels
good first issue Good for newcomers new feature
Projects
OML-planning

Comments

@AlekseySh
Copy link
Contributor

AlekseySh commented Jun 10, 2024 •
edited
Loading

The metric is described here. So, the main difference from our map or precision is that it's not a query-wise metric, but a global one. In other words, there is the only precision-recall curve for all queries.

A few years ago I used an implementation from here, but not sure if it would be easy to adapt that code.

Check the existed OML metrics for reference.

image
@AlekseySh AlekseySh added this to To do in OML-planning via automation Jun 10, 2024
@AlekseySh AlekseySh mentioned this issue Jun 10, 2024
Open
@AlekseySh
Copy link
Contributor Author

Linked with #589

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
good first issue Good for newcomers new feature
Projects
OML-planning
To do
Milestone
No milestone
Development

No branches or pull requests
1 participant
@AlekseySh