-
Notifications
You must be signed in to change notification settings - Fork 12
Uncertainty bands for plot_roc #74
Copy link
Copy link
Open
Labels
good first issueGood for newcomersGood for newcomersimprovementSomething which would improve current status, but not add anything newSomething which would improve current status, but not add anything newlow priorityNot urgent and won't degrade with timeNot urgent and won't degrade with time
Description
Metadata
Metadata
Assignees
Labels
good first issueGood for newcomersGood for newcomersimprovementSomething which would improve current status, but not add anything newSomething which would improve current status, but not add anything newlow priorityNot urgent and won't degrade with timeNot urgent and won't degrade with time
Current status
plot_rocprovides a variety of options for computing and plotting ROC curves, including bootstrap resampling to compute the uncertainty on the ROC AUCs.Deficiency
Whilst the mean ROC AUCs are displayed, along with their uncertainty, the curves that are plotted are just single lines with no uncertainty. Ideally the uncertainty band coming from bootstrap resamples of the data should be used to compute the uncertainty bands.
Probable solution
_bs_roc_aucis extended to compute and return multiple ROC curves.plt.plotis replaced withsns.lineplotand set to show the standard deviation as a band as computed using the ROC curves returned by_bs_roc_auc.