Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Study different partitioning of events #19

Open
orelgueta opened this issue Feb 4, 2021 · 2 comments
Open

Study different partitioning of events #19

orelgueta opened this issue Feb 4, 2021 · 2 comments

Comments

@orelgueta
Copy link
Collaborator

Following the idea of dividing our dataset to 20% good PSF, 60% average PSF and 20% bad PSF, I calculated the confusion matrix for that configuration (regression is awesome). Results are below.
I expected to see better performance, but there is still quite a bit of confusion between the good and the average (less so with the bad). Perhaps we need to look at other configuration and also improve our regression performance further.

All_confusion_matrix_n_types_3

@TarekHC
Copy link
Collaborator

TarekHC commented Feb 4, 2021

Oh, wow. This is very interesting! Now the intermediate event type has very good performance!

Although note now the event statistics are "broken", so the color scheme of this plot is not properly showing the "performance".

I would do what I told you in the past. Sum the events withing each "row" and divide all values in the row by that number. That way we would show % of events falling into the right/wrong box per event type (and it would not matter the statistics in each row).

@orelgueta
Copy link
Collaborator Author

Funny, I just sent you an e-mail asking if this is what you meant because I noticed the same issue =)

All_confusion_matrix_n_types_3

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants