Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Target drift report with real label only #1306

Open
xuyunlong123 opened this issue Sep 20, 2024 · 4 comments
Open

Target drift report with real label only #1306

xuyunlong123 opened this issue Sep 20, 2024 · 4 comments

Comments

@xuyunlong123
Copy link

how can i use the target drift detect for feature, i don't find in the doc.

@elenasamuylova
Copy link
Collaborator

Hi @xuyunlong123, could you clarify what you try to achieve?

If you only have a single column (real label) and want to see the shift in its distribution, you can simply create a Report with a single ColumnDriftMetric for this column.

If you want to detect drift for a set of features, you use DataDriftPreset.

The TargetDriftPreset is useful when you have both prediction/label column and feature columns and you want to look at data drift as well as on correlation changes / visually explore the dependency between target and features.

@xuyunlong123
Copy link
Author

Hi @xuyunlong123, could you clarify what you try to achieve?

If you only have a single column (real label) and want to see the shift in its distribution, you can simply create a Report with a single ColumnDriftMetric for this column.

If you want to detect drift for a set of features, you use DataDriftPreset.

The TargetDriftPreset is useful when you have both prediction/label column and feature columns and you want to look at data drift as well as on correlation changes / visually explore the dependency between target and features.

emm,i see. the situation is that i creat many creaditscore models for loan application,but they have the same target label and different features, so i want to use one detector which can test the drift between features and target.That confuses me.Thanks for your reply.

@xuyunlong123
Copy link
Author

Hi @xuyunlong123, could you clarify what you try to achieve?

If you only have a single column (real label) and want to see the shift in its distribution, you can simply create a Report with a single ColumnDriftMetric for this column.

If you want to detect drift for a set of features, you use DataDriftPreset.

The TargetDriftPreset is useful when you have both prediction/label column and feature columns and you want to look at data drift as well as on correlation changes / visually explore the dependency between target and features.

I have another question if i only have label and feature columns, the TargetDriftPreset could work?

@elenasamuylova
Copy link
Collaborator

Hi @xuyunlong123, yes - you just need to label your label column as target in column mapping https://docs.evidentlyai.com/user-guide/input-data/column-mapping#target-and-prediction

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants