Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inappropriate content detection #243

Closed
lvillacin opened this issue Nov 16, 2020 · 6 comments
Closed

Inappropriate content detection #243

lvillacin opened this issue Nov 16, 2020 · 6 comments

Comments

@lvillacin
Copy link

Is your feature request related to a problem? Please describe.
Was hoping I could detect inappropriate content from the photos so I could blur them out unless I specifically don't want to.

Describe the feature you'd like
Maybe it could be one of the edits like an inappropriate filter option and the photos can come back blurred or even better somehow with a metatag that says it's inappropriate so I could do a custom handle in-app.

Either way, I think this is really useful for apps that allow user-generated content, which is, of course, one of the main uses for serverless-image-handler.

Additional context
I know this could be done using Amazon Rekognition and since serverless-image-handler already uses it for smartCrop, this might not be too hard to do I guess.

@beomseoklee
Copy link
Member

@lvillacin thanks for your input. We put this one into our backlog item, and we will consider how to add this feature.

@lvillacin
Copy link
Author

Thanks @beomseoklee looking forward to seeing this being implemented 🤩

@G-Lenz
Copy link
Contributor

G-Lenz commented Jan 29, 2021

We've added support for content moderation in v5.2.0.

@jbaudanza
Copy link

We've added support for content moderation in v5.2.0.

This is a great feature! But would it be possible to have the contentModeration edit applied before the other edits in applyEdits.

The problem I have some users avatars that are being incorrectly flagged as inappropriate, but only the thumbnail versions. The original versions pass the content-moderation filter just fine.

@G-Lenz
Copy link
Contributor

G-Lenz commented Jun 3, 2021

Hi @jbaudanza , the solution evaluates the edits in order, so if contentModeration is listed before the other edits, it should apply the contentModeration before the other edits.

@jbaudanza
Copy link

Hi @jbaudanza , the solution evaluates the edits in order, so if contentModeration is listed before the other edits, it should apply the contentModeration before the other edits.

Ah that works! Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants