Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add feature #163

Open
Suhailyu opened this issue Jan 21, 2025 · 3 comments
Open

Add feature #163

Suhailyu opened this issue Jan 21, 2025 · 3 comments

Comments

@Suhailyu
Copy link

Both male and female vocals are included in the conversion process, and the effects apply to both types of sounds. Any improvements made depend on the selected model. For example, if a male model is chosen for conversion, it will only affect male vocals, leaving female vocals unchanged and unaffected by the conversion

@JackismyShephard
Copy link

@Suhailyu This might be a useful feature but it is not easily attainable. The way song cover generation currently works is that first the main vocals are extracted from the selected song and then those vocals are converted using RVC. For what you are suggesting you would need a stemming model that separates an audio track into three stems: male vocals, female vocals and instrumentals. I am not sure there are stemming models that can do that well. Also you would need to know a priori whether a chosen voice model is based on a male or female voice. I don't think that information is available at the moment for all RVC voice models.

@Suhailyu
Copy link
Author

I’ve noticed an issue where there’s leakage in some songs, and the conversion process is also affecting the instruments.

@JackismyShephard
Copy link

Yeah that is also due to the separation models not being perfect. You can try my fork of this app where you have the possibility to experiment with some settings for the audio separation models. It might help.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants