Using Deep Speech

[JRMeyer]

>>> kdavis
[November 1, 2017, 2:28pm]

Covers topics concerned with the use of Deep Speech

[This is an archived TTS discussion thread from discourse.mozilla.org/t/using-deep-speech]

[JRMeyer]

>>> maboa
[November 14, 2017, 11:31am]

Just wanted to say this is great to see, since I'm working in the area
of STT I'm very much looking forward to the discussion on this topic -
hoping to contribute
![:slight_smile:]

[Archived Post]

[JRMeyer]

>>> mark2
[December 22, 2017, 9:35am]

Hi!

I am testing the basic use of DeepSpeech with pre-trained model
downloaded from https://github.com/mozilla/DeepSpeech/releases and
some test wav-files downloaded from
https://www.dropbox.com/s/xecprghgwbbuk3m/vctk-pc225.tar.gz?dl=1. The
correct transcriptions for three below cases are "It is linked to the
row over proposed changes at Scottish Ballet", "Please call Stella" and
"Ask her to bring these things with her from the store" respectively.
The results suggested by the default model are something totally
different:

AMAC02TX3KKHTD8:DeepSpeech mark$ deepspeech .../models/output_graph.pb
p225_366.wav .../models/alphabet.txt .../models/lm.binary
.../models/trie
Loading model from file .../models/output_graph.pb
Loaded model in 1.071s.
Loading language model from files .../models/lm.binary .../models/trie
Loaded language model in 3.408s.
Running inference.
i do
Inference took 8.283s for 15.900s audio file.
AMAC02TX3KKHTD8:DeepSpeech mark$ deepspeech .../models/output_graph.pb
p225_001.wav .../models/alphabet.txt .../models/lm.binary
.../models/trie
Loading model from file .../models/output_graph.pb
Loaded model in 0.920s.
Loading language model from files .../models/lm.binary .../models/trie
Loaded language model in 3.111s.
Running inference.
huh
Inference took 4.822s for 6.155s audio file.
AMAC02TX3KKHTD8:DeepSpeech mark$ deepspeech .../models/output_graph.pb
p225_002.wav .../models/alphabet.txt .../models/lm.binary
.../models/trie
Loading model from file .../models/output_graph.pb
Loaded model in 1.026s.
Loading language model from files .../models/lm.binary .../models/trie
Loaded language model in 3.217s.
Running inference.
a cage
Inference took 7.021s for 12.176s audio file.

Any ideas for the such behaviour?

BR,
Mark

[Archived Post]

[JRMeyer]

>>> kdavis
[December 22, 2017, 9:46am]

Are the wav audio files 16-bit, 16 kHz, and mono? If not, deepspeech
can't create transcripts for them.

[Archived Post]

[JRMeyer]

>>> lissyx
[December 22, 2017, 9:47am]

[\mark2](
look at your files, and like mentionned, it's 48kHz instead of 16kHz as
expected, that explains the completely unexpected output.

[Archived Post]

[JRMeyer]

>>> lissyx
[December 22, 2017, 9:49am]

FTR:

alexportable-alex:/tmp/deepspeech/cpu$ LC_ALL=C ./deepspeech ../models/output_graph.pb ../test-data/vctk-p225/wav48/p225/p225_366.wav ../models/alphabet.txt -t 2>&1
2017-12-22 10:48:34.494758: I tensorflow/core/platform/cpu_feature_guard.cc:137] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
u to o
cpu_time_overall=23.77523 cpu_time_mfcc=0.00953 cpu_time_infer=23.76570
alexportable-alex:/tmp/deepspeech/cpu$ LC_ALL=C ./deepspeech ../models/output_graph.pb ../test-data/vctk-p225/wav48/p225/p225_366.16k.wav ../models/alphabet.txt -t 2>&1
2017-12-22 10:48:54.894628: I tensorflow/core/platform/cpu_feature_guard.cc:137] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
it is lind to the row everyprprose changes at scosish balle
cpu_time_overall=22.01665 cpu_time_mfcc=0.00750 cpu_time_infer=22.00915

And one can do conversion like that:

alexportable-alex:/tmp/deepspeech/cpu$ ffmpeg -i ../test-data/vctk-p225/wav48/p225/p225_366.wav -acodec pcm_s16le -ac 1 -ar 16000 ../test-data/vctk-p225/wav48/p225/p225_366.16k.wav
alexportable-alex:/tmp/deepspeech/cpu$

[Archived Post]

[JRMeyer]

>>> mark2
[December 22, 2017, 10:12am]

Thanks! Now it gives more reasonable answers.

[Archived Post]