Can i use other language modelling tools than kenlm

[JRMeyer]

>>> mark2
[January 11, 2018, 10:59am]

Hi!

I want to set up a training pipe for my own audio and text corpus by
following the tutorial: TUTORIAL : How I trained a specific french
model to control my
robot

However, I got stuck in building language model with KenLM (in the
tutorial the command: '/bin/bin/./lmplz slash --text vocabulary.txt slash --arpa
words.arpa slash --o 3') as it requires Boost and I had a lot of problems
with installing it to Mac.

Is Deep Speech compatible with other language modelling tools such as: slash
SRILM:
https://www.sri.com/engage/products-solutions/sri-language-modeling-toolkit slash
VariKN: https://github.com/vsiivola/variKN slash
TheanoLM: https://github.com/senarvi/theanolm

such that I am not bind to KenLM?

[This is an archived TTS discussion thread from discourse.mozilla.org/t/can-i-use-other-language-modelling-tools-than-kenlm]

[JRMeyer]

>>> lissyx
[January 11, 2018, 11:24am]

We only support KenLM, we even have a specific CTC decoder bound with
it. However, if you switch the code not to rely on the specific
CTC/KenLM decoder, you might be able to plug your own. Be prepared to
hack, though.

What's your problem with Boost? Maybe you should start a specific topic,
others might be able to help you?

[Archived Post]

[JRMeyer]

>>> mark2
[January 15, 2018, 7:14am]

The problem I met while installing Boost from sources was the error: slash
error: no matching constructor for initialization of 'storage_type' (aka
'boost::atomics::detail::storage128_type')

but I solved it by trying version 1.54: slash

github.com/tomopy/tomopy

#### Issue: Boost compile error with Clang 3.4 on Mac OS

opened by dgursoy on
2014-03-30

closed by dgursoy on
2014-06-10

{.content style='white-space: pre-wrap;'}<br/> clang -fno-strict-aliasing -fno-common -dynamic -I/usr/local/include -I/usr/local/opt/sqlite/include -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/usr/local/include -I/Users/dgursoy/Projects/tomopy/tomopy/algorithms/recon/gridrec -I/usr/local/Cellar/python/2.7.6/Frameworks/Python.framework/Versions/2.7/include/python2.7 -c tomopy/algorithms/recon/gridrec/grid.cpp -o build/temp.macosx-10.9-x86_64-2.7/tomopy/algorithms/recon/gridrec/grid.o<br/> clang -fno-strict-aliasing -fno-common...<br/>

[Archived Post]

[JRMeyer]

>>> lissyx
[January 15, 2018, 8:21am]

So now it works for you?
![:slight_smile:](

[Archived Post]

[JRMeyer]

>>> mark2
[January 15, 2018, 8:22am]

Yeah, I got KenLM installed
![:slight_smile:](
thanks!

[Archived Post]

[JRMeyer]

>>> krishnamohan.191
[March 21, 2018, 12:30pm]



> We only support KenLM, we even have a specific CTC decoder bound with
> it.

Can you explain how CTC decoder bound to KenLM.

[Archived Post]

[JRMeyer]

>>> lissyx
[March 21, 2018, 12:39pm]

implemented specific code to
have CTC decoder using the beam scoring from KenLM.

[Archived Post]

[JRMeyer]

>>> jageshmaharjan
[May 7, 2018, 7:40am]

Is the Boost library necessary. However, I installed
withsudo apt-get install cmake libblkid-dev e2fslibs-dev libboost-all-dev libaudit-dev

[Archived Post]