From a6c80dd987aa2979cec8a41d581f0b143609a79e Mon Sep 17 00:00:00 2001 From: Josh Meyer Date: Sun, 3 Oct 2021 17:30:29 -0400 Subject: [PATCH] Add English v1.0.0 large vocab --- english/coqui/v1.0.0-large-vocab/LICENSE | 202 +++++++++++++ english/coqui/v1.0.0-large-vocab/LOG_TESTING | 285 ++++++++++++++++++ .../coqui/v1.0.0-large-vocab/MODEL_CARD.md | 83 +++++ english/coqui/v1.0.0-large-vocab/alphabet.txt | 33 ++ 4 files changed, 603 insertions(+) create mode 100644 english/coqui/v1.0.0-large-vocab/LICENSE create mode 100644 english/coqui/v1.0.0-large-vocab/LOG_TESTING create mode 100644 english/coqui/v1.0.0-large-vocab/MODEL_CARD.md create mode 100644 english/coqui/v1.0.0-large-vocab/alphabet.txt diff --git a/english/coqui/v1.0.0-large-vocab/LICENSE b/english/coqui/v1.0.0-large-vocab/LICENSE new file mode 100644 index 0000000..d645695 --- /dev/null +++ b/english/coqui/v1.0.0-large-vocab/LICENSE @@ -0,0 +1,202 @@ + + Apache License + Version 2.0, January 2004 + http://www.apache.org/licenses/ + + TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION + + 1. Definitions. + + "License" shall mean the terms and conditions for use, reproduction, + and distribution as defined by Sections 1 through 9 of this document. + + "Licensor" shall mean the copyright owner or entity authorized by + the copyright owner that is granting the License. + + "Legal Entity" shall mean the union of the acting entity and all + other entities that control, are controlled by, or are under common + control with that entity. For the purposes of this definition, + "control" means (i) the power, direct or indirect, to cause the + direction or management of such entity, whether by contract or + otherwise, or (ii) ownership of fifty percent (50%) or more of the + outstanding shares, or (iii) beneficial ownership of such entity. + + "You" (or "Your") shall mean an individual or Legal Entity + exercising permissions granted by this License. + + "Source" form shall mean the preferred form for making modifications, + including but not limited to software source code, documentation + source, and configuration files. + + "Object" form shall mean any form resulting from mechanical + transformation or translation of a Source form, including but + not limited to compiled object code, generated documentation, + and conversions to other media types. + + "Work" shall mean the work of authorship, whether in Source or + Object form, made available under the License, as indicated by a + copyright notice that is included in or attached to the work + (an example is provided in the Appendix below). + + "Derivative Works" shall mean any work, whether in Source or Object + form, that is based on (or derived from) the Work and for which the + editorial revisions, annotations, elaborations, or other modifications + represent, as a whole, an original work of authorship. For the purposes + of this License, Derivative Works shall not include works that remain + separable from, or merely link (or bind by name) to the interfaces of, + the Work and Derivative Works thereof. + + "Contribution" shall mean any work of authorship, including + the original version of the Work and any modifications or additions + to that Work or Derivative Works thereof, that is intentionally + submitted to Licensor for inclusion in the Work by the copyright owner + or by an individual or Legal Entity authorized to submit on behalf of + the copyright owner. For the purposes of this definition, "submitted" + means any form of electronic, verbal, or written communication sent + to the Licensor or its representatives, including but not limited to + communication on electronic mailing lists, source code control systems, + and issue tracking systems that are managed by, or on behalf of, the + Licensor for the purpose of discussing and improving the Work, but + excluding communication that is conspicuously marked or otherwise + designated in writing by the copyright owner as "Not a Contribution." + + "Contributor" shall mean Licensor and any individual or Legal Entity + on behalf of whom a Contribution has been received by Licensor and + subsequently incorporated within the Work. + + 2. Grant of Copyright License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You a perpetual, + worldwide, non-exclusive, no-charge, royalty-free, irrevocable + copyright license to reproduce, prepare Derivative Works of, + publicly display, publicly perform, sublicense, and distribute the + Work and such Derivative Works in Source or Object form. + + 3. Grant of Patent License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You a perpetual, + worldwide, non-exclusive, no-charge, royalty-free, irrevocable + (except as stated in this section) patent license to make, have made, + use, offer to sell, sell, import, and otherwise transfer the Work, + where such license applies only to those patent claims licensable + by such Contributor that are necessarily infringed by their + Contribution(s) alone or by combination of their Contribution(s) + with the Work to which such Contribution(s) was submitted. If You + institute patent litigation against any entity (including a + cross-claim or counterclaim in a lawsuit) alleging that the Work + or a Contribution incorporated within the Work constitutes direct + or contributory patent infringement, then any patent licenses + granted to You under this License for that Work shall terminate + as of the date such litigation is filed. + + 4. Redistribution. You may reproduce and distribute copies of the + Work or Derivative Works thereof in any medium, with or without + modifications, and in Source or Object form, provided that You + meet the following conditions: + + (a) You must give any other recipients of the Work or + Derivative Works a copy of this License; and + + (b) You must cause any modified files to carry prominent notices + stating that You changed the files; and + + (c) You must retain, in the Source form of any Derivative Works + that You distribute, all copyright, patent, trademark, and + attribution notices from the Source form of the Work, + excluding those notices that do not pertain to any part of + the Derivative Works; and + + (d) If the Work includes a "NOTICE" text file as part of its + distribution, then any Derivative Works that You distribute must + include a readable copy of the attribution notices contained + within such NOTICE file, excluding those notices that do not + pertain to any part of the Derivative Works, in at least one + of the following places: within a NOTICE text file distributed + as part of the Derivative Works; within the Source form or + documentation, if provided along with the Derivative Works; or, + within a display generated by the Derivative Works, if and + wherever such third-party notices normally appear. The contents + of the NOTICE file are for informational purposes only and + do not modify the License. You may add Your own attribution + notices within Derivative Works that You distribute, alongside + or as an addendum to the NOTICE text from the Work, provided + that such additional attribution notices cannot be construed + as modifying the License. + + You may add Your own copyright statement to Your modifications and + may provide additional or different license terms and conditions + for use, reproduction, or distribution of Your modifications, or + for any such Derivative Works as a whole, provided Your use, + reproduction, and distribution of the Work otherwise complies with + the conditions stated in this License. + + 5. Submission of Contributions. Unless You explicitly state otherwise, + any Contribution intentionally submitted for inclusion in the Work + by You to the Licensor shall be under the terms and conditions of + this License, without any additional terms or conditions. + Notwithstanding the above, nothing herein shall supersede or modify + the terms of any separate license agreement you may have executed + with Licensor regarding such Contributions. + + 6. Trademarks. This License does not grant permission to use the trade + names, trademarks, service marks, or product names of the Licensor, + except as required for reasonable and customary use in describing the + origin of the Work and reproducing the content of the NOTICE file. + + 7. Disclaimer of Warranty. Unless required by applicable law or + agreed to in writing, Licensor provides the Work (and each + Contributor provides its Contributions) on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or + implied, including, without limitation, any warranties or conditions + of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A + PARTICULAR PURPOSE. You are solely responsible for determining the + appropriateness of using or redistributing the Work and assume any + risks associated with Your exercise of permissions under this License. + + 8. Limitation of Liability. In no event and under no legal theory, + whether in tort (including negligence), contract, or otherwise, + unless required by applicable law (such as deliberate and grossly + negligent acts) or agreed to in writing, shall any Contributor be + liable to You for damages, including any direct, indirect, special, + incidental, or consequential damages of any character arising as a + result of this License or out of the use or inability to use the + Work (including but not limited to damages for loss of goodwill, + work stoppage, computer failure or malfunction, or any and all + other commercial damages or losses), even if such Contributor + has been advised of the possibility of such damages. + + 9. Accepting Warranty or Additional Liability. While redistributing + the Work or Derivative Works thereof, You may choose to offer, + and charge a fee for, acceptance of support, warranty, indemnity, + or other liability obligations and/or rights consistent with this + License. However, in accepting such obligations, You may act only + on Your own behalf and on Your sole responsibility, not on behalf + of any other Contributor, and only if You agree to indemnify, + defend, and hold each Contributor harmless for any liability + incurred by, or claims asserted against, such Contributor by reason + of your accepting any such warranty or additional liability. + + END OF TERMS AND CONDITIONS + + APPENDIX: How to apply the Apache License to your work. + + To apply the Apache License to your work, attach the following + boilerplate notice, with the fields enclosed by brackets "[]" + replaced with your own identifying information. (Don't include + the brackets!) The text should be enclosed in the appropriate + comment syntax for the file format. We also recommend that a + file or class name and description of purpose be included on the + same "printed page" as the copyright notice for easier + identification within third-party archives. + + Copyright [yyyy] [name of copyright owner] + + Licensed under the Apache License, Version 2.0 (the "License"); + you may not use this file except in compliance with the License. + You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. diff --git a/english/coqui/v1.0.0-large-vocab/LOG_TESTING b/english/coqui/v1.0.0-large-vocab/LOG_TESTING new file mode 100644 index 0000000..5f50043 --- /dev/null +++ b/english/coqui/v1.0.0-large-vocab/LOG_TESTING @@ -0,0 +1,285 @@ +I Loading best validating checkpoint from /home/ubuntu/oct-3-english-stt-checkpoints/acoustic_model/checkpoints/best_dev-3663881 +I Loading variable from checkpoint: cudnn_lstm/rnn/multi_rnn_cell/cell_0/cudnn_compatible_lstm_cell/bias +I Loading variable from checkpoint: cudnn_lstm/rnn/multi_rnn_cell/cell_0/cudnn_compatible_lstm_cell/kernel +I Loading variable from checkpoint: global_step +I Loading variable from checkpoint: layer_1/bias +I Loading variable from checkpoint: layer_1/weights +I Loading variable from checkpoint: layer_2/bias +I Loading variable from checkpoint: layer_2/weights +I Loading variable from checkpoint: layer_3/bias +I Loading variable from checkpoint: layer_3/weights +I Loading variable from checkpoint: layer_5/bias +I Loading variable from checkpoint: layer_5/weights +I Loading variable from checkpoint: layer_6/bias +I Loading variable from checkpoint: layer_6/weights +Testing model on /home/ubuntu/en-data/test.csv +Test epoch | Steps: 0 | Elapsed Time: 0:00:00 +Test epoch | Steps: 1 | Elapsed Time: 0:00:29 +Test epoch | Steps: 2 | Elapsed Time: 0:00:55 +Test epoch | Steps: 3 | Elapsed Time: 0:01:22 +Test epoch | Steps: 4 | Elapsed Time: 0:01:39 +Test epoch | Steps: 5 | Elapsed Time: 0:02:00 +Test epoch | Steps: 6 | Elapsed Time: 0:02:34 +Test epoch | Steps: 7 | Elapsed Time: 0:02:44 +Test epoch | Steps: 7 | Elapsed Time: 0:02:44 +Test on /home/ubuntu/en-data/test.csv - WER: 0.443992, CER: 0.248600, loss: 51.432274 +-------------------------------------------------------------------------------- +Best WER: +-------------------------------------------------------------------------------- +WER: 0.000000, CER: 0.000000, loss: 35.819138 + - wav: file:///home/ubuntu/en-data/common_voice_en_20305877.opus + - src: "he is a member of the national rally for democracy" + - res: "he is a member of the national rally for democracy" +-------------------------------------------------------------------------------- +WER: 0.000000, CER: 0.000000, loss: 35.702061 + - wav: file:///home/ubuntu/en-data/common_voice_en_20242298.opus + - src: "but in the middle of the negotiations he decided not to go through" + - res: "but in the middle of the negotiations he decided not to go through" +-------------------------------------------------------------------------------- +WER: 0.000000, CER: 0.000000, loss: 30.634878 + - wav: file:///home/ubuntu/en-data/common_voice_en_20881181.opus + - src: "it is written from the viewpoint of the ship's chief engineer montgomery scott" + - res: "it is written from the viewpoint of the ship's chief engineer montgomery scott" +-------------------------------------------------------------------------------- +WER: 0.000000, CER: 0.000000, loss: 30.399607 + - wav: file:///home/ubuntu/en-data/common_voice_en_26267987.opus + - src: "the frequency of the electromagnetic radiation is related to the reference of the observers" + - res: "the frequency of the electromagnetic radiation is related to the reference of the observers" +-------------------------------------------------------------------------------- +WER: 0.000000, CER: 0.000000, loss: 28.879627 + - wav: file:///home/ubuntu/en-data/common_voice_en_26970287.opus + - src: "the government of alberta is organized as a parliamentary democracy with a unicameral legislature" + - res: "the government of alberta is organized as a parliamentary democracy with a unicameral legislature" +-------------------------------------------------------------------------------- +Median WER: +-------------------------------------------------------------------------------- +WER: 0.428571, CER: 0.259259, loss: 73.611267 + - wav: file:///home/ubuntu/en-data/common_voice_en_25193717.opus + - src: "slavery was legal and practiced in each of the thirteen colonies at various times" + - res: "clever he was legal and brett and each of the thirteen colonies a fore times" +-------------------------------------------------------------------------------- +WER: 0.428571, CER: 0.208791, loss: 73.538918 + - wav: file:///home/ubuntu/en-data/common_voice_en_19999354.opus + - src: "his papers are now held at manuscripts and special collections the university of nottingham" + - res: "i propose now held at ministration special collections the university of notingham" +-------------------------------------------------------------------------------- +WER: 0.428571, CER: 0.315217, loss: 72.908447 + - wav: file:///home/ubuntu/en-data/common_voice_en_25568014.opus + - src: "lafayette secured the agreement of louis philippe who accepted the throne to various reforms" + - res: "the fated secured the agreement of voice vitae the throne to various reforms" +-------------------------------------------------------------------------------- +WER: 0.428571, CER: 0.235294, loss: 72.391060 + - wav: file:///home/ubuntu/en-data/common_voice_en_25183003.opus + - src: "brian mcconnell a nearby tabloid journalist also intervened and was shot in the chest" + - res: "brian went cool and herbie that boy journalist also intervened and was shot in the chest" +-------------------------------------------------------------------------------- +WER: 0.428571, CER: 0.198020, loss: 70.961609 + - wav: file:///home/ubuntu/en-data/common_voice_en_19601265.opus + - src: "its primary use is for surveillance and observation in battlefield environments with downlinked video" + - res: "his primary use is perseverance and observation and battlefield environments with the dowling video" +-------------------------------------------------------------------------------- +Worst WER: +-------------------------------------------------------------------------------- +WER: 1.400000, CER: 0.666667, loss: 66.314156 + - wav: file:///home/ubuntu/en-data/common_voice_en_24771140.opus + - src: "it is opposing soft systems" + - res: "is of closing to the tree comes" +-------------------------------------------------------------------------------- +WER: 1.500000, CER: 0.558824, loss: 65.613472 + - wav: file:///home/ubuntu/en-data/common_voice_en_27095220.opus + - src: "center for sustainable development" + - res: "send a forest in in wonderment" +-------------------------------------------------------------------------------- +WER: 1.600000, CER: 1.076923, loss: 135.049271 + - wav: file:///home/ubuntu/en-data/common_voice_en_19287970.opus + - src: "it is available on youtube" + - res: "its available on you tube it's available on you to" +-------------------------------------------------------------------------------- +WER: 2.000000, CER: 0.882353, loss: 175.302841 + - wav: file:///home/ubuntu/en-data/common_voice_en_18778827.opus + - src: "these extra cards were inserted randomly into packs" + - res: "oh but that is is extra care worn as your to the run to win is agusan" +-------------------------------------------------------------------------------- +WER: 2.000000, CER: 0.720000, loss: 54.325821 + - wav: file:///home/ubuntu/en-data/common_voice_en_25648391.opus + - src: "offended isabel flies off" + - res: "i think it is a ten light of" +-------------------------------------------------------------------------------- +Testing model on /home/ubuntu/librispeech/librivox-test-clean.csv +Test epoch | Steps: 0 | Elapsed Time: 0:00:00 +Test epoch | Steps: 1 | Elapsed Time: 0:00:38 +Test epoch | Steps: 2 | Elapsed Time: 0:01:41 +Test epoch | Steps: 3 | Elapsed Time: 0:03:10 +Test epoch | Steps: 3 | Elapsed Time: 0:03:10 +Test on /home/ubuntu/librispeech/librivox-test-clean.csv - WER: 0.052248, CER: 0.018900, loss: 8.554506 +-------------------------------------------------------------------------------- +Best WER: +-------------------------------------------------------------------------------- +WER: 0.000000, CER: 0.000000, loss: 20.654106 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-clean-wav/5142-36377-0014.wav + - src: "a pretty girl and so far as i could judge by appearances a good girl too describing her generally i may say that she had a small head well carried and well set on her shoulders bright gray eyes that looked at you honestly and meant what they looked a trim slight little figure too slight for our english notions of beauty a strong american accent and a rare thing in america a pleasantly toned voice which made the accent agreeable to english ears" + - res: "a pretty girl and so far as i could judge by appearances a good girl too describing her generally i may say that she had a small head well carried and well set on her shoulders bright gray eyes that looked at you honestly and meant what they looked a trim slight little figure too slight for our english notions of beauty a strong american accent and a rare thing in america a pleasantly toned voice which made the accent agreeable to english ears" +-------------------------------------------------------------------------------- +WER: 0.000000, CER: 0.000000, loss: 20.471767 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-clean-wav/1580-141083-0001.wav + - src: "i had always known him to be restless in his manner but on this particular occasion he was in such a state of uncontrollable agitation that it was clear something very unusual had occurred" + - res: "i had always known him to be restless in his manner but on this particular occasion he was in such a state of uncontrollable agitation that it was clear something very unusual had occurred" +-------------------------------------------------------------------------------- +WER: 0.000000, CER: 0.000000, loss: 18.640211 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-clean-wav/4507-16021-0047.wav + - src: "yesterday you were trembling for a health that is dear to you to day you fear for your own to morrow it will be anxiety about money the day after to morrow the diatribe of a slanderer the day after that the misfortune of some friend then the prevailing weather then something that has been broken or lost then a pleasure with which your conscience and your vertebral column reproach you again the course of public affairs" + - res: "yesterday you were trembling for a health that is dear to you to day you fear for your own to morrow it will be anxiety about money the day after to morrow the diatribe of a slanderer the day after that the misfortune of some friend then the prevailing weather then something that has been broken or lost then a pleasure with which your conscience and your vertebral column reproach you again the course of public affairs" +-------------------------------------------------------------------------------- +WER: 0.000000, CER: 0.000000, loss: 17.031771 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-clean-wav/3570-5694-0006.wav + - src: "drunkenness and the other pathological consequences of the free use of stimulants therefore tend in their turn to become honorific as being a mark at the second remove of the superior status of those who are able to afford the indulgence" + - res: "drunkenness and the other pathological consequences of the free use of stimulants therefore tend in their turn to become honorific as being a mark at the second remove of the superior status of those who are able to afford the indulgence" +-------------------------------------------------------------------------------- +WER: 0.000000, CER: 0.000000, loss: 16.966490 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-clean-wav/237-126133-0022.wav + - src: "i didn't have any fears if i worked it rightly said the old gentleman complacently" + - res: "i didn't have any fears if i worked it rightly said the old gentleman complacently" +-------------------------------------------------------------------------------- +Median WER: +-------------------------------------------------------------------------------- +WER: 0.015385, CER: 0.002882, loss: 5.821908 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-clean-wav/4507-16021-0026.wav + - src: "to keep afloat and to rescue from oblivion to hold above the gulf were it but a fragment of some language which man has spoken and which would otherwise be lost that is to say one of the elements good or bad of which civilization is composed or by which it is complicated to extend the records of social observation is to serve civilization itself" + - res: "to keep afloat and to rescue from oblivion to hold above the gulf where it but a fragment of some language which man has spoken and which would otherwise be lost that is to say one of the elements good or bad of which civilization is composed or by which it is complicated to extend the records of social observation is to serve civilization itself" +-------------------------------------------------------------------------------- +WER: 0.015625, CER: 0.011236, loss: 32.164326 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-clean-wav/4077-13751-0018.wav + - src: "american school boys read with emotions of horror of the albigenses driven beaten and killed with a papal legate directing the butchery and of the vaudois hunted and hounded like beasts as the effect of a royal decree and they yet shall read in the history of their own country of scenes as terrible as these in the exhibition of injustice and inhuman hate" + - res: "american school boys read with emotions of horror of the albigenses driven beaten and killed with a papal legate directing the butchery and of the todos hunted and hounded like beasts as the effect of a royal decree and they yet shall read in the history of their own country of scenes as terrible as these in the exhibition of injustice and inhuman hate" +-------------------------------------------------------------------------------- +WER: 0.015625, CER: 0.008499, loss: 20.004030 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-clean-wav/6930-75918-0003.wav + - src: "from the respect paid her on all sides she seemed like a queen and from the adoration with which she was treated by two or three she appeared an object of worship the queen mother gave the french the most affectionate reception france was her native country and she had suffered too much unhappiness in england for england to have made her forget france" + - res: "from the respect paid her on all sides she seemed like a clean and from the adoration with which she was treated by two or three she appeared an object of worship the queen mother gave the french the most affectionate reception france was her native country and she had suffered too much unhappiness in england for england to have made her forget france" +-------------------------------------------------------------------------------- +WER: 0.016129, CER: 0.002747, loss: 8.017584 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-clean-wav/3729-6852-0006.wav + - src: "silvia did not think that her good conduct was a merit for she knew that she was virtuous only because her self love compelled her to be so and she never exhibited any pride or assumed any superiority towards her theatrical sisters although satisfied to shine by their talent or their beauty they cared little about rendering themselves conspicuous by their virtue" + - res: "sylvia did not think that her good conduct was a merit for she knew that she was virtuous only because her self love compelled her to be so and she never exhibited any pride or assumed any superiority towards her theatrical sisters although satisfied to shine by their talent or their beauty they cared little about rendering themselves conspicuous by their virtue" +-------------------------------------------------------------------------------- +WER: 0.016949, CER: 0.005479, loss: 7.095662 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-clean-wav/2300-131720-0035.wav + - src: "in this connection it should be mentioned that the association of edison illuminating companies in the same year adopted resolutions unanimously to the effect that the edison meter was accurate and that its use was not expensive for stations above one thousand lights and that the best financial results were invariably secured in a station selling current by meter" + - res: "in this connection it should be mentioned that the association of addison illuminating companies in the same year adopted resolutions unanimously to the effect that the edison meter was accurate and that its use was not expensive for stations above one thousand lights and that the best financial results were invariably secured in a station selling current by meter" +-------------------------------------------------------------------------------- +Worst WER: +-------------------------------------------------------------------------------- +WER: 0.750000, CER: 0.200000, loss: 20.187176 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-clean-wav/8463-294828-0005.wav + - src: "conseil was my manservant" + - res: "cause was my man servant" +-------------------------------------------------------------------------------- +WER: 0.777778, CER: 0.404762, loss: 56.192341 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-clean-wav/3729-6852-0043.wav + - src: "i reside in the marais rue de douze portes" + - res: "iris eyed in the mare rude duport" +-------------------------------------------------------------------------------- +WER: 1.000000, CER: 0.444444, loss: 32.090935 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-clean-wav/2830-3980-0026.wav + - src: "verse two" + - res: "first to" +-------------------------------------------------------------------------------- +WER: 1.000000, CER: 0.294118, loss: 14.372181 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-clean-wav/1089-134691-0024.wav + - src: "stephanos dedalos" + - res: "stefano delos" +-------------------------------------------------------------------------------- +WER: 1.000000, CER: 0.214286, loss: 3.630816 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-clean-wav/61-70968-0038.wav + - src: "robin fitzooth" + - res: "robin fitz routh" +-------------------------------------------------------------------------------- +Testing model on /home/ubuntu/librispeech/librivox-test-other.csv +Test epoch | Steps: 0 | Elapsed Time: 0:00:00 +Test epoch | Steps: 1 | Elapsed Time: 0:00:41 +Test epoch | Steps: 2 | Elapsed Time: 0:01:18 +Test epoch | Steps: 3 | Elapsed Time: 0:02:49 +Test epoch | Steps: 3 | Elapsed Time: 0:02:49 +Test on /home/ubuntu/librispeech/librivox-test-other.csv - WER: 0.150316, CER: 0.072548, loss: 26.010748 +-------------------------------------------------------------------------------- +Best WER: +-------------------------------------------------------------------------------- +WER: 0.000000, CER: 0.000000, loss: 41.159855 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-other-wav/3331-159609-0000.wav + - src: "never mind what the business was it suffices to say that it was a good beginning for a young man like tom who having been born and bred in the most conservative class of the most conceited city in new england needed just the healthy hearty social influences of the west to widen his views and make a man of him" + - res: "never mind what the business was it suffices to say that it was a good beginning for a young man like tom who having been born and bred in the most conservative class of the most conceited city in new england needed just the healthy hearty social influences of the west to widen his views and make a man of him" +-------------------------------------------------------------------------------- +WER: 0.000000, CER: 0.000000, loss: 32.022297 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-other-wav/2033-164914-0020.wav + - src: "o my lord continued the eunuch and shahrazad perceived the dawn of day and ceased to say her permitted say" + - res: "o my lord continued the eunuch and shahrazad perceived the dawn of day and ceased to say her permitted say" +-------------------------------------------------------------------------------- +WER: 0.000000, CER: 0.000000, loss: 26.933062 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-other-wav/8188-269290-0048.wav + - src: "after the address the girls themselves were encouraged to speak and a very animated discussion followed" + - res: "after the address the girls themselves were encouraged to speak and a very animated discussion followed" +-------------------------------------------------------------------------------- +WER: 0.000000, CER: 0.000000, loss: 25.881916 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-other-wav/7902-96594-0001.wav + - src: "yes sir but he may turn up on the cliff at any moment" + - res: "yes sir but he may turn up on the cliff at any moment" +-------------------------------------------------------------------------------- +WER: 0.000000, CER: 0.000000, loss: 24.124416 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-other-wav/2414-128291-0004.wav + - src: "answered he the same that thou seekest thou mischief maker that is to say happiness upon earth" + - res: "answered he the same that thou seekest thou mischief maker that is to say happiness upon earth" +-------------------------------------------------------------------------------- +Median WER: +-------------------------------------------------------------------------------- +WER: 0.125000, CER: 0.056962, loss: 41.689541 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-other-wav/367-293981-0011.wav + - src: "to be brief he took the materials of which he made a compound mixing them all and boiling them a good while until it seemed to him they had come to perfection" + - res: "to be brief he took the materials of which he made a compound mixing the wall boiling them a good willet until it seemed to him they had come to perfection" +-------------------------------------------------------------------------------- +WER: 0.125000, CER: 0.075949, loss: 39.316055 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-other-wav/1688-142285-0052.wav + - src: "as they turned up into a small court opening out of a squalid street bessy said" + - res: "as they turned up into a small court opening out into a squalid street betty said" +-------------------------------------------------------------------------------- +WER: 0.125000, CER: 0.039548, loss: 38.868198 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-other-wav/6128-63241-0001.wav + - src: "the women he had hitherto known had been mainly of his own soft clime and it was not often they exhibited the tendency he detected and cursorily deplored in missus luna's sister" + - res: "the women he had hitherto known had been mainly or his own soft climb and it was not often be exhibited the tendency he detected and cursorily deplored in missus lunes sister" +-------------------------------------------------------------------------------- +WER: 0.125000, CER: 0.040359, loss: 37.354950 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-other-wav/4294-14317-0004.wav + - src: "but beware of letting bandinello quit you rather bestow upon him always more than he demands for if he goes into foreign parts his ignorance is so presumptuous that he is just the man to disgrace our most illustrious school" + - res: "but beware of letting bend nello quit you rather bestow upon him always more than he demands for he goes into foreign parts his ignorance is so presumptuous that is just the man to disgrace or most illustrious school" +-------------------------------------------------------------------------------- +WER: 0.125000, CER: 0.061069, loss: 36.567032 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-other-wav/7105-2340-0001.wav + - src: "well the failing still exists doesn't it said her husband or do you suppose a reform of character is entailed along with the estate" + - res: "well the failing still exists thus in it said the husband or do you suppose a reform of character is entailed along with the estate" +-------------------------------------------------------------------------------- +Worst WER: +-------------------------------------------------------------------------------- +WER: 1.100000, CER: 0.589286, loss: 123.546707 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-other-wav/2414-128292-0023.wav + - src: "o eternal everywhere o eternal nowhere o eternal in vain" + - res: "o i don't know everywhere or i done the nowhere who had turned that in vain" +-------------------------------------------------------------------------------- +WER: 1.125000, CER: 0.375000, loss: 71.525642 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-other-wav/2609-156975-0016.wav + - src: "was moses justified in resisting the egyptian taskmaster" + - res: "his moves its just finding resist in de gibson taskmaster" +-------------------------------------------------------------------------------- +WER: 1.333333, CER: 0.400000, loss: 19.822819 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-other-wav/7105-2340-0009.wav + - src: "signed wilfrid pigeoncote" + - res: "sign wilfred pecan coat" +-------------------------------------------------------------------------------- +WER: 1.500000, CER: 0.187500, loss: 13.895748 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-other-wav/533-131564-0022.wav + - src: "where's milicent" + - res: "where is millicent" +-------------------------------------------------------------------------------- +WER: 2.000000, CER: 0.720000, loss: 69.510612 + - wav: file:///home/ubuntu/librispeech/LibriSpeech/test-other-wav/5442-41168-0014.wav + - src: "sergey ivanovitch frowned" + - res: "so that he even abich round" +-------------------------------------------------------------------------------- diff --git a/english/coqui/v1.0.0-large-vocab/MODEL_CARD.md b/english/coqui/v1.0.0-large-vocab/MODEL_CARD.md new file mode 100644 index 0000000..d90ea48 --- /dev/null +++ b/english/coqui/v1.0.0-large-vocab/MODEL_CARD.md @@ -0,0 +1,83 @@ +# Model card for English STT v1.0.0 + +Jump to section: + +- [Model details](#model-details) +- [Intended use](#intended-use) +- [Performance Factors](#performance-factors) +- [Metrics](#metrics) +- [Training data](#training-data) +- [Evaluation data](#evaluation-data) +- [Ethical considerations](#ethical-considerations) +- [Caveats and recommendations](#caveats-and-recommendations) + +## Model details + +- Person or organization developing model: Maintained by [Coqui](https://coqui.ai/). +- Model language: English / English / `en` +- Model date: October 3, 2021 +- Model type: `Speech-to-Text` +- Model version: `v1.0.0` +- Compatible with 🐸 STT version: `v1.0.0` +- License: Apache 2.0 +- Citation details: `@techreport{english-stt, author = {Coqui}, title = {English STT v1.0.0}, institution = {Coqui}, address = {\url{https://coqui.ai/models}} year = {2021}, month = {October}, number = {STT-EN-1.0.0} }` +- Where to send questions or comments about the model: You can leave an issue on [`STT` issues](https://github.com/coqui-ai/STT/issues), open a new discussion on [`STT` discussions](https://github.com/coqui-ai/STT/discussions), or chat with us on [Gitter](https://gitter.im/coqui-ai/). + +## Intended use + +Speech-to-Text for the [English Language](https://en.wikipedia.org/wiki/English_language) on 16kHz, mono-channel audio. + +## Performance Factors + +Factors relevant to Speech-to-Text performance include but are not limited to speaker demographics, recording quality, and background noise. Read more about STT performance factors [here](https://stt.readthedocs.io/en/latest/DEPLOYMENT.html#how-will-a-model-perform-on-my-data). + +## Metrics + +STT models are usually evaluated in terms of their transcription accuracy, deployment Real-Time Factor, and model size on disk. + +#### Transcription Accuracy + +Using the language model with settings `lm_alpha=0.49506138236732433` and `lm_beta=0.11939819449850608` (found via `lm_optimizer.py`): + +- Librispeech clean: WER: 5.2\%, CER: 1.9\% +- Librispeech clean: WER: 15.0\%, CER: 7.3\% +- Common Voice 7.0 (Coqui custom splits): 44.4\%, CER: 24.7\% + +#### Model Size + +For STT, you always must deploy an acoustic model, and it is often the case you also will want to deploy an application-specific language model. + +|Model type|Vocabulary|Filename|Size| +----------------|-----|----------------|-----| +|Acoustic model | open | `model.tflite` | 181M| +|Language model | large | `large-vocabulary.scorer` |127M| + +### Approaches to uncertainty and variability + +Confidence scores and multiple paths from the decoding beam can be used to measure model uncertainty and provide multiple, variable transcripts for any processed audio. + +## Training data + +This model was trained on the following corpora: Common Voice 7.0 English (custom Coqui train/dev/test splits), LibriSpeech, and Multilingual Librispeech. In total approximately ~47,000 hours of data. + +## Evaluation data + +The validation ("dev") sets came from CV, Librispeech, and MLS. + +## Ethical considerations + +Deploying a Speech-to-Text model into any production setting has ethical implications. You should consider these implications before use. + +### Demographic Bias + +You should assume every machine learning model has demographic bias unless proven otherwise. For STT models, it is often the case that transcription accuracy is better for men than it is for women. If you are using this model in production, you should acknowledge this as a potential issue. + +### Surveillance + +Speech-to-Text may be mis-used to invade the privacy of others by recording and mining information from private conversations. This kind of individual privacy is protected by law in may countries. You should not assume consent to record and analyze private speech. + +## Caveats and recommendations + +Machine learning models (like this STT model) perform best on data that is similar to the data on which they were trained. Read about what to expect from an STT model with regard to your data [here](https://stt.readthedocs.io/en/latest/DEPLOYMENT.html#how-will-a-model-perform-on-my-data). + +In most applications, it is recommended that you [train your own language model](https://stt.readthedocs.io/en/latest/LANGUAGE_MODEL.html) to improve transcription accuracy on your speech data. diff --git a/english/coqui/v1.0.0-large-vocab/alphabet.txt b/english/coqui/v1.0.0-large-vocab/alphabet.txt new file mode 100644 index 0000000..46aa35e --- /dev/null +++ b/english/coqui/v1.0.0-large-vocab/alphabet.txt @@ -0,0 +1,33 @@ +# Each line in this file represents the Unicode codepoint (UTF-8 encoded) +# associated with a numeric label. +# A line that starts with # is a comment. You can escape it with \# if you wish +# to use '#' as a label. + +a +b +c +d +e +f +g +h +i +j +k +l +m +n +o +p +q +r +s +t +u +v +w +x +y +z +' +# The last (non-comment) line needs to end with a newline.