Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(web): import the generator for the pred-text wordbreaker's Unicode-property data-table ⚡ #10690

Merged
merged 27 commits into from
Aug 27, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
9093c07
change(web): preps for wordbreaker child projects
jahorton Feb 12, 2024
901861a
feat(web): implements string-encoded prop-array search
jahorton Feb 12, 2024
58c7575
feat(web): full property data-table generation functionality; data is…
jahorton Feb 13, 2024
346556b
fix(web): conditional import path
jahorton Feb 16, 2024
cf4f832
chore(web): Merge branch 'master' into feat/web/wordbreaker-property-…
jahorton Aug 6, 2024
cc023dd
chore(common/models): reverts unneeded addition of zlib
jahorton Aug 6, 2024
6994273
chore(web): Merge branch 'fix/web/lm-worker-test' into feat/web/wordb…
jahorton Aug 6, 2024
1e8662a
chore(web): Merge branch 'chore/common/minimum-versions-add-data' int…
jahorton Aug 6, 2024
fd8b260
change(common/models): adds unicode-data downloader
jahorton Aug 6, 2024
77b94bf
feat(common/models): integrates wordbreaking-data processor into word…
jahorton Aug 6, 2024
242eb6c
fix(common): restore, preserve unicode-copyright.txt
jahorton Aug 6, 2024
c7f4631
fix(common/models): fix tsconfig issue from this PR's changes
jahorton Aug 7, 2024
e2dffff
fix(common): fix data-compiler path references
jahorton Aug 7, 2024
217ad29
fix(common/models): actually run the data-compiler
jahorton Aug 7, 2024
c2da9cd
change(common/models): data table compilation as configure, not build
jahorton Aug 7, 2024
1ff33a3
change(common/models): set unicode-data dep for configure step
jahorton Aug 7, 2024
a517c87
chore(web): Merge branch 'master' into feat/web/wordbreaker-property-…
jahorton Aug 7, 2024
dda43aa
change(common/models): moves wordbreaker data-gen from src/ to tools/…
jahorton Aug 8, 2024
7016e5b
chore(common/models): removes incomplete early check-in
jahorton Aug 8, 2024
e5387f0
change(web): Unicode data-fetcher build.sh -> download.sh
jahorton Aug 8, 2024
88df68c
chore(common/models): reorganize wordbreaker build outputs
jahorton Aug 21, 2024
044c25a
change(common/models): increase specificity in wordbreaker's .gitignore
jahorton Aug 23, 2024
8737709
chore(web): Merge branch 'master' into feat/web/wordbreaker-property-…
jahorton Aug 23, 2024
347b814
chore(common/models): copies original data-gen's license for attribution
jahorton Aug 23, 2024
ecaef39
docs(common/models): fixes relative path in doc-comment
jahorton Aug 23, 2024
ad91f63
chore(web): Merge branch 'master' into feat/web/wordbreaker-property-…
jahorton Aug 26, 2024
be24a7d
chore(common/models): moves data-compiler artifacts to /tools subfolder
jahorton Aug 26, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion common/models/wordbreakers/.gitignore
Original file line number Diff line number Diff line change
@@ -1 +1,2 @@
build/
build/
src/main/default/data.inc.ts
22 changes: 17 additions & 5 deletions common/models/wordbreakers/build.sh
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,8 @@ THIS_SCRIPT="$(readlink -f "${BASH_SOURCE[0]}")"

################################ Main script ################################

# Note: the raw text files used for data.inc.ts are found within
# /resources/standards-data/unicode-character-database.
builder_describe "Builds the predictive-text wordbreaker implementation module" \
"clean" \
"configure" \
Expand All @@ -20,16 +22,26 @@ builder_describe "Builds the predictive-text wordbreaker implementation module"
"--ci"

builder_describe_outputs \
configure /node_modules \
build build/obj/index.js
configure src/main/default/data.inc.ts \
build build/main/obj/index.js

builder_parse "$@"

function do_configure() {
verify_npm_setup

# This is a script used to build the data.inc.ts file needed by the
# default wordbreaker. We rarely update the backing data, but it
# is needed _before_ the `build` action's compilation step.
tsc -b tools/data-compiler/tsconfig.json
node ./build/tools/data-compiler/obj/index.js
}

function do_build() {
tsc -b
tsc -b ./tsconfig.json

# Declaration bundling.
tsc --emitDeclarationOnly --outFile ./build/lib/index.d.ts
tsc -p ./tsconfig.json --emitDeclarationOnly --outFile ./build/main/lib/index.d.ts
}

function do_test() {
Expand All @@ -40,7 +52,7 @@ function do_test() {
fi
}

builder_run_action configure verify_npm_setup
builder_run_action configure do_configure
builder_run_action clean rm -rf build/
builder_run_action build do_build
builder_run_action test do_test
18 changes: 12 additions & 6 deletions common/models/wordbreakers/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -14,17 +14,23 @@
],
"homepage": "https://github.com/keymanapp/keyman",
"license": "MIT",
"main": "build/obj/index.js",
"types": "build/obj/index.d.ts",
"main": "build/main/obj/index.js",
"types": "build/main/obj/index.d.ts",
"exports": {
".": {
"es6-bundling": "./src/index.ts",
"default": "./build/obj/index.js"
"es6-bundling": "./src/main/index.ts",
"default": "./build/main/obj/index.js"
},
"./lib": {
"types": "./build/lib/index.d.ts"
"types": "./build/main/lib/index.d.ts"
},
"./obj/*.js": "./build/obj/*.js"
"./obj/*.js": "./build/main/obj/*.js",
"./test-index": {
"default": "./build/main/obj/test-index.js"
},
"./README.md": {
"default": "./README.md"
}
},
"directories": {
"lib": "lib",
Expand Down
Loading
Loading