Skip to content
This repository has been archived by the owner on Apr 6, 2020. It is now read-only.

[devops] Batch uploader script #227

Merged
merged 1 commit into from
Oct 30, 2019
Merged

Conversation

joeyklee
Copy link
Contributor

Dear ml5 community,

I'm making a Pull Request(PR). Please see the details below.

A good PR 🌟

β†’ Step 1: Which branch are you submitting to? 🌲

Development (for new features or updates), Release (for bug fixes), or ___________?

  • development

β†’ Step 2: Describe your Pull Request πŸ“

Fixing a Bug? Adding an Update? Submitting a New Example? Does it introduce a breaking change?

  • Adds batch uploader script that traverses this repo and then updates all the p5 web editor sketches.
  • NOTE: this will not currently work as the p5 web editor api is not yet in the release. But when the time comes, we can auto-update our sketches this way.

usage

  1. update the .env file with the appropriate details
  2. run the script
npm run update:p5webeditor

cc/ @catarak @shiffman

@joeyklee joeyklee changed the base branch from release to development October 30, 2019 22:06
@joeyklee joeyklee merged commit 9a9091f into development Oct 30, 2019
@joeyklee joeyklee deleted the batch-uploader-script branch October 30, 2019 22:06
joeyklee added a commit that referenced this pull request Nov 6, 2019
* Adds face-api demos (#161)

* added face-expressions demo

* added classifyExpressionsMultiple

* rm model files and model path requirement

* added face landmarks example

* clean up example

* rm options in example

* added local models example

* changed function names

* updated examples to use .detect()

* rm translation

* added image example of Frida

* added detectSingle

* updated image landmarks with landmarks.parts

* refactored code friendly and changed colors

* made ex friendly

* changed options from withFaceX to withX

* Structure examples directories for consistency (#170)

* moved CVAE example to dir

* moved dcgan to random for random space

* moved sentiment to dir

* moved word2vec to dir

* moved files

* rm p5 lib

* match javascript example folder structure

* Examples index page (#171)

* added placeholder index.html and node script

* adds ml5 index page

* added latent vector example (#175)

* Trying out some new example ideas for DCGAN latent vector

* added simpler demo (#181)

* moved index.html to /public (#182)

* [In progress] Support for p5 Instance mode in ml5.js example (#160)

* added bodypix_p5Instance

* adds p5Instance mode example

* [in progress] Adds plain javascript examples based on the p5 examples (#165)

* added plain js bodypix examples

* added cvae example

* added dcgan example

* added faceapi with landmarks // todo expressions

* stashing changes for now

* moved files

* added yolo webcam plain js

* added yolo image example

* remove text on p5

* rm p5 scripts

* adds bodyPix examples

* wip expressions demo

* adds faceapi expressions demo

* adds charRNN_interactive example

* added charRNN_test

* added charRnn_text_stateful'

* adds ImageClassification_Video_Load

* added ImageClassification_DoodleNet_Canvas

* added sentiment ex

* adds unet example

* add doodlenet_video - NOT WORKING

* added posenet examples - NOT WORKING

* added posenet_image_single

* adds part selection example - NEEDS REVIEW

* adds examples for posnet

* added styletransfer video plainjs

* added word2vec example

* rm p5 ref

* added sketchRnn basic example

* added sketchRnn interactive

* adds pix2pix example

* add pix2pix promise

* adds speech command

* adds speech commands example

* adds plain js pitchDetection

* adds pitch game

* format text

* adds knn video example

* adds knn classifier video example

* adds knn classifier posenet

* adds regressor fe

* adds videosquare

* adds sound example

* adds piano ex

* adds scavenger hunt - works only in chrome for now

* adds video and sound example

* adds doodlenet examples

* adds multiple example

* update bodypix examples

* update cvae

* adds updates to faceapi and dcgan

* updates yolo

* updats examples

* adds teachable machine image classification example (#196)

* rm expressions references in faceapi examples (#202)

* adds live-server to npm scripts (#204)

* update gh templates (#211)

* Generic Neural Net Example (#164)

* added example

* added co2 net - WORK IN PROGRESS

* updated model and loaded data from model

* fix unNormalize

* refactored code

* added axes

* added axes

* added message about log transform

* added legend in html

* adds placeholder for titanic example

* adds data, constructor, and laodData

* adds normalize data function

* adds training function

* updates example

* adds neural network training

* Speculative Ideas about Titanic Example (#187)

* speculative ideas with example

* since it's classification is there a way to mirror other ml5 classification examples?

* refactor of titanic example

* Adds titanic example to match diy-nn-with-data (#188)

* adds experimental csv and specified string as output

* working with titanic

* update examples - TODO: feed in normalized vals for titanic inputs

* adds simple regression example placeholder

* adds simple regression example

* comments train with options

* moves batchSize and epoch options

* change to .classify()

* updates co2 training sketch with predict vals from 0 - 1

* update to classify

* updates basic -- broken

* changes inputs and fixes undef.

* changes data in basic

* whitespace adjustments

* some cleanup and ideas for titanic example

* speculative port of color classifier example

* rm shuffle()

* updates color classifier example

* change vals to arrays in .addData()

* work on neural network color classifier (#190)

* small adjustments for testing code with ml5js/ml5-library#574

* example cleanup todos

* updates color classifier example to reflect current generic nn

* Updating Titanic Example (#191)

* redoing titanic example with final cleaned data from @lydiajessup

* training is working but issue with predict and passing in strings

* working with manually encoding of inputs to predict()

* updates titanic sketch

* porting tf.js XOR example from coding train challenge (#192)

* porting tf.js XOR example from coding train challenge

* adding learning rate

* noting hiddenUnits variable

* updating color classifier see: ml5js/ml5-library#581

* refactor titanic example

* using label directly

* logs not loss

* trying values

* moving sketch.js

* update simple regression

* updates regression sketch

* update co2 example

* update to use results.outputs

* Refactors examples to match diy-nn-refactor branch (#195)

* neural noteplayer example

* example inspired by Eyeo 2019 Rebecca Fiebrink talk

* rename musical mouse example

* example tweaks and oscillator

* adds refactoring examples

* updates examples based in refactor

* updates xor"

* rm unused co2net

* updates examples for regression

* updates musical note example

* adds experimental normalizationOptions

* adds example of multi layered network

* changes activations

* adds simple classification example

* changes .normalize() to .normalizeData()

* updates all examples to handle array of .predict() or .classify() output

* Pass over DIY interactive data examples (#198)

* neural noteplayer example

* example inspired by Eyeo 2019 Rebecca Fiebrink talk

* rename musical mouse example

* example tweaks and oscillator

* musical face example

* different interface for face example

* mouse and pixels cleanup

* musical face adjust to new API

* code comments

* low res pixel comments and naming

* Clean-up of interactive neural network examples (#201)

* neural noteplayer example

* example inspired by Eyeo 2019 Rebecca Fiebrink talk

* rename musical mouse example

* example tweaks and oscillator

* musical face example

* different interface for face example

* mouse and pixels cleanup

* musical face adjust to new API

* code comments

* low res pixel comments and naming

* comments and cleanup for face example

* normalize automatically face

* DIY Neural Network mouseXY classification example (#199)

* neural noteplayer example

* example inspired by Eyeo 2019 Rebecca Fiebrink talk

* rename musical mouse example

* example tweaks and oscillator

* musical face example

* different interface for face example

* mouse and pixels cleanup

* musical face adjust to new API

* code comments

* attempting DIY classification example

* ?

* fixes outputs and changes function to .classify()

* posenet classification example

* rm console.log

* rm withExpressions in musical face

* [diy nn] Updates examples to use labels for inputs/outputs (#205)

* updates musical mouse and xy classifier with specific input/output labels

* update titles

* update text in co2net

* adds load data function (#206)

* adds xOR example with multiPredict (#207)

* [WIP] DIY NN - examples for loading model (#210)

* adds loadModel example

* updates example showcasing issues

* updated example to reflect current ml5-lib temp fix

* Updates model_load example (#212)

* adds loadModel example

* updates example showcasing issues

* updated example to reflect current ml5-lib temp fix

* updates loading model example

* rm faceapi examples with expressions (#213)

* Updates bodypix examples to use preload() for p5js examples (#214)

* adds preload example

* updates bodypix to use preload()

* Kmeans Image Segmentation Example (#215)

* adds simple kmeans clustering example

* code cleanup

* change image size to 30 x 30 to run faster

* changes ml5 version to 0.4.0

* updates public index

* updates ml5 version and updater script

* update npm script name"

* adds 2019

* updates p5 to version 0.9.0

* sets localhost

* Revising Teachable Machine Snippets (#218)

* matching proposed TM snippets for image classification

* sound example and refactoring to new TM folder

* changing name to include URL

* fix typo

* adds flipped video (#219)

* updates bodypix examples to reflect updated api (#225)

* adds p5 batch uploader script

* adds p5 batch uploader script (#227)

* set ml to dev

* adds background to unet

* bumps version
joeyklee added a commit that referenced this pull request Nov 7, 2019
* Adds face-api demos (#161)

* added face-expressions demo

* added classifyExpressionsMultiple

* rm model files and model path requirement

* added face landmarks example

* clean up example

* rm options in example

* added local models example

* changed function names

* updated examples to use .detect()

* rm translation

* added image example of Frida

* added detectSingle

* updated image landmarks with landmarks.parts

* refactored code friendly and changed colors

* made ex friendly

* changed options from withFaceX to withX

* Structure examples directories for consistency (#170)

* moved CVAE example to dir

* moved dcgan to random for random space

* moved sentiment to dir

* moved word2vec to dir

* moved files

* rm p5 lib

* match javascript example folder structure

* Examples index page (#171)

* added placeholder index.html and node script

* adds ml5 index page

* added latent vector example (#175)

* Trying out some new example ideas for DCGAN latent vector

* added simpler demo (#181)

* moved index.html to /public (#182)

* [In progress] Support for p5 Instance mode in ml5.js example (#160)

* added bodypix_p5Instance

* adds p5Instance mode example

* [in progress] Adds plain javascript examples based on the p5 examples (#165)

* added plain js bodypix examples

* added cvae example

* added dcgan example

* added faceapi with landmarks // todo expressions

* stashing changes for now

* moved files

* added yolo webcam plain js

* added yolo image example

* remove text on p5

* rm p5 scripts

* adds bodyPix examples

* wip expressions demo

* adds faceapi expressions demo

* adds charRNN_interactive example

* added charRNN_test

* added charRnn_text_stateful'

* adds ImageClassification_Video_Load

* added ImageClassification_DoodleNet_Canvas

* added sentiment ex

* adds unet example

* add doodlenet_video - NOT WORKING

* added posenet examples - NOT WORKING

* added posenet_image_single

* adds part selection example - NEEDS REVIEW

* adds examples for posnet

* added styletransfer video plainjs

* added word2vec example

* rm p5 ref

* added sketchRnn basic example

* added sketchRnn interactive

* adds pix2pix example

* add pix2pix promise

* adds speech command

* adds speech commands example

* adds plain js pitchDetection

* adds pitch game

* format text

* adds knn video example

* adds knn classifier video example

* adds knn classifier posenet

* adds regressor fe

* adds videosquare

* adds sound example

* adds piano ex

* adds scavenger hunt - works only in chrome for now

* adds video and sound example

* adds doodlenet examples

* adds multiple example

* update bodypix examples

* update cvae

* adds updates to faceapi and dcgan

* updates yolo

* updats examples

* adds teachable machine image classification example (#196)

* rm expressions references in faceapi examples (#202)

* adds live-server to npm scripts (#204)

* update gh templates (#211)

* Generic Neural Net Example (#164)

* added example

* added co2 net - WORK IN PROGRESS

* updated model and loaded data from model

* fix unNormalize

* refactored code

* added axes

* added axes

* added message about log transform

* added legend in html

* adds placeholder for titanic example

* adds data, constructor, and laodData

* adds normalize data function

* adds training function

* updates example

* adds neural network training

* Speculative Ideas about Titanic Example (#187)

* speculative ideas with example

* since it's classification is there a way to mirror other ml5 classification examples?

* refactor of titanic example

* Adds titanic example to match diy-nn-with-data (#188)

* adds experimental csv and specified string as output

* working with titanic

* update examples - TODO: feed in normalized vals for titanic inputs

* adds simple regression example placeholder

* adds simple regression example

* comments train with options

* moves batchSize and epoch options

* change to .classify()

* updates co2 training sketch with predict vals from 0 - 1

* update to classify

* updates basic -- broken

* changes inputs and fixes undef.

* changes data in basic

* whitespace adjustments

* some cleanup and ideas for titanic example

* speculative port of color classifier example

* rm shuffle()

* updates color classifier example

* change vals to arrays in .addData()

* work on neural network color classifier (#190)

* small adjustments for testing code with ml5js/ml5-library#574

* example cleanup todos

* updates color classifier example to reflect current generic nn

* Updating Titanic Example (#191)

* redoing titanic example with final cleaned data from @lydiajessup

* training is working but issue with predict and passing in strings

* working with manually encoding of inputs to predict()

* updates titanic sketch

* porting tf.js XOR example from coding train challenge (#192)

* porting tf.js XOR example from coding train challenge

* adding learning rate

* noting hiddenUnits variable

* updating color classifier see: ml5js/ml5-library#581

* refactor titanic example

* using label directly

* logs not loss

* trying values

* moving sketch.js

* update simple regression

* updates regression sketch

* update co2 example

* update to use results.outputs

* Refactors examples to match diy-nn-refactor branch (#195)

* neural noteplayer example

* example inspired by Eyeo 2019 Rebecca Fiebrink talk

* rename musical mouse example

* example tweaks and oscillator

* adds refactoring examples

* updates examples based in refactor

* updates xor"

* rm unused co2net

* updates examples for regression

* updates musical note example

* adds experimental normalizationOptions

* adds example of multi layered network

* changes activations

* adds simple classification example

* changes .normalize() to .normalizeData()

* updates all examples to handle array of .predict() or .classify() output

* Pass over DIY interactive data examples (#198)

* neural noteplayer example

* example inspired by Eyeo 2019 Rebecca Fiebrink talk

* rename musical mouse example

* example tweaks and oscillator

* musical face example

* different interface for face example

* mouse and pixels cleanup

* musical face adjust to new API

* code comments

* low res pixel comments and naming

* Clean-up of interactive neural network examples (#201)

* neural noteplayer example

* example inspired by Eyeo 2019 Rebecca Fiebrink talk

* rename musical mouse example

* example tweaks and oscillator

* musical face example

* different interface for face example

* mouse and pixels cleanup

* musical face adjust to new API

* code comments

* low res pixel comments and naming

* comments and cleanup for face example

* normalize automatically face

* DIY Neural Network mouseXY classification example (#199)

* neural noteplayer example

* example inspired by Eyeo 2019 Rebecca Fiebrink talk

* rename musical mouse example

* example tweaks and oscillator

* musical face example

* different interface for face example

* mouse and pixels cleanup

* musical face adjust to new API

* code comments

* attempting DIY classification example

* ?

* fixes outputs and changes function to .classify()

* posenet classification example

* rm console.log

* rm withExpressions in musical face

* [diy nn] Updates examples to use labels for inputs/outputs (#205)

* updates musical mouse and xy classifier with specific input/output labels

* update titles

* update text in co2net

* adds load data function (#206)

* adds xOR example with multiPredict (#207)

* [WIP] DIY NN - examples for loading model (#210)

* adds loadModel example

* updates example showcasing issues

* updated example to reflect current ml5-lib temp fix

* Updates model_load example (#212)

* adds loadModel example

* updates example showcasing issues

* updated example to reflect current ml5-lib temp fix

* updates loading model example

* rm faceapi examples with expressions (#213)

* Updates bodypix examples to use preload() for p5js examples (#214)

* adds preload example

* updates bodypix to use preload()

* Kmeans Image Segmentation Example (#215)

* adds simple kmeans clustering example

* code cleanup

* change image size to 30 x 30 to run faster

* changes ml5 version to 0.4.0

* updates public index

* updates ml5 version and updater script

* update npm script name"

* adds 2019

* updates p5 to version 0.9.0

* sets localhost

* Revising Teachable Machine Snippets (#218)

* matching proposed TM snippets for image classification

* sound example and refactoring to new TM folder

* changing name to include URL

* fix typo

* adds flipped video (#219)

* updates bodypix examples to reflect updated api (#225)

* adds p5 batch uploader script

* adds p5 batch uploader script (#227)

* set ml to dev

* adds background to unet

* bumps version
joeyklee added a commit that referenced this pull request Nov 14, 2019
* Adds face-api demos (#161)

* added face-expressions demo

* added classifyExpressionsMultiple

* rm model files and model path requirement

* added face landmarks example

* clean up example

* rm options in example

* added local models example

* changed function names

* updated examples to use .detect()

* rm translation

* added image example of Frida

* added detectSingle

* updated image landmarks with landmarks.parts

* refactored code friendly and changed colors

* made ex friendly

* changed options from withFaceX to withX

* Structure examples directories for consistency (#170)

* moved CVAE example to dir

* moved dcgan to random for random space

* moved sentiment to dir

* moved word2vec to dir

* moved files

* rm p5 lib

* match javascript example folder structure

* Examples index page (#171)

* added placeholder index.html and node script

* adds ml5 index page

* added latent vector example (#175)

* Trying out some new example ideas for DCGAN latent vector

* added simpler demo (#181)

* moved index.html to /public (#182)

* [In progress] Support for p5 Instance mode in ml5.js example (#160)

* added bodypix_p5Instance

* adds p5Instance mode example

* [in progress] Adds plain javascript examples based on the p5 examples (#165)

* added plain js bodypix examples

* added cvae example

* added dcgan example

* added faceapi with landmarks // todo expressions

* stashing changes for now

* moved files

* added yolo webcam plain js

* added yolo image example

* remove text on p5

* rm p5 scripts

* adds bodyPix examples

* wip expressions demo

* adds faceapi expressions demo

* adds charRNN_interactive example

* added charRNN_test

* added charRnn_text_stateful'

* adds ImageClassification_Video_Load

* added ImageClassification_DoodleNet_Canvas

* added sentiment ex

* adds unet example

* add doodlenet_video - NOT WORKING

* added posenet examples - NOT WORKING

* added posenet_image_single

* adds part selection example - NEEDS REVIEW

* adds examples for posnet

* added styletransfer video plainjs

* added word2vec example

* rm p5 ref

* added sketchRnn basic example

* added sketchRnn interactive

* adds pix2pix example

* add pix2pix promise

* adds speech command

* adds speech commands example

* adds plain js pitchDetection

* adds pitch game

* format text

* adds knn video example

* adds knn classifier video example

* adds knn classifier posenet

* adds regressor fe

* adds videosquare

* adds sound example

* adds piano ex

* adds scavenger hunt - works only in chrome for now

* adds video and sound example

* adds doodlenet examples

* adds multiple example

* update bodypix examples

* update cvae

* adds updates to faceapi and dcgan

* updates yolo

* updats examples

* adds teachable machine image classification example (#196)

* rm expressions references in faceapi examples (#202)

* adds live-server to npm scripts (#204)

* update gh templates (#211)

* Generic Neural Net Example (#164)

* added example

* added co2 net - WORK IN PROGRESS

* updated model and loaded data from model

* fix unNormalize

* refactored code

* added axes

* added axes

* added message about log transform

* added legend in html

* adds placeholder for titanic example

* adds data, constructor, and laodData

* adds normalize data function

* adds training function

* updates example

* adds neural network training

* Speculative Ideas about Titanic Example (#187)

* speculative ideas with example

* since it's classification is there a way to mirror other ml5 classification examples?

* refactor of titanic example

* Adds titanic example to match diy-nn-with-data (#188)

* adds experimental csv and specified string as output

* working with titanic

* update examples - TODO: feed in normalized vals for titanic inputs

* adds simple regression example placeholder

* adds simple regression example

* comments train with options

* moves batchSize and epoch options

* change to .classify()

* updates co2 training sketch with predict vals from 0 - 1

* update to classify

* updates basic -- broken

* changes inputs and fixes undef.

* changes data in basic

* whitespace adjustments

* some cleanup and ideas for titanic example

* speculative port of color classifier example

* rm shuffle()

* updates color classifier example

* change vals to arrays in .addData()

* work on neural network color classifier (#190)

* small adjustments for testing code with ml5js/ml5-library#574

* example cleanup todos

* updates color classifier example to reflect current generic nn

* Updating Titanic Example (#191)

* redoing titanic example with final cleaned data from @lydiajessup

* training is working but issue with predict and passing in strings

* working with manually encoding of inputs to predict()

* updates titanic sketch

* porting tf.js XOR example from coding train challenge (#192)

* porting tf.js XOR example from coding train challenge

* adding learning rate

* noting hiddenUnits variable

* updating color classifier see: ml5js/ml5-library#581

* refactor titanic example

* using label directly

* logs not loss

* trying values

* moving sketch.js

* update simple regression

* updates regression sketch

* update co2 example

* update to use results.outputs

* Refactors examples to match diy-nn-refactor branch (#195)

* neural noteplayer example

* example inspired by Eyeo 2019 Rebecca Fiebrink talk

* rename musical mouse example

* example tweaks and oscillator

* adds refactoring examples

* updates examples based in refactor

* updates xor"

* rm unused co2net

* updates examples for regression

* updates musical note example

* adds experimental normalizationOptions

* adds example of multi layered network

* changes activations

* adds simple classification example

* changes .normalize() to .normalizeData()

* updates all examples to handle array of .predict() or .classify() output

* Pass over DIY interactive data examples (#198)

* neural noteplayer example

* example inspired by Eyeo 2019 Rebecca Fiebrink talk

* rename musical mouse example

* example tweaks and oscillator

* musical face example

* different interface for face example

* mouse and pixels cleanup

* musical face adjust to new API

* code comments

* low res pixel comments and naming

* Clean-up of interactive neural network examples (#201)

* neural noteplayer example

* example inspired by Eyeo 2019 Rebecca Fiebrink talk

* rename musical mouse example

* example tweaks and oscillator

* musical face example

* different interface for face example

* mouse and pixels cleanup

* musical face adjust to new API

* code comments

* low res pixel comments and naming

* comments and cleanup for face example

* normalize automatically face

* DIY Neural Network mouseXY classification example (#199)

* neural noteplayer example

* example inspired by Eyeo 2019 Rebecca Fiebrink talk

* rename musical mouse example

* example tweaks and oscillator

* musical face example

* different interface for face example

* mouse and pixels cleanup

* musical face adjust to new API

* code comments

* attempting DIY classification example

* ?

* fixes outputs and changes function to .classify()

* posenet classification example

* rm console.log

* rm withExpressions in musical face

* [diy nn] Updates examples to use labels for inputs/outputs (#205)

* updates musical mouse and xy classifier with specific input/output labels

* update titles

* update text in co2net

* adds load data function (#206)

* adds xOR example with multiPredict (#207)

* [WIP] DIY NN - examples for loading model (#210)

* adds loadModel example

* updates example showcasing issues

* updated example to reflect current ml5-lib temp fix

* Updates model_load example (#212)

* adds loadModel example

* updates example showcasing issues

* updated example to reflect current ml5-lib temp fix

* updates loading model example

* rm faceapi examples with expressions (#213)

* Updates bodypix examples to use preload() for p5js examples (#214)

* adds preload example

* updates bodypix to use preload()

* Kmeans Image Segmentation Example (#215)

* adds simple kmeans clustering example

* code cleanup

* change image size to 30 x 30 to run faster

* changes ml5 version to 0.4.0

* updates public index

* updates ml5 version and updater script

* update npm script name"

* adds 2019

* updates p5 to version 0.9.0

* sets localhost

* Revising Teachable Machine Snippets (#218)

* matching proposed TM snippets for image classification

* sound example and refactoring to new TM folder

* changing name to include URL

* fix typo

* adds flipped video (#219)

* updates bodypix examples to reflect updated api (#225)

* adds p5 batch uploader script

* adds p5 batch uploader script (#227)

* set ml to dev

* adds background to unet

* bumps version

* sets ml5 to dev

* merge release and set ml5 local host

* adds example index json and script (#239)

* sets ml5 url to dev

* adds devops scripts for updating ml5 refs and avoiding merge conflicts

* sets ml5 url to release

* bumps version  v0.4.3

* sets ml version to 0.4.3

* updates examples json
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant