Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Executions View #596

Merged
merged 102 commits into from
Oct 3, 2022
Merged
Show file tree
Hide file tree
Changes from 101 commits
Commits
Show all changes
102 commits
Select commit Hold shift + click to select a range
286e1f8
chore: move src to a new location
anrusina Apr 24, 2022
0efd1df
ci: allow branch to be built again
anrusina Apr 24, 2022
b49fed5
chore: replace link to github repository to a proper one
anrusina Apr 25, 2022
9503a4c
ci: basic test and test-coverage setup
anrusina Apr 25, 2022
3091c4b
chore: add first plugin package
anrusina Apr 25, 2022
3573659
chore: allow to start test from main directory
anrusina Apr 25, 2022
8d1fef9
ci: update lowest mkdirp version (#423)
anrusina Apr 25, 2022
48a1c92
chore: add build scripts for console app (#429)
ursucarina Apr 26, 2022
caaf5c2
fix: hide the legend (#435)
eugenejahn Apr 28, 2022
133038a
ci: move storybook related packages to top level (#434)
anrusina Apr 28, 2022
1651a6f
fix: fix issue 386 (#437)
eugenejahn Apr 28, 2022
eeb551b
ci: ensure unified tsconfig and remove mocks, test, stories from buil…
anrusina Apr 28, 2022
b6e9941
Make whole row clickable to open TaskExecutionDetails panel (#444)
eugenejahn May 2, 2022
b513280
ci: allow to start jest config for all project at once (#447)
anrusina May 3, 2022
ecfdd4c
minor: unable to view all the workflow versions (#446)
ursucarina May 4, 2022
5b44539
chore(tsc): exclude test/stories/mock files only from build (#451)
anrusina May 5, 2022
560b645
ci: ensure that webpack too doesn't include test/mock/specs files (#452)
anrusina May 6, 2022
5e2bcbc
minor: add support for StructuredDataSet Input/Output type (#445)
ursucarina May 6, 2022
86d5636
chore: Provide basic repo structure and ensure that stories, tests, v…
anrusina May 11, 2022
acf3cb9
ci: minimize babel presence (#457)
anrusina May 11, 2022
38a4e96
fix: update node executions to display map tasks (#455)
olga-union May 13, 2022
c2ee154
ci: resolve docker build issues (#462)
anrusina May 13, 2022
e84a3c0
Chore: Rebase devmain on top of master (#464)
anrusina May 13, 2022
0853680
fix: ensure that admin version is fully shown (#465)
anrusina May 14, 2022
093210b
chore: fix for console not respecting admin url (#468)
ursucarina May 17, 2022
1859cf5
chore: rebase on top of master
anrusina May 17, 2022
42d2632
fix: trigger release #patch (#477)
anrusina May 18, 2022
324b4f5
feat: add task version info (#485)
apTalya May 19, 2022
821299e
chore: update Readme with python note + package version update (#486)
apTalya May 19, 2022
c25daea
hotfix ci pipeline (#487)
yindia May 20, 2022
747b100
[Mapping][TaskInfo] V.2 - Update Task details to allow check informat…
olga-union May 18, 2022
b70d14b
fix: add eventVersion check for map tasks (#484)
olga-union May 19, 2022
7f6305f
fix: resolve minimist package to v1.2.6 (#492)
anrusina May 19, 2022
144349c
ci: add flyte-api plugin package (#490)
anrusina May 19, 2022
64b2793
fix: update/add graph related stories (#493)
olga-union May 23, 2022
7ea0c9f
fix: separate api auth to plugin folder (#495)
anrusina May 25, 2022
4a23f4e
feat: rerun task action in execution page (#488)
eugenejahn May 26, 2022
aaca9db
chore: update release version (#501)
anrusina Jun 2, 2022
d407301
chore(deps-dev): bump protobufjs from 6.8.9 to 6.11.3 (#502)
dependabot[bot] Jun 3, 2022
606e37e
chore: add package generator for basics/composites/plugins (#503)
anrusina Jun 6, 2022
1a0dc0f
fix(bug-508): executions can not be filtered by start time (#509)
anrusina Jun 9, 2022
1013deb
chore(deps-dev): bump semantic-release from 17.2.3 to 19.0.3 (#510)
dependabot[bot] Jun 10, 2022
32686cc
feat: support flyte decks (#504)
james-union Jun 13, 2022
1386b40
feat: navbar navigation dropdown (#511)
anrusina Jun 16, 2022
7606fdf
chore: support internal/external navigsation better (#513)
anrusina Jun 17, 2022
075a1f9
Update Contributing.md (#515)
anrusina Jun 23, 2022
161d7ee
chore: update navigationDropdown usage (#517)
anrusina Jun 23, 2022
32b92b4
chore(deps): bump jsdom from 16.4.0 to 16.7.0 (#516)
dependabot[bot] Jun 23, 2022
c1c386c
feat: launch plans list & detail page #none; (#507)
james-union Jun 27, 2022
54c8ca1
chore: release 1.1.3 (#520)
anrusina Jun 27, 2022
e933f21
fix: cache icon fro map task (#519)
eugenejahn Jun 28, 2022
1be5572
fix: Relaunch form does not persist security context values when chan…
james-union Jun 29, 2022
4006e3b
fix: release process (#529)
yindia Jun 30, 2022
a05e295
fix: fix semantic-release config (#532)
yindia Jul 1, 2022
daf28e6
test: fix time sensitive test (#533)
anrusina Jul 1, 2022
d191445
Rename upgrade idl workflow (#534)
yindia Jul 1, 2022
506b953
fix: support mapped tasks (#494)
james-union Jul 1, 2022
59d5d2a
fix(491): remove favicon package + use favicon.svg by default (#537)
anrusina Jul 1, 2022
7e44dca
Fixed undefined task input types access in NodeExecutionActions (#538)
Jul 6, 2022
f6f8283
feat: support union type for launch plan (#540)
eugenejahn Jul 13, 2022
64440c0
fix: graph has realtime updates as execution progresses (#543)
olga-union Jul 15, 2022
168d383
fix: make sure groups used in graph aren't undefined (#545)
olga-union Jul 19, 2022
7d196cd
Hotfix docker push GHWF (#547)
yindia Jul 20, 2022
e62b43b
fix: Graph Center on initial render (#541)
james-union Jul 20, 2022
28a224e
fix: graph edge overlaps nodes (#542)
james-union Jul 20, 2022
33b1cee
fix: flyteconsole tag in ci pipeline (#550)
yindia Jul 25, 2022
16d70a9
enable docker push for console (#552)
yindia Jul 26, 2022
bcdd464
chore(deps): bump terser from 4.8.0 to 4.8.1 (#548)
dependabot[bot] Jul 26, 2022
3f2bbfb
Update Flyteidl version (#558)
flyte-bot Aug 10, 2022
1f89e2b
fix: fix searchbar X button (#564)
ursucarina Aug 16, 2022
9b10e5f
fix: update timeline view to show dynamic wf internals on first rende…
olga-union Aug 17, 2022
a4bf213
fix: webmanifest missing crossorigin attribute (#566)
ursucarina Aug 17, 2022
cdd94b7
fix: console showing subworkflows as unknown (#570)
olga-union Aug 19, 2022
b6e1e40
fix: Dict value loses 1 trailing character on UI Launch. (#561)
james-union Aug 22, 2022
9c2632a
fix: launchform validation (#557)
james-union Aug 25, 2022
a3bbeb0
fix: integrate timeline and graph tabs wrappers under one component (…
olga-union Aug 31, 2022
e453bfe
chore(deps-dev): bump moment from 2.29.3 to 2.29.4 (#549)
dependabot[bot] Aug 31, 2022
dc1c73f
added none type in union type (#577)
eugenejahn Sep 6, 2022
7e3c6db
fix: correctly coerce `defaultValue` when rendering LaunchPlan detail…
rahul-theorem Sep 6, 2022
f027c43
#minor: inputHelpers InputProps (#579)
ursucarina Sep 7, 2022
afd85bf
fix: fix test of launchform (#581)
james-union Sep 7, 2022
250ab96
Pruning some unused packages (#583)
jsonporter Sep 8, 2022
ce59d55
feat: minor change (#584)
jsonporter Sep 9, 2022
786bced
fix: floor seconds to int in the edge case moment returns it as float…
olga-union Sep 9, 2022
9a1ae4c
Update Flyteidl version (#575)
flyte-bot Sep 12, 2022
a5cad5d
fix: add BASE_URL to dev startup, open deeply nested urls (#589)
ursucarina Sep 13, 2022
6fa1cc1
fix: add default disabled state for only mine filter (#585)
olga-union Sep 14, 2022
64e55be
Update Flyteidl version (#590)
flyte-bot Sep 15, 2022
cc81094
fix: use compiledworkflowclosure in all three tabs for executions view
james-union Sep 26, 2022
ec466c1
fix: executiontabcontent
james-union Sep 27, 2022
b36e312
fix: test for workflowgraph
james-union Sep 27, 2022
abac285
fix: detail panel
james-union Sep 28, 2022
b9eed42
Launch plan ref v2 (#601)
jsonporter Sep 29, 2022
d649546
fix: enable deeplinks in development (#602)
ursucarina Sep 29, 2022
e114250
fix: linter
james-union Sep 30, 2022
9510e35
Merge branch 'master' into james/executions-view
james-union Sep 30, 2022
1e97e47
fix: tests for workflowgraph
james-union Sep 30, 2022
fb43e04
fix: skip tests, package.json file back
james-union Sep 30, 2022
013b504
fix: console flyteidl 1.1.14
james-union Sep 30, 2022
9d8b933
fix: console flyteidl 1.1.14
james-union Sep 30, 2022
1c95233
fix: console flyteidl 1.1.4
james-union Sep 30, 2022
be571b2
Merge branch 'devmain' of https://github.com/flyteorg/flyteconsole in…
olga-union Sep 30, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
21 changes: 0 additions & 21 deletions .babelrc

This file was deleted.

1 change: 1 addition & 0 deletions .eslintrc.js
Original file line number Diff line number Diff line change
Expand Up @@ -85,6 +85,7 @@ module.exports = {
'no-await-in-loop': 'off',
'no-undef-init': 'off',
'no-unneeded-ternary': 'off',
'no-underscore-dangle': 'off',
'prefer-object-spread': 'off',
'prefer-template': 'off',
'default-case': 'off',
Expand Down
43 changes: 29 additions & 14 deletions .github/workflows/checks.yml
Original file line number Diff line number Diff line change
Expand Up @@ -12,14 +12,14 @@ on:
- devmain

jobs:
extraxt_branch:
extract_branch:
runs-on: ubuntu-latest
outputs:
currentTag: ${{ steps.extract_branch.outputs.extract_branch }}
branch: ${{ steps.extract_branch.outputs.branch }}
steps:
- name: Extract branch name
shell: bash
run: echo "##[set-output name=branch;]$(echo ${GITHUB_REF#refs/heads/})"
run: echo "::set-output name=branch::$(echo ${GITHUB_HEAD_REF:-${GITHUB_REF#refs/heads/}})"
id: extract_branch

unit_tests_with_coverage:
Expand Down Expand Up @@ -66,7 +66,7 @@ jobs:
release:
name: Generate Release
if: ${{ (github.event_name != 'pull_request') && (needs.extract_branch.outputs.branch == 'master') }}
needs: [unit_tests_with_coverage, lint_project, build_docker_image, extraxt_branch]
needs: [unit_tests_with_coverage, lint_project, build_docker_image, extract_branch]
runs-on: ubuntu-latest
steps:
- name: Checkout
Expand Down Expand Up @@ -107,17 +107,32 @@ jobs:
# a tag, update our target
run: |
CURRENT_TAG=$(git tag --sort=-refname --points-at ${{ github.ref }} | head -n 1)
echo $CURRENT_TAG
echo "::set-output name=currentTag::$CURRENT_TAG"

push_docker_image:
name: Build & Push Flyteconsole Image
name: Push to Github Registry
needs: [check_for_tag]
uses: flyteorg/flytetools/.github/workflows/publish.yml@master
with:
version: ${{ needs.check_for_tag.outputs.currentTag }}
dockerfile: Dockerfile
push: true
repository: ${{ github.repository }}
secrets:
FLYTE_BOT_PAT: ${{ secrets.FLYTE_BOT_PAT }}
FLYTE_BOT_USERNAME: ${{ secrets.FLYTE_BOT_USERNAME }}
runs-on: ubuntu-latest
if: ${{ needs.check_for_tag.outputs.currentTag != '' }}
steps:
- uses: actions/checkout@v2
with:
fetch-depth: '0'
- name: Autobump version
env:
TAG: ${{ needs.check_for_tag.outputs.currentTag }}
run: |
VERSION=${TAG:1} make update_npmversion
- name: Push Docker Image to Github Registry
uses: whoan/docker-build-with-cache-action@v5
with:
username: "${{ secrets.FLYTE_BOT_USERNAME }}"
password: "${{ secrets.FLYTE_BOT_PAT }}"
image_name: flyteorg/flyteconsole
image_tag: latest,${{ github.sha }},${{ needs.check_for_tag.outputs.currentTag }}
push_git_tag: true
push_image_and_stages: true
dockerfile: Dockerfile
registry: ghcr.io
build_extra_args: "--compress=true"
Original file line number Diff line number Diff line change
Expand Up @@ -10,10 +10,11 @@ on:
options:
- boilerplate
- flyteidl
- flyteconsole
jobs:
trigger-upgrade:
name: ${{ github.event.inputs.component }} Upgrade
if: ${{ github.event.inputs.component == "boilerplate" }}
if: ${{ github.event.inputs.component == 'boilerplate' }}
uses: flyteorg/flytetools/.github/workflows/flyte_automation.yml@master
with:
component: ${{ github.event.inputs.component }}
Expand All @@ -23,7 +24,7 @@ jobs:
upgrade_flyteidl:
name: Upgrade Flyteidl
runs-on: ubuntu-latest
if: ${{ github.event.inputs.component == "boilerplate" }}
if: ${{ github.event.inputs.component == 'flyteidl' }}
steps:
- uses: actions/checkout@v2
with:
Expand All @@ -47,7 +48,7 @@ jobs:
signoff: true
branch: flyte-bot-update-flyteidl
delete-branch: true
title: 'Update Flyteidl version'
title: "Update Flyteidl version"
body: |
Update Flyteidl version
- Auto-generated by [flyte-bot]
Expand All @@ -57,3 +58,4 @@ jobs:
owners
maintainers
draft: false

6 changes: 2 additions & 4 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -40,6 +40,7 @@ app/public/styles/*.css
.idea
.cache/
venv/
*.tsbuildinfo

# Frontend
.awcache/
Expand All @@ -52,7 +53,4 @@ yarn-error.log

# Certs
.srl
script/rootCA.*
script/server.crt
script/server.csr
script/server.key
certificate/
9 changes: 1 addition & 8 deletions .releaserc.json
Original file line number Diff line number Diff line change
Expand Up @@ -9,13 +9,6 @@
}
],
["@semantic-release/npm", { "npmPublish": false }],
"@semantic-release/github",
[
"@semantic-release/git",
{
"assets": ["package.json", "CHANGELOG.md"],
"message": "chore(release): Release ${nextRelease.version} [skip ci]\n\n${nextRelease.notes}"
}
]
"@semantic-release/github"
]
}
10 changes: 5 additions & 5 deletions .storybook/StorybookContainer.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -6,11 +6,11 @@ import { QueryClientProvider } from 'react-query';
import { MemoryRouter } from 'react-router-dom';
import { SnackbarProvider } from 'notistack';

import { ErrorBoundary } from '../src/components/common/ErrorBoundary';
import { createQueryClient } from '../src/components/data/queryCache';
import { muiTheme } from '../src/components/Theme/muiTheme';
import { LocalCacheProvider } from '../src/basics/LocalCache/ContextProvider';
import { FeatureFlagsProvider } from '../src/basics/FeatureFlags';
import { ErrorBoundary } from '../packages/zapp/console/src/components/common/ErrorBoundary';
import { createQueryClient } from '../packages/zapp/console/src/components/data/queryCache';
import { muiTheme } from '../packages/zapp/console/src/components/Theme/muiTheme';
import { LocalCacheProvider } from '../packages/zapp/console/src/basics/LocalCache/ContextProvider';
import { FeatureFlagsProvider } from '../packages/zapp/console/src/basics/FeatureFlags';

const useStyles = makeStyles((theme: Theme) => ({
container: {
Expand Down
14 changes: 12 additions & 2 deletions .storybook/main.js
Original file line number Diff line number Diff line change
@@ -1,16 +1,17 @@
var path = require('path');
module.exports = {
core: {
builder: 'webpack5',
},
stories: ['../src/**/*.stories.mdx', '../src/**/*.stories.@(js|jsx|ts|tsx)'],
stories: ['../packages/**/*.stories.@(js|jsx|ts|tsx|mdx)'],
addons: [
'@storybook/addon-links',
'@storybook/addon-essentials',
'@storybook/addon-interactions',
],
framework: '@storybook/react',
webpackFinal: async (config, { configType }) => {
config.resolve.modules = ['src', 'node_modules'];
config.resolve.modules = ['packages/zapp/console/src', 'node_modules'];
config.module.rules = [
...config.module.rules,
{
Expand All @@ -22,6 +23,15 @@ module.exports = {
use: ['babel-loader', { loader: 'ts-loader', options: { transpileOnly: true } }],
},
];

config.resolve.alias = {
...config.resolve.alias,
'@flyteconsole/locale': path.resolve(__dirname, '../packages/basics/locale/src'),
'@flyteconsole/ui-atoms': path.resolve(__dirname, '../packages/composites/ui-atoms/src'),
'@flyteconsole/components': path.resolve(__dirname, '../packages/plugins/components/src'),
'@flyteconsole/flyte-api': path.resolve(__dirname, '../packages/plugins/flyte-api/src'),
};

return config;
},
};
16 changes: 16 additions & 0 deletions .vscode/launch.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
{
// Use IntelliSense to learn about possible attributes.
// Hover to view descriptions of existing attributes.
// For more information, visit: https://go.microsoft.com/fwlink/?linkid=830387
"version": "0.2.0",
"configurations": [
{
"name": "launch generator",
"type": "node",
"request": "launch",
"skipFiles": ["<node_internals>/**"],
"program": "${workspaceFolder}/script/generator/src/index.js",
"console": "integratedTerminal"
}
]
}
27 changes: 26 additions & 1 deletion CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,30 @@ a single module, you can specify that one specifically
(ex. `localStorage.debug = 'flyte:adminEntity'` to only see decoded Flyte
Admin API requests).

## Generate new package

To add a new package use a script

```bash
yarn generate:package
```

After new package is generated, you will need to update some values to be able to use it with other packages.
For example in case if package plan to be used in `console` app

Ensure to add proper webpack alias path resolutions into:
* ./storybook/main.js - as `'@flyteconsole/flyte-api': path.resolve(__dirname, '../packages/plugins/flyte-api/src’),`
* packages/zapp/console/webpack.common.config.ts to alias section - as `'@flyteconsole/flyte-api': path.resolve(__dirname, '../packages/plugins/flyte-api/src’),`

To add child package usage to other package, in parent package ->
* Add `{ "path": “../../${type}/${package-name}" }` to tsconfig.json
* Add `{ "path": “../../${type}/${package-name}/tsconfig.build.json" }` to tsconfig.build.json (if exists)
- Then you can import your changes as `import { getLoginUrl } from '@flyteconsole/flyte-api’;`

> If you see `yarn lint` package not defined issues update `.\eslintrc.js` by adding your package to
'import/core-modules': ['@clients/locale', '@clients/primitives', '@clients/theme'],


## Storybook

This project has support for [Storybook](https://storybook.js.org/).
Expand Down Expand Up @@ -115,9 +139,10 @@ brew install asdf
brew install vips
```

- Add Yarn plugin to asdf, to manage yarn versions
- Add Yarn and NodeJs plugins to asdf, to manage versions

```bash
asdf plugin add nodejs https://github.com/asdf-vm/asdf-nodejs.git
asdf plugin-add yarn https://github.com/twuni/asdf-yarn.git
brew install gpg
```
Expand Down
10 changes: 6 additions & 4 deletions Dockerfile
Original file line number Diff line number Diff line change
@@ -1,8 +1,9 @@
# Use node:17 to docker build on M1
FROM node:16 as builder
LABEL org.opencontainers.image.source https://github.com/lyft/flyteconsole
LABEL org.opencontainers.image.source https://github.com/flyteorg/flyteconsole

WORKDIR /code/flyteconsole
COPY package*.json yarn.lock ./
COPY ./packages/zapp/console/package*.json yarn.lock ./
RUN : \
# install production dependencies
&& yarn install --production \
Expand All @@ -17,10 +18,11 @@ RUN : \
# build
&& make build_prod \
# place the runtime application in /app
&& mv dist index.js env.js plugins.js /app
&& mv ./packages/zapp/console/dist /app \
&& mv ./packages/zapp/console/index.js ./packages/zapp/console/env.js ./packages/zapp/console/plugins.js /app

FROM gcr.io/distroless/nodejs
LABEL org.opencontainers.image.source https://github.com/lyft/flyteconsole
LABEL org.opencontainers.image.source https://github.com/flyteorg/flyteconsole

COPY --from=builder /app app
WORKDIR /app
Expand Down
7 changes: 7 additions & 0 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -42,3 +42,10 @@ test_unit_codecov:
.PHONY: generate_ssl
generate_ssl:
./script/generate_ssl.sh

PLACEHOLDER_NPM := \"version\": \"0.0.0-develop\"

.PHONY: update_npmversion
update_npmversion:
grep "$(PLACEHOLDER_NPM)" "packages/zapp/console/package.json"
sed -i "s/$(PLACEHOLDER_NPM)/\"version\": \"${VERSION}\"/g" "packages/zapp/console/package.json"
Loading