Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Develop #1169

Merged
merged 4 commits into from
Aug 20, 2022
Merged

Develop #1169

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
9710b1d
build(golang/dockerfile): rm unused tar
ma-pony Aug 18, 2022
412643d
Update Dockerfile
ma-pony Aug 18, 2022
9d2f4a7
Merge pull request #1165 from ma-pony/develop
tikazyq Aug 18, 2022
804797c
fix(demo): fixed importing demo data indefinitely issue https://githu…
tikazyq Aug 20, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion backend/go.mod
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,4 +2,4 @@ module crawlab

go 1.16

require github.com/crawlab-team/crawlab-core v0.6.1-0.20220807014734-91a703d8f762
require github.com/crawlab-team/crawlab-core v0.6.1-0.20220820024533-b8336f87f24d
3 changes: 3 additions & 0 deletions backend/go.sum
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -130,12 +130,15 @@ github.com/crawlab-team/crawlab-core v0.6.1-0.20220718062618-6925d9af1673 h1:N9T
github.com/crawlab-team/crawlab-core v0.6.1-0.20220718062618-6925d9af1673/go.mod h1:7kvjKE9gnduqvoRHZV7GXSlR1nM7iO/GJy50ERfW8k4=
github.com/crawlab-team/crawlab-core v0.6.1-0.20220807014734-91a703d8f762 h1:YS1BmYDhLXrW3efTAvcNr1+a2LJmOBB9QAjQz/6AbOo=
github.com/crawlab-team/crawlab-core v0.6.1-0.20220807014734-91a703d8f762/go.mod h1:Bah0/ekMg47cYwtleRBS6UUfIOZYN6+GXZLkyPqMN0E=
github.com/crawlab-team/crawlab-core v0.6.1-0.20220820024533-b8336f87f24d h1:C2mwAnXCY93Osc+s8rtPsOSOjVRGmspUQmorUamYrAE=
github.com/crawlab-team/crawlab-core v0.6.1-0.20220820024533-b8336f87f24d/go.mod h1:KtjBPYGOaVEzLL3Jtf0nNCrmhgndFhXi4Xj6eyU8ptA=
github.com/crawlab-team/crawlab-db v0.0.2/go.mod h1:o7o4rbcyAWlFGHg9VS7V7tM/GqRq+N2mnAXO71cZA78=
github.com/crawlab-team/crawlab-db v0.6.0-1 h1:Is3a3q1epc7mFP4iDIr9nXlcHSW5IL6jXKQ3YEsXpVo=
github.com/crawlab-team/crawlab-db v0.6.0-1/go.mod h1:gfeF0nAnFuup6iYvgHkY0in/HpO/+JktXqVNMdhoxhU=
github.com/crawlab-team/crawlab-fs v0.0.0/go.mod h1:k2VXprQspLAmbgO5sSpqMjg/xP4iKDkW4RyTWY8eTZM=
github.com/crawlab-team/crawlab-fs v0.6.0-beta.20211101.1940 h1:KFZ39oe/QyhhRhXYZSmzDZl3L/JUEPkiiaf4+/iuboY=
github.com/crawlab-team/crawlab-fs v0.6.0-beta.20211101.1940/go.mod h1:dA1G6xeiClbTMkjRuoagGrcKfQ97jJZRAhZUSwrKdoI=
github.com/crawlab-team/crawlab-fs v0.6.0-beta.20211101.1940.0.20220818064917-625d96eea842/go.mod h1:dA1G6xeiClbTMkjRuoagGrcKfQ97jJZRAhZUSwrKdoI=
github.com/crawlab-team/crawlab-grpc v0.6.0-beta.20211219.1930 h1:THQ+k+LgCO0Tyw0wDTnTekqnyGhJdsbg3IAhtyqdBlU=
github.com/crawlab-team/crawlab-grpc v0.6.0-beta.20211219.1930/go.mod h1:YHWntJs8VVIgYqtrq/mMfYpO8DNhnEzizP0apw9NQ8Y=
github.com/crawlab-team/crawlab-log v0.1.0 h1:0t+lZEojs3Vqb/bMkk2qs3I+1+XdwKG3pMTfeK5PZWM=
Expand Down
6 changes: 4 additions & 2 deletions workspace/dockerfiles/golang/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,12 +25,14 @@ RUN apt-get install -y python3 python3-pip \
# install golang
RUN curl -OL https://storage.googleapis.com/golang/go1.16.7.linux-amd64.tar.gz \
&& tar -C /usr/local -xvf go1.16.7.linux-amd64.tar.gz \
&& ln -s /usr/local/go/bin/go /usr/local/bin/go
&& ln -s /usr/local/go/bin/go /usr/local/bin/go \
&& rm go1.16.7.linux-amd64.tar.gz

# install seaweedfs
RUN wget https://github.com/chrislusf/seaweedfs/releases/download/2.76/linux_amd64.tar.gz \
&& tar -zxf linux_amd64.tar.gz \
&& cp weed /usr/local/bin
&& cp weed /usr/local/bin \
&& rm linux_amd64.tar.gz

# install backend
RUN pip install scrapy pymongo bs4 requests -i https://mirrors.aliyun.com/pypi/simple
Expand Down