Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dgraph-live-loader is slow when starting two dgraphzero nodes and one dgraph node #1571

Closed
pawanrawal opened this issue Oct 3, 2017 · 2 comments
Assignees
Labels
kind/bug Something is broken.
Milestone

Comments

@pawanrawal
Copy link
Contributor

pawanrawal commented Oct 3, 2017

Start two dgraphzero nodes and a dgraph instance.

./dgraphzero --id 1
./dgraphzero -id 2 -peer 127.0.0.1:8888 -w w2 -port 8890
./dgraph -memory_mb 10000 -peer 127.0.0.1:8888

Try to load 21 million data with schema

➜  dgraph-live-loader git:(master) ✗ ./dgraph-live-loader -r ../../../benchmarks/data/21million.rdf.gz -s ../../../benchmarks/data/21million.schema

Processing ../../../benchmarks/data/21million.schema

Processing ../../../benchmarks/data/21million.rdf.gz
[Request:      9] Total RDFs done:     9000 RDFs per second:     161 Time Elapsed: 56s 

The starting rate is very low and it keeps on going down. This doesn't happen when only one dgraphzero node is running.

@pawanrawal pawanrawal added the kind/bug Something is broken. label Oct 3, 2017
@pawanrawal pawanrawal added this to the v0.8.3 milestone Oct 3, 2017
@manishrjain
Copy link
Contributor

manishrjain commented Oct 3, 2017

Is this because of Raft?

@pawanrawal: Assigned this to @janardhan1993. Reassign it to yourself, if you're already working on this.

@janardhan1993
Copy link
Contributor

Leader changes in zero were not getting updated in state. AssignUids from client was going to wrong server(it was not the leader). zero was throwing error since it was not the leader and client got stuck.

janardhan1993 pushed a commit that referenced this issue Oct 4, 2017
* propose zero leader changes to state
@manishrjain manishrjain added the kind/bug Something is broken. label Mar 21, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Something is broken.
Development

No branches or pull requests

3 participants