Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bad response from RPCNodeException hangs the server #48

Closed
agates opened this issue Jun 18, 2022 · 0 comments
Closed

Bad response from RPCNodeException hangs the server #48

agates opened this issue Jun 18, 2022 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@agates
Copy link
Collaborator

agates commented Jun 18, 2022

Brian noticed some of the RPCNodeException exceptions after attempting to write a Hive transaction are resulting in bad malformed error responses:

  File "/home/podping/app/src/podping_hivewriter/podping_hivewriter.py", line 232, in _iri_batch_handler_loop
    iri_batch.iri_set, medium=self.medium, reason=self.reason
  File "/home/podping/app/src/podping_hivewriter/podping_hivewriter.py", line 489, in failure_retry
    if ex.raw_body["error"]["data"]["name"] == "tx_missing_posting_auth":
KeyError: 'name'
@agates agates added the bug Something isn't working label Jun 18, 2022
@agates agates self-assigned this Jun 18, 2022
agates added a commit that referenced this issue Jun 18, 2022
@agates agates closed this as completed Jun 18, 2022
agates added a commit that referenced this issue Oct 15, 2022
* Re-add testnet API to Hive client (#57)

* Update defaults to match current values

Defaults now match those held by @podping account on Hive as of 2022-08-26

* Fixes #54

Allow `hive_operation_period` to be set by ENV on startup and ignore overrides from control account
Fixes #54

* testing and preparing for HF26

Signed-off-by: Brian of London <[email protected]>

* fix warning for depreciated poetry option

Signed-off-by: Brian of London <[email protected]>

* linting

Signed-off-by: Brian of London <[email protected]>

* hard coded test against a testnet if one exists

Signed-off-by: Brian of London <[email protected]>

* bump version to 1.2.7

Signed-off-by: Brian of London <[email protected]>

* poetry updates

Signed-off-by: Brian of London <[email protected]>

* fix for stupidity reading envs

Signed-off-by: Brian of London <[email protected]>

* improve error handling in logging

Signed-off-by: Brian of London <[email protected]>

* fix test #51

Signed-off-by: Brian of London <[email protected]>

* update test_name in test #56

Signed-off-by: Brian of London <[email protected]>

* poetry updates

Signed-off-by: Brian of London <[email protected]>

Signed-off-by: Brian of London <[email protected]>

* Update CLI docs

* Lighthive/zmq/tooling updates

* Use new lighthive load balancing/node selection

* Fix missing property on Config

* Fix tests, refactor error handling/logging, catch more API node failures

* More specific error handling in listen_for_custom_json_operations

* Handle RC depletion

Changes to handle RC depletion by retrying.

Separate to this software, Brianoflondon will be running a service which gives RC delegations to any podping sending account.

This should be fast enough to fix RC depletion so the correct response from HiveWriter will be to re-try.

* Bump version

Signed-off-by: Brian of London <[email protected]>

* Limit nodes to exclude pharesim and others.

Signed-off-by: Brian of London <[email protected]>

* Removed https://hived.emre.sh/

Signed-off-by: Brian of London <[email protected]>

* Catch and handle RC Depletion

This introduces a sleep timer which gives time for the RC delegation script to delegate more RCs to the server.

* Catch RC exhaustion

Uses secrets for random wait time with exponential back off.

* Test for NotEnoughResourceCredits error

* lint

Signed-off-by: Brian of London <[email protected]>

* version back to 1.2.7

Signed-off-by: Brian of London <[email protected]>

* Remove random time in wait for RC Delegation

Signed-off-by: Brian of London <[email protected]>

* Unit test for not enough RCs

Signed-off-by: Brian of London <[email protected]>

* Fix issue caused by git merge

Signed-off-by: Brian of London <[email protected]>

* remove failing resource checks on startup

Signed-off-by: Brian of London <[email protected]>

* Add send_notification_iris to #48 regression tests

* Make startup error handling more clear, construct_operation non-async

* Catch TooManyCustomJsonsPerBlock for backoff

* Separate exception catch for TooManyCustomJsonsPerBlock, sleep one block

Signed-off-by: Brian of London <[email protected]>
Co-authored-by: Alecks Gates <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant