Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reformat of the Server code #1042

Closed
wants to merge 13 commits into from
Closed

Reformat of the Server code #1042

wants to merge 13 commits into from

Conversation

Eugene-hu
Copy link
Contributor

@Eugene-hu Eugene-hu commented Jan 4, 2023

The server now follows the same format as the core validator and is a single class.

List of changes:

  • Removed run.py from the core_server and moved it into the main class
  • All functions are now part of the core_server.neuron class
  • Removed the default backwards from axon, now instead expects user to the attach their own backward function
  • Added additional documentation

@Eugene-hu Eugene-hu changed the base branch from master to nobunaga January 4, 2023 20:39
Copy link
Contributor

@isabella618033 isabella618033 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@@ -428,6 +426,7 @@ def encode_forward_causallmnext(self, token_batch, std_tokenizer=None, topk: int
"""
transformers.set_seed(0)
transformers.enable_full_determinism(0)
print('forward called checkpoint')
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this a debug logging or just temporary?

@Eugene-hu Eugene-hu closed this Feb 2, 2023
@ifrit98 ifrit98 deleted the server_reformat branch May 24, 2023 14:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants