Skip to content
This repository has been archived by the owner on Oct 31, 2023. It is now read-only.

Support mini batch in training #190

Merged
merged 5 commits into from
Nov 6, 2018
Merged

Support mini batch in training #190

merged 5 commits into from
Nov 6, 2018

Conversation

ledw
Copy link
Contributor

@ledw ledw commented Oct 19, 2018

As in title. For a given mini batch, it will use the same set of negatives to do updates.
Experiments on a bunch of different tasks shows that this gives a 2-3x speed up depending on task and achieves the same accuracy.

Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

Blame Revision:
Copy link
Contributor

@jaseweston jaseweston left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

MOST awesome!
do you have plots of batchSize vs. speed and perf?

@ledw ledw merged commit 8790244 into master Nov 6, 2018
dna2github pushed a commit to dna2fork/StarSpace that referenced this pull request Jul 19, 2019
* batch negs

Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

Blame Revision:

* fix
alexanderkjeldaas pushed a commit to alexanderkjeldaas/StarSpace that referenced this pull request Mar 2, 2020
* batch negs

Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

Blame Revision:

* fix
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants