[feat] Dropout partial bw fusion (second take)#164

Merged

blefaudeux merged 7 commits intomainfrom dropout_bw_fusion

Jan 3, 2022

+334-150

Commits on Dec 23, 2021

Commits on Dec 26, 2021

WIP better scheduling, improving perfs all around
blefaudeux
committed

Commits on Dec 27, 2021

larger tiles and better speed, full loss curve checked
blefaudeux
committed

Commits on Jan 3, 2022

code review, not all factorization options were possible in the end, Triton jit can be a little picky
blefaudeux
committed
tweaking formulations so that they please Triton. Slightly faster dropmask generation
blefaudeux
committed
small cleanup, removing old files and fixing broken links
blefaudeux
committed