Looking at the code here, I do not see the synthetic gradients module. dni_linear

Hi <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="

Thanks for clearing this up, Andrew! <span class="email-hidden-tog

Does this really work??? about dni.pytorch HOT 3 CLOSED

garymcintire commented on July 29, 2024

Does this really work???

from dni.pytorch.

Comments (3)

andrewliao11 commented on July 29, 2024

Hi @garymcintire ,
In fact, my dni_linear is the synthetic gradient module. The main network will be updated based on the output of the dni_linear, instead of back-propagation signal from loss function.
please see L37 in train.py.

from dni.pytorch.

andrewliao11 commented on July 29, 2024

I'll first close this issue.
feel free to reopen it if there are other questions

from dni.pytorch.

garymcintire commented on July 29, 2024

Thanks for clearing this up, Andrew!

…

-----Original Message----- From: Andrew [mailto:[email protected]] Sent: Thursday, July 20, 2017 3:37 AM To: andrewliao11/dni.pytorch Cc: garymcintire; Mention Subject: Re: [andrewliao11/dni.pytorch] Does this really work??? (#4) Closed #4 <#4> . — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#4 (comment)> , or mute the thread <https://github.com/notifications/unsubscribe-auth/AE_8eHCBxmNVTPdI3MsTZVBtqrIORtawks5sPxGZgaJpZM4OdW30> . <https://github.com/notifications/beacon/AE_8eDKP064nb8gGpXvBerA1dXzVl5Cmks5sPxGZgaJpZM4OdW30.gif>

from dni.pytorch.

Related Issues (6)

Recommend Projects