fkodom / yet-another-retnet Goto Github PK
View Code? Open in Web Editor NEWA simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (https://arxiv.org/pdf/2307.08621.pdf)
License: MIT License