SC.

Project · open source

RetNet: Hugging Face-Compatible Retentive Networks

A Hugging Face-compatible RetNet implementation with parallel, recurrent, and chunkwise execution.

View source All projects

RetNet

A Hugging Face-compatible implementation of Retentive Networks (RetNet), supporting parallel, recurrent, and chunkwise forward passes. It integrates with the Transformers ecosystem for training and generation.