This is the repo for the MixKABRN Neural Network (Mixture of Kolmogorov-Arnold Bit Retentive Networks), and an attempt at first adapting it for training on text, and later adjust it for other modalities.

An implementation of "Retentive Network: A Successor to Transformer for Large Language Models"

3D LiDAR Semantic Segmentation with range images and Retentive Networks