Skip to content

SLotAbr/Decoder_model

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

24 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Decoder_model

Decoder model for language modelling.

This repository serves educational purposes only. Here I try to recreate a decoder-only model of the transformer architecture from scratch. It includes a model itself as well as training mechanisms

About

Decoder model for language modelling

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages