
Arnaud Pannatier
@ArnaudPannatier • 1,104 subscribers
PhD Student @francoisfleuret 's Machine Learning Group Idiap Research Institute - @Idiap_ch EDIC EPFL - @EPFL_en
Videos

GPTs are generating sequences in a left-to-right order. Is there another way? With François Fleuret and @evanncourdier, in partnership with SkySoft-ATM, we developed σ-GPT, capable of generating sequences in any order chosen dynamically at inference time. 1/6
Arnaud Pannatier379,912 Aufrufe • vor 2 Jahren

The code for σ-GPT is out! Feel free to experiment with it here: It extends the François Fleuret picoclvr (non-nlp tasks) and Andrej Karpathy nanoGPT (text) codebases, with an additional KV-Cache from IRIS by Vincent Micheli and Eloi Alonso. (links below)
Arnaud Pannatier12,600 Aufrufe • vor 2 Jahren
Keine weiteren Inhalte verfügbar