Add extrapolation experiment slurm scripts - #38

Open

SaulLu wants to merge 14 commits into

LS/extrapolation_law

Commits on Mar 28, 2022

add template extrapolation
SaulLu
committed
601185a
save changes
SaulLu
committed
59f9867
woups
SaulLu
committed
260a601

Commits on Mar 29, 2022

add tests
SaulLu
committed
d080ed1

Commits on Apr 13, 2022

add extrapolation law checkpoint 117k alibi
SaulLu
committed
6002b7e
copy training script
SaulLu
committed
c14c1f5
adapt paths and slurm config
SaulLu
committed
8dbc378
change eval
SaulLu
committed
cd41b7a
indentation
SaulLu
committed
6b8a26f
last adaptation
SaulLu
committed
4b40871
rotary need max-position-embeddings args set to none
SaulLu
committed
734afb9
typo
SaulLu
committed
e938721
try
SaulLu
committed
a2acc4b

Commits on Apr 14, 2022

fix
SaulLu
committed
de62cfe