Found 1 document(s)
Page 1 of 1
-
Looped language models run each token through the same layers several times, and each run is one iteration. To save compute, an extra layer, the halting head, gives after each iteration the probability that the token sto...