[D] Inner workings of the chatgpt memory Submitted by terserterseness t3_10fxryj on January 19, 2023 at 9:48 AM in MachineLearning 21 comments 35
Czl2 t1_j4zqan4 wrote on January 19, 2023 at 11:48 AM Ask model to summarize whatever is about to be cut off as you slide the token window and replace what is lost with that summary? In this way your token window always has a summarized version of what is missing attached? Permalink 8
Viewing a single comment thread. View all comments