Viewing a single comment thread. View all comments

Czl2 t1_j4zqan4 wrote

Ask model to summarize whatever is about to be cut off as you slide the token window and replace what is lost with that summary? In this way your token window always has a summarized version of what is missing attached?

8