Viewing a single comment thread. View all comments

zoontechnicon t1_j69b6g5 wrote on January 28, 2023 at 5:56 PM

The solution, as evidenced by code in huggingface/transformers is to force the probability of the end token to -Inf. What a hack...