How to get the probability of a token generated from generate()? #1766
-
I am trying to use self._scores[-1, token] but it is giving every token as zero. Also, why?
Is it impossible to get the probs of the last prediction? |
Beta Was this translation helpful? Give feedback.
Answered by
qnixsynapse
Sep 26, 2024
Replies: 1 comment
-
Update: I found it. It's self._ctx.get_logits() |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
qnixsynapse
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Update: I found it. It's self._ctx.get_logits()