Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] 会遇到触发finish_reason为stop的情况。 #4893

Open
LeXwDeX opened this issue Jun 27, 2024 · 1 comment
Open

[Bug] 会遇到触发finish_reason为stop的情况。 #4893

LeXwDeX opened this issue Jun 27, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@LeXwDeX
Copy link

LeXwDeX commented Jun 27, 2024

Bug Description

当SSE推送消息的时候,收到这种消息会触发stop导致模型停止输出。

image

data: {"id":"chatcmpl-9eecNoubJGBMDtO7YnhA3hIa9fxzK","object":"chat.completion.chunk","created":1719476283,"model":"gpt-4o-2024-05-13","system_fingerprint":"fp_abc28019ad","choices":[{"index":0,"delta":{"content":" ="},"logprobs":null,"finish_reason":null}]}

data: {"id":"chatcmpl-9eecNoubJGBMDtO7YnhA3hIa9fxzK","object":"chat.completion.chunk","created":1719476283,"model":"gpt-4o-2024-05-13","system_fingerprint":"fp_abc28019ad","choices":[{"index":0,"delta":{"content":" tokenizer"},"logprobs":null,"finish_reason":null}]}

data: {"id":"chatcmpl-9eecNoubJGBMDtO7YnhA3hIa9fxzK","object":"chat.completion.chunk","created":1719476283,"model":"gpt-4o-2024-05-13","system_fingerprint":"fp_abc28019ad","choices":[{"index":0,"delta":{"content":"(f"},"logprobs":null,"finish_reason":null}]}

data: {"id":"chatcmpl-9eecNoubJGBMDtO7YnhA3hIa9fxzK","object":"chat.completion.chunk","created":1719476283,"model":"gpt-4o-2024-05-13","system_fingerprint":"fp_abc28019ad","choices":[{"index":0,"delta":{"content":"\""},"logprobs":null,"finish_reason":null}]}

data: {"id":"chatcmpl-9eecNoubJGBMDtO7YnhA3hIa9fxzK","object":"chat.completion.chunk","created":1719476283,"model":"gpt-4o-2024-05-13","system_fingerprint":"fp_abc28019ad","choices":[{"index":0,"delta":{},"logprobs":null,"finish_reason":"stop"}]}

data: [DONE]

遇到一个奇怪的地方,这里会触发"finish_reason":"stop"

@LeXwDeX LeXwDeX added the bug Something isn't working label Jun 27, 2024
@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


Title: [Bug] You will encounter a situation where finish_reason is stop.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants