[Issue]: Is there any example of SSE for streaming?

[yidasanqian]

Describe the issue

Using FastAPI or Flask?

Steps to reproduce

No response

Screenshots and logs

No response

Additional Information

No response

[LittleLittleCloud]

python/non-python? server-side/client side?

[yidasanqian]

python/non-python? server-side/client side?

Python, server-side

[LittleLittleCloud]

@yidasanqian I currently only have dotnet/server example for SSE endpoint. The gist is to set response header as text/event-stream and return the data with sse-event format

event:
your-event-nae
data:
your-data...

https://github.com/LittleLittleCloud/Agent-ChatRoom/blob/b639c7b5e0781ada4ea5d413d1c840534d2971a9/ChatRoom/ChatRoom.Common/Controller/ChatRoomClientController.cs#L241.

I also find an example for sse server-side implementation using fast-api, which you can find out that the header is also set to text/event-stream and the data format is also data:..... Hope this can help a little bit.

https://medium.com/@nandagopal05/server-sent-events-with-python-fastapi-f1960e0c8e4b

[yidasanqian]

@LittleLittleCloud I have two agents, how can I stream the conversation between them through FastAPI?

assistant = AssistantAgent(
    name="assistant",
    system_message=DEFAULT_SYSTEM_MESSAGE,
    llm_config=llm_config
)

user_agent = UserProxyAgent(
    name="user_agent",
    human_input_mode="NEVER",
    max_consecutive_auto_reply=10,
    is_termination_msg=lambda x: x.get("content", "").rstrip().endswith("TERMINATE"),
    code_execution_config={"executor": code_executor}
)

chat_res = user_agent.initiate_chat(
        recipient=assistant,
        message=message,
        summary_method="last_msg"
      )