Fantastic tool - have a question re: Assistants. #11
Answered
by
allanbunch
Hyperlooper
asked this question in
Q&A
-
|
First off let me say this set of nodes is great. I have been wanting to play with LLM's in a low code environment for a while, and this is just fantastic. I am struggling a bit on how to put together a flow that would let me chat with an existing OpenAI assistant that I've created via OpenAI's web-based interface. I have read through the API docs but since I am not really a programmer, I am struggling with how to set up the thread and actually submit a query and get a reply. I wonder if this might be a useful example flow to include with the project? Since Assistants can be created via the OpenAI web interface, having an example of how to actually chat with them via NodeRed would be very instructive for folks with less of a programming background. |
Beta Was this translation helpful? Give feedback.
Answered by
allanbunch
Dec 15, 2023
Replies: 1 comment 9 replies
-
|
Great to hear that you're finding this project useful. And thanks for the Assistants nudge. |
Beta Was this translation helpful? Give feedback.
9 replies
-
|
@Hyperlooper - Here's a basic example showcasing an Assistant conversation without using Function (JavaScript) nodes. To get started, you'll need to import this flow into your Node-RED environment, drop your Assistant's name into the This flow can be streamlined with the use of a couple of Function nodes; I plan to share a second flow demonstrating just that. Cheers! [
{
"id": "98bb4e379ccf9199",
"type": "tab",
"label": "Basic Aassistant Demo",
"disabled": false,
"info": "",
"env": []
},
{
"id": "5913e8c93fe899c1",
"type": "group",
"z": "98bb4e379ccf9199",
"style": {
"stroke": "#999999",
"stroke-opacity": "1",
"fill": "none",
"fill-opacity": "1",
"label": true,
"label-position": "nw",
"color": "#a4a4a4"
},
"nodes": [
"99ae56d003d0ef7d",
"29cdc0890289d709",
"50937e1b47d612a7",
"39d437b60ac2373f",
"c4c940b15f441b48"
],
"x": 374,
"y": 79,
"w": 272,
"h": 242
},
{
"id": "c4c940b15f441b48",
"type": "OpenAI API",
"z": "98bb4e379ccf9199",
"g": "5913e8c93fe899c1",
"name": "List Assistants",
"service": "6bf3be50f1f3a262",
"method": "listAssistants",
"x": 540,
"y": 120,
"wires": [
[
"50937e1b47d612a7"
]
],
"outputLabels": [
"Assistant Objects"
]
},
{
"id": "b1d9ab0a2c2b3ac4",
"type": "inject",
"z": "98bb4e379ccf9199",
"name": "1. Start New Conversation",
"props": [
{
"p": "assistant.name",
"v": "Node-RED Basic Assistant",
"vt": "str"
},
{
"p": "assistant.thread",
"v": "{\"messages\":[{\"role\":\"user\",\"content\":\"Hi! I'm considering using Node-RED for advanced generative AI workflows. How about we collaborate to uncover a few novel use cases.\"}]}",
"vt": "json"
}
],
"repeat": "",
"crontab": "",
"once": false,
"onceDelay": 0.1,
"topic": "",
"x": 250,
"y": 120,
"wires": [
[
"c4c940b15f441b48"
]
]
},
{
"id": "7d045ace87d9255e",
"type": "debug",
"z": "98bb4e379ccf9199",
"name": "Assistant Response",
"active": true,
"tosidebar": true,
"console": false,
"tostatus": false,
"complete": "payload.data[0].content[0].text.value",
"targetType": "msg",
"statusVal": "",
"statusType": "auto",
"x": 1320,
"y": 560,
"wires": []
},
{
"id": "4cd408fd47398f03",
"type": "OpenAI API",
"z": "98bb4e379ccf9199",
"name": "Create Thread & Run",
"service": "6bf3be50f1f3a262",
"method": "createThreadAndRun",
"x": 500,
"y": 380,
"wires": [
[
"69dc3f70d59ad3f0"
]
]
},
{
"id": "99ae56d003d0ef7d",
"type": "switch",
"z": "98bb4e379ccf9199",
"g": "5913e8c93fe899c1",
"name": "Filter Assistants",
"property": "payload.name",
"propertyType": "msg",
"rules": [
{
"t": "eq",
"v": "assistant.name",
"vt": "msg"
}
],
"checkall": "true",
"repair": false,
"outputs": 1,
"x": 540,
"y": 240,
"wires": [
[
"39d437b60ac2373f"
]
]
},
{
"id": "29cdc0890289d709",
"type": "split",
"z": "98bb4e379ccf9199",
"g": "5913e8c93fe899c1",
"name": "Split Assistants",
"splt": "\\n",
"spltType": "str",
"arraySplt": 1,
"arraySpltType": "len",
"stream": false,
"addname": "",
"x": 540,
"y": 200,
"wires": [
[
"99ae56d003d0ef7d"
]
]
},
{
"id": "50937e1b47d612a7",
"type": "change",
"z": "98bb4e379ccf9199",
"g": "5913e8c93fe899c1",
"name": "Extract Assistants",
"rules": [
{
"t": "move",
"p": "payload.data",
"pt": "msg",
"to": "payload",
"tot": "msg"
}
],
"action": "",
"property": "",
"from": "",
"to": "",
"reg": false,
"x": 530,
"y": 160,
"wires": [
[
"29cdc0890289d709"
]
]
},
{
"id": "39d437b60ac2373f",
"type": "change",
"z": "98bb4e379ccf9199",
"g": "5913e8c93fe899c1",
"name": "Extract Assistant Details",
"rules": [
{
"t": "move",
"p": "payload",
"pt": "msg",
"to": "_tmp",
"tot": "msg"
},
{
"t": "set",
"p": "payload",
"pt": "msg",
"to": "{}",
"tot": "json"
},
{
"t": "set",
"p": "payload.assistant_id",
"pt": "msg",
"to": "_tmp.id",
"tot": "msg"
},
{
"t": "move",
"p": "assistant.thread",
"pt": "msg",
"to": "payload.thread",
"tot": "msg"
},
{
"t": "delete",
"p": "_tmp",
"pt": "msg"
}
],
"action": "",
"property": "",
"from": "",
"to": "",
"reg": false,
"x": 510,
"y": 280,
"wires": [
[
"4cd408fd47398f03"
]
]
},
{
"id": "617d830a9aff083d",
"type": "OpenAI API",
"z": "98bb4e379ccf9199",
"name": "Retrieve Run",
"service": "6bf3be50f1f3a262",
"method": "getRun",
"x": 950,
"y": 380,
"wires": [
[
"c01328d99c2a06a9"
]
]
},
{
"id": "69dc3f70d59ad3f0",
"type": "change",
"z": "98bb4e379ccf9199",
"name": "Extract Run Info",
"rules": [
{
"t": "move",
"p": "payload",
"pt": "msg",
"to": "_tmp",
"tot": "msg"
},
{
"t": "set",
"p": "payload",
"pt": "msg",
"to": "{}",
"tot": "json"
},
{
"t": "set",
"p": "payload.thread_id",
"pt": "msg",
"to": "_tmp.thread_id",
"tot": "msg"
},
{
"t": "set",
"p": "payload.run_id",
"pt": "msg",
"to": "_tmp.id",
"tot": "msg"
},
{
"t": "delete",
"p": "_tmp",
"pt": "msg"
}
],
"action": "",
"property": "",
"from": "",
"to": "",
"reg": false,
"x": 760,
"y": 380,
"wires": [
[
"617d830a9aff083d"
]
]
},
{
"id": "c01328d99c2a06a9",
"type": "switch",
"z": "98bb4e379ccf9199",
"name": "Run Status Loop",
"property": "payload.status",
"propertyType": "msg",
"rules": [
{
"t": "eq",
"v": "queued",
"vt": "str"
},
{
"t": "eq",
"v": "completed",
"vt": "str"
},
{
"t": "eq",
"v": "in_progress",
"vt": "str"
},
{
"t": "else"
}
],
"checkall": "true",
"repair": false,
"outputs": 4,
"x": 770,
"y": 500,
"wires": [
[
"69dc3f70d59ad3f0"
],
[
"f65c5250dc0efc66"
],
[
"69dc3f70d59ad3f0"
],
[
"321069b5da602198"
]
],
"inputLabels": [
"Run Details"
],
"outputLabels": [
"Run Queued",
"Run Complete",
"Run In Progress",
"Run Exception"
]
},
{
"id": "24c305df85a1f5a7",
"type": "OpenAI API",
"z": "98bb4e379ccf9199",
"name": "List Messages",
"service": "6bf3be50f1f3a262",
"method": "listMessages",
"x": 1100,
"y": 520,
"wires": [
[
"cd68bee3cc1eb2ad"
]
]
},
{
"id": "f65c5250dc0efc66",
"type": "change",
"z": "98bb4e379ccf9199",
"name": "Extract Thread Id",
"rules": [
{
"t": "move",
"p": "payload",
"pt": "msg",
"to": "_tmp",
"tot": "msg"
},
{
"t": "set",
"p": "payload",
"pt": "msg",
"to": "{}",
"tot": "json"
},
{
"t": "set",
"p": "payload.thread_id",
"pt": "msg",
"to": "_tmp.thread_id",
"tot": "msg"
},
{
"t": "delete",
"p": "_tmp",
"pt": "msg"
}
],
"action": "",
"property": "",
"from": "",
"to": "",
"reg": false,
"x": 1090,
"y": 480,
"wires": [
[
"24c305df85a1f5a7"
]
]
},
{
"id": "321069b5da602198",
"type": "debug",
"z": "98bb4e379ccf9199",
"name": "Run Exception",
"active": true,
"tosidebar": true,
"console": false,
"tostatus": false,
"complete": "payload",
"targetType": "msg",
"statusVal": "",
"statusType": "auto",
"x": 760,
"y": 560,
"wires": [],
"inputLabels": [
"Run Exception"
],
"icon": "font-awesome/fa-exclamation-triangle"
},
{
"id": "6874f82df303ef48",
"type": "comment",
"z": "98bb4e379ccf9199",
"name": "New Conversation node instructions...",
"info": "## Start New Conversation Inject Node\n1. Set `msg.assistant.name` to the name of your existing assistant.\n2. Set `msg.assistant.thread.messages` to an array of valid thread messages.",
"x": 210,
"y": 80,
"wires": [],
"icon": "font-awesome/fa-book"
},
{
"id": "34095d6bbaf305e4",
"type": "inject",
"z": "98bb4e379ccf9199",
"name": "2. Continue Conversation",
"props": [
{
"p": "payload.thread_id",
"v": "payload.thread_id",
"vt": "flow"
},
{
"p": "payload.role",
"v": "user",
"vt": "str"
},
{
"p": "payload.content",
"v": "Fantastic! I don't yet have specifics in mind, so the sky's the limit! 🚀",
"vt": "str"
}
],
"repeat": "",
"crontab": "",
"once": false,
"onceDelay": 0.1,
"topic": "",
"x": 250,
"y": 480,
"wires": [
[
"c4e4aa90fb7b8285"
]
]
},
{
"id": "c6a2f674f70ea03f",
"type": "comment",
"z": "98bb4e379ccf9199",
"name": "Continue Conversation node instructions...",
"info": "## Continue Conversation Inject Node\n1. Set `msg.payload.content` whatever you'd like to say in response to the assistant's last message.",
"x": 200,
"y": 440,
"wires": [],
"icon": "font-awesome/fa-book"
},
{
"id": "c4e4aa90fb7b8285",
"type": "OpenAI API",
"z": "98bb4e379ccf9199",
"name": "Create Message",
"service": "6bf3be50f1f3a262",
"method": "createMessage",
"x": 520,
"y": 480,
"wires": [
[
"0320324ca040d99c"
]
]
},
{
"id": "cd68bee3cc1eb2ad",
"type": "change",
"z": "98bb4e379ccf9199",
"name": "Store Conversation Details",
"rules": [
{
"t": "set",
"p": "payload.thread_id",
"pt": "flow",
"to": "payload.data[0].thread_id",
"tot": "msg"
},
{
"t": "set",
"p": "payload.assistant_id",
"pt": "flow",
"to": "payload.data[0].assistant_id",
"tot": "msg"
}
],
"action": "",
"property": "",
"from": "",
"to": "",
"reg": false,
"x": 1060,
"y": 560,
"wires": [
[
"7d045ace87d9255e"
]
]
},
{
"id": "f2b419ee4c649021",
"type": "OpenAI API",
"z": "98bb4e379ccf9199",
"name": "Create Run",
"service": "6bf3be50f1f3a262",
"method": "createRun",
"x": 530,
"y": 540,
"wires": [
[
"c01328d99c2a06a9"
]
]
},
{
"id": "0320324ca040d99c",
"type": "change",
"z": "98bb4e379ccf9199",
"name": "Create Run Payload",
"rules": [
{
"t": "set",
"p": "payload",
"pt": "msg",
"to": "{}",
"tot": "json"
},
{
"t": "set",
"p": "payload.thread_id",
"pt": "msg",
"to": "payload.thread_id",
"tot": "flow"
},
{
"t": "set",
"p": "payload.assistant_id",
"pt": "msg",
"to": "payload.assistant_id",
"tot": "flow"
}
],
"action": "",
"property": "",
"from": "",
"to": "",
"reg": false,
"x": 260,
"y": 540,
"wires": [
[
"f2b419ee4c649021"
]
]
},
{
"id": "6bf3be50f1f3a262",
"type": "Service Host",
"apiBase": "https://api.openai.com/v1",
"secureApiKeyHeaderOrQueryName": "Authorization",
"name": "OpenAI Auth"
}
] |
Beta Was this translation helpful? Give feedback.
Answer selected by
allanbunch
-
|
Oh wow, I can't wait to get this a spin, thank you so much! I have learned a lot by looking through your other examples. |
Beta Was this translation helpful? Give feedback.
-
|
Fantastic. Let me know if you have any questions. Here's the version implemented with Function nodes. Much easier on the eye. [
{
"id": "0cff40ae97ed5041",
"type": "tab",
"label": "Basic Aassistant Demo Low-code",
"disabled": false,
"info": "",
"env": []
},
{
"id": "4f8d2450811e925c",
"type": "inject",
"z": "0cff40ae97ed5041",
"name": "1. Start New Conversation",
"props": [
{
"p": "assistant.name",
"v": "Node-RED Basic Assistant",
"vt": "str"
},
{
"p": "assistant.thread",
"v": "{\"messages\":[{\"role\":\"user\",\"content\":\"Hi! I'm considering using Node-RED for advanced generative AI workflows. How about we collaborate to uncover a few novel use cases.\"}]}",
"vt": "json"
}
],
"repeat": "",
"crontab": "",
"once": false,
"onceDelay": 0.1,
"topic": "",
"x": 330,
"y": 120,
"wires": [
[
"bc9392752fa33ad6"
]
]
},
{
"id": "48382d39732203ce",
"type": "debug",
"z": "0cff40ae97ed5041",
"name": "Assistant Response",
"active": true,
"tosidebar": true,
"console": false,
"tostatus": false,
"complete": "payload.data[0].content[0].text.value",
"targetType": "msg",
"statusVal": "",
"statusType": "auto",
"x": 1440,
"y": 440,
"wires": []
},
{
"id": "903cf1e422a50bb5",
"type": "OpenAI API",
"z": "0cff40ae97ed5041",
"name": "Create Thread & Run",
"service": "6bf3be50f1f3a262",
"method": "createThreadAndRun",
"x": 580,
"y": 180,
"wires": [
[
"8cd2ab025e5d0ea7"
]
]
},
{
"id": "4eb04b4cdc4a86f9",
"type": "OpenAI API",
"z": "0cff40ae97ed5041",
"name": "Retrieve Run",
"service": "6bf3be50f1f3a262",
"method": "getRun",
"x": 1110,
"y": 180,
"wires": [
[
"2d5d5c57300e3371"
]
]
},
{
"id": "2d5d5c57300e3371",
"type": "switch",
"z": "0cff40ae97ed5041",
"name": "Run Status Loop",
"property": "payload.status",
"propertyType": "msg",
"rules": [
{
"t": "eq",
"v": "queued",
"vt": "str"
},
{
"t": "eq",
"v": "in_progress",
"vt": "str"
},
{
"t": "eq",
"v": "completed",
"vt": "str"
},
{
"t": "else"
}
],
"checkall": "true",
"repair": false,
"outputs": 4,
"x": 910,
"y": 340,
"wires": [
[
"8cd2ab025e5d0ea7"
],
[
"8cd2ab025e5d0ea7"
],
[
"7b352d1d83b590c3"
],
[
"79b19dc9365fe744"
]
],
"inputLabels": [
"Run Details"
],
"outputLabels": [
"Run Queued",
"Run In Progress",
"Run Complete",
"Run Exception"
]
},
{
"id": "02e1631ec984fcb9",
"type": "OpenAI API",
"z": "0cff40ae97ed5041",
"name": "List Messages",
"service": "6bf3be50f1f3a262",
"method": "listMessages",
"x": 1220,
"y": 400,
"wires": [
[
"1755a11f64330559"
]
]
},
{
"id": "79b19dc9365fe744",
"type": "debug",
"z": "0cff40ae97ed5041",
"name": "Run Exception",
"active": true,
"tosidebar": true,
"console": false,
"tostatus": false,
"complete": "payload",
"targetType": "msg",
"statusVal": "",
"statusType": "auto",
"x": 900,
"y": 400,
"wires": [],
"inputLabels": [
"Run Exception"
],
"icon": "font-awesome/fa-exclamation-triangle"
},
{
"id": "0455d15582dfc3a9",
"type": "comment",
"z": "0cff40ae97ed5041",
"name": "New Conversation node instructions...",
"info": "## Start New Conversation Inject Node\n1. Set `msg.assistant.name` to the name of your existing assistant.\n2. Set `msg.assistant.thread.messages` to an array of valid thread messages.",
"x": 290,
"y": 80,
"wires": [],
"icon": "font-awesome/fa-book"
},
{
"id": "409cb78d1f17a91d",
"type": "inject",
"z": "0cff40ae97ed5041",
"name": "2. Continue Conversation",
"props": [
{
"p": "payload.thread_id",
"v": "payload.thread_id",
"vt": "flow"
},
{
"p": "payload.role",
"v": "user",
"vt": "str"
},
{
"p": "payload.content",
"v": "Fantastic! I don't yet have specifics in mind, so the sky's the limit! 🚀",
"vt": "str"
}
],
"repeat": "",
"crontab": "",
"once": false,
"onceDelay": 0.1,
"topic": "",
"x": 330,
"y": 280,
"wires": [
[
"84e7ce5c8c8a40bb"
]
]
},
{
"id": "ea346beaf9ec95f4",
"type": "comment",
"z": "0cff40ae97ed5041",
"name": "Continue Conversation node instructions...",
"info": "## Continue Conversation Inject Node\n1. Set `msg.payload.content` whatever you'd like to say in response to the assistant's last message.",
"x": 280,
"y": 240,
"wires": [],
"icon": "font-awesome/fa-book"
},
{
"id": "84e7ce5c8c8a40bb",
"type": "OpenAI API",
"z": "0cff40ae97ed5041",
"name": "Create Message",
"service": "6bf3be50f1f3a262",
"method": "createMessage",
"x": 600,
"y": 280,
"wires": [
[
"1974366c8a31a4c1"
]
]
},
{
"id": "69b900b830bb23e1",
"type": "OpenAI API",
"z": "0cff40ae97ed5041",
"name": "Create Run",
"service": "6bf3be50f1f3a262",
"method": "createRun",
"x": 610,
"y": 340,
"wires": [
[
"2d5d5c57300e3371"
]
]
},
{
"id": "1974366c8a31a4c1",
"type": "change",
"z": "0cff40ae97ed5041",
"name": "Create Run Payload",
"rules": [
{
"t": "set",
"p": "payload",
"pt": "msg",
"to": "{}",
"tot": "json"
},
{
"t": "set",
"p": "payload.thread_id",
"pt": "msg",
"to": "payload.thread_id",
"tot": "flow"
},
{
"t": "set",
"p": "payload.assistant_id",
"pt": "msg",
"to": "payload.assistant_id",
"tot": "flow"
}
],
"action": "",
"property": "",
"from": "",
"to": "",
"reg": false,
"x": 340,
"y": 340,
"wires": [
[
"69b900b830bb23e1"
]
]
},
{
"id": "9bbc3789e6ce9a77",
"type": "function",
"z": "0cff40ae97ed5041",
"name": "Create Run Payload",
"func": "let assistants = msg.payload.data;\n\nlet assistant = assistants.find(assistant => assistant.name === msg.assistant.name);\n\nmsg.payload = {};\n\nif (assistant) {\n // Retrieved the assistant, now create the payload for the next node\n msg.payload.assistant_id = assistant.id;\n msg.payload.thread = msg.assistant.thread;\n} else {\n // No assistant found with the given name\n msg.payload = null;\n}\n\nreturn msg;",
"outputs": 1,
"timeout": 0,
"noerr": 0,
"initialize": "",
"finalize": "",
"libs": [],
"x": 880,
"y": 120,
"wires": [
[
"903cf1e422a50bb5"
]
]
},
{
"id": "bc9392752fa33ad6",
"type": "OpenAI API",
"z": "0cff40ae97ed5041",
"name": "List Assistants",
"service": "6bf3be50f1f3a262",
"method": "listAssistants",
"x": 600,
"y": 120,
"wires": [
[
"9bbc3789e6ce9a77"
]
],
"outputLabels": [
"Assistant Objects"
]
},
{
"id": "8cd2ab025e5d0ea7",
"type": "function",
"z": "0cff40ae97ed5041",
"name": "Create Run Status Payload",
"func": "let thread_id = msg.payload.thread_id;\n\nlet run_id = msg.payload.id;\n\nmsg.payload = {\n thread_id: thread_id,\n run_id: run_id\n};\n\nreturn msg;",
"outputs": 1,
"timeout": 0,
"noerr": 0,
"initialize": "",
"finalize": "",
"libs": [],
"x": 880,
"y": 180,
"wires": [
[
"4eb04b4cdc4a86f9"
]
]
},
{
"id": "7b352d1d83b590c3",
"type": "function",
"z": "0cff40ae97ed5041",
"name": "Extract Thread Id",
"func": "msg.payload = {\n thread_id: msg.payload.thread_id\n}\n\nreturn msg;",
"outputs": 1,
"timeout": 0,
"noerr": 0,
"initialize": "",
"finalize": "",
"libs": [],
"x": 1210,
"y": 360,
"wires": [
[
"02e1631ec984fcb9"
]
]
},
{
"id": "1755a11f64330559",
"type": "function",
"z": "0cff40ae97ed5041",
"name": "Store Conversation Details",
"func": "flow.set(\"payload.thread_id\", msg.payload.data[0].thread_id);\n\nflow.set(\"payload.assistant_id\", msg.payload.data[0].assistant_id);\n\nreturn msg;",
"outputs": 1,
"timeout": 0,
"noerr": 0,
"initialize": "",
"finalize": "",
"libs": [],
"x": 1180,
"y": 440,
"wires": [
[
"48382d39732203ce"
]
]
},
{
"id": "6bf3be50f1f3a262",
"type": "Service Host",
"apiBase": "https://api.openai.com/v1",
"secureApiKeyHeaderOrQueryName": "Authorization",
"name": "OpenAI Auth"
}
] |
Beta Was this translation helpful? Give feedback.
-
|
These really helped me get over the hurdle of learning how to do this in Node Red with your tool, thank you so much. I now have my own assistant chatting with me on my phone via telegram, using your node red tooling. I have some mild short-term memory deficits, and am setting up a little tool in Node Red to send me reminders in natural language at various times in order to help with this. You just helped me solve a HUGE part of this puzzle, I appreciate it! |
Beta Was this translation helpful? Give feedback.
-
|
Great to hear that your project is taking shape! Happy to help. Cheers! |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
@Hyperlooper - Here's a basic example showcasing an Assistant conversation without using Function (JavaScript) nodes.
To get started, you'll need to import this flow into your Node-RED environment, drop your Assistant's name into the
Start New ConversationInject node, then trigger that node after deploying your updated flow. You can also update theusermessages in both theStart New ConversationandContinue ConversationInject nodes according to your needs.This flow can be streamlined with the use of a couple of Function nodes; I plan to share a second flow demonstrating just that. Cheers!
[ { "id": "98bb4e379ccf9199", "type": "tab", "label": "Basic Aassist…