Front-end of AssistGUI

​ ASSISTGUI is a benchmark designed to evaluate models' abilities to automate tasks on the Windows platform by manipulating the mouse and keyboard. It consists of 100 tasks from popular software like After Effects and MS Word, each with accompanying project files. The goal is to assess the effectiveness of GUI automation and foster progress in this field.

https://arxiv.org/abs/2312.13108

## Project Setup

pip install -r requirements.txt

npm install

Compile and Hot-Reload for Development

npm run dev

Compile and Minify for Production

npm run build

Usage

1. The App will automatically show all current apps you are now opening.
2. Select an app, input your needs, and press the send button.
3. The LLM at the backend will generate the steps
4. Press continue, and the client will automatically open the corresponding window and automatically control the software.