Efficient rebuild of scripts when lib files change

[BeSpunky]

This script watches the lib folder, and when changes to ts files are made, it does 2 things:

1. Create/update a dependency graph of libFilePath -> dependantScriptPaths[]
2. Touches all script files that depend on the changed lib file to trigger rebuild.

https://gist.github.com/BeSpunky/d40bf6052b2c9a4f3a58b22108e5124a

TLDR
Currently, ScriptKit only rebuilds scripts if it detects changes to the scripts folder.
If you extract your reusable parts and put them into the lib folder, ScriptKit doesn't pick up on changes to those files.
The manual way to overcome this is to save your script file again and trigger rebuild.

No more... :)

Actually, this is a 3 scripts solution:

1. update-script-dependency-graphs: Partially rebuilds the graph if a triggering file has been provided, otherwise completely rebuilds it.
2. watch-libs: Watches lib files, partially rebuild the graph using update-script-dependency-graph, then touch the scripts.
3. watch-scripts: Watch script files, partially rebuild the graph

[nbbaier]

Could you give a little more guidance on how to install these? Would love to get it set up.

[BeSpunky]

Sure.
Do the following for the 3 Gists I've provided above:

1. Download the Gist as a zip.
   Inside your zip, you'll notice two folders:

   

2. Copy the contents of _ into your scripts folder

3. Copy the contents of __/lib into your lib folder

You might find duplicate lib files. Just skip the duplicates.
That's because each script is generated separately.

Sorry for the hassle. I'm thinking of producing a quick installer script for these Gists.

@johnlindquist, any chance of leveraging the existing kit:// schema for multiple files?
Otherwise, I'd have to come up with my own methodology for installation, AND... you'd have to install the installation script, before installing anything else. 🤓

[BeSpunky]

⚠️ HEADS UP

There's a problem I thought I had fixed, but turns out I didn't.
This might leave you with multiple unclosed processes over time, and you'll have to manually terminate them...

Will post the fix when I catch it.

[nbbaier]

Thanks! Having issues, might be something I did wrong though. I ge the following error when I add something to scripts:

[2023-05-06 13:04:38.082] [info]  {"args":["unlink"]}
[2023-05-06 13:05:33.866] [warn]  ☠️ ERROR PROMPT SHOULD SHOW ☠️
[2023-05-06 13:05:33.866] [warn]  Error: update-scripts-dependency-graph not found
    at resolveToScriptPath (file:///Users/nicholasbaier/.kit/core/utils.js:183:11)
    at run (file:///Users/nicholasbaier/.kit/core/utils.js:477:26)
    at file:///Users/nicholasbaier/.kenv/.scripts/watch-scripts.mjs:4:7
[2023-05-06 13:05:33.868] [info]  {"args":["add"]}

And the following error when I add to lib:

[JayAchar]

@johnlindquist Did this update get included? I've come across this issue today where editing files in a lib folder doesn't result in typescript rebuilding scripts.

[johnlindquist]

@JayAchar

https://github.com/johnlindquist/kitapp/releases/tag/v1.93.13

☝️ There's the latest Script Kit v2 beta. I completely replaced the "compile on file change" logic into a custom loader that compiles instantly "on run". So no more lib/compile issues :)

[shyagamzo]

Wonderful! Thanks for the update!

[JosXa]

@johnlindquist In 2.9, it still only works if you touch the script file. It won't rebuild if its dependencies in lib change. I'll definitely grab this code and see what can be done with it :)

[johnlindquist]

@JosXa In 2.9, I'll need to clear the .scripts cache from the app if the libs change. The app no longer watches the scripts at all and uses a cache in the loader.