RunPod's Dockerless CLI

[VicThor-wpp]

Hi, is there a way to implement the dockerless feature to speed up the building image process of the dockerfile?

A blog with info.
https://blog.runpod.io/runpod-dockerless-cli-innovation/

[TimPietrusky]

@VicThor-wpp that is something we have to look into, thanks for pointing it out!

[VicThor-wpp]

Im actually testing with Mkdir and CP in the dockerfile to move the files from /runpod_volumes and is working. It need the detailed list of particular models for each custom_node, but in the end speed up the first run and some custom nodes dont download the models, so it avoid the crash.

[brgrp]

@VicThor-wpp anything you wanna share? I am probably doing the same right now hehe

[voytek98]

any updates @brgrp @VicThor-wpp ?

[TimPietrusky]

@VicThor-wpp @brgrp @voytek98 did anyone of you came to any result?

[VicThor-wpp]

Yes, I make a web app for a interactive campaign for a week, I run on 3/10 runpod gpus and generate more than 20K images. Sorry I'm pretty busy right now but I'll try to make the time to make a guide.

Basically use the runpod storage to save huge models (checkpoint, ipadapters, loras, ctrlNet) and custom-modules and after with docker file install all dependencies of modules in a single pip install (tricky part) and copy all custom files (you cant change the location of all custom modules in the Comfy paths) but for a simpler workflow it should be more easy.

[TimPietrusky]

@VicThor-wpp that sounds great! If you ever have time, we can also jump into a video call, and you can walk me through it, and I can convert this into a guide.