Make repo compatible with the webui

[ljleb]

We can add a python script under scripts/mecha_extension.py which would serve as the entry point for the webui extension. I outline here what I think we want to do, but I'm open to any suggestion really.

Must have:

• select a .mecha recipe in the checkpoints dropdown to load a recipe instead of a model. The recipe is merged on the spot. This allows to save a lot of disk space while also making it very easy to explore highly complex alternative model weights composition

Should have:

• create recipes from within the webui and run them. I'm not sure what interface to use for this, maybe we can just have a textbox in which we hand-craft them

[Enferlain]

Yeah I think the biggest boost for testing would be being able to go through various recipes in batches and even iterate through them with something like an XYZ and see the results of those experiments immediately. That would already be halfway to unlocking not just executing already existing ideas but go into exploration territory.

I feel like that is one of the biggest strengths you've carved out with Mecha, as everything else is computationally shit in comparison. Imagine being able to do a shitload of merges, more than you could manually put together, and then being able to visually confirm the results without having to manually load and gen and unload them throughout the process, and without your gpu or ram breaking a sweat.

And maybe in the future Mecha could even do the exploration part with something like this

Who knows. I have suggestions but no knowledge to explain the technicals and I can't help implement them, which makes suggesting things feel a bit awkward. But I like everything so far and I'm thankful for what you e made.

[ljleb]

Yeah I think the biggest boost for testing would be being able to go through various recipes in batches and even iterate through them with something like an XYZ and see the results of those experiments immediately. That would already be halfway to unlocking not just executing already existing ideas but go into exploration territory.

Honestly, I think that's a really good idea. Implementing it will need a little bit of forethought, I'm not sure how to coerce the webui into working in this way.

I've been testing the comfy nodes for a little bit of time yesterday and while they are absolutely not finished, it really works well for quick prototyping. Also, while this is still a work in progress, I got a custom code node to work in comfyui. It is very rough around the edges though.

Maybe it could be an alternative to consider in the meantime for you, I don't know. (feel free to ping me if I haven't done the docs yet in case you intend to consider it, I am open to feedback on the way things work currently)

And maybe in the future Mecha could even do the exploration part with something like this

Thanks for the suggestion. It might be possible to do automatic/manual scoring in mecha using recipes with free parameters. This also needs forethought and design, but there shouldn't be anything in the way of doing this currently.

But I like everything so far and I'm thankful for what you e made.

Thanks for saying that. Knowing what I'm doing isn't all pointless gives me the strength to keep going. ❤️