Lora training support

[KintCark]

Can we get Lora training support in sdcpp it would be awesome and probably use less memory I hope

[stduhpf]

Now that at-runtime LoRA support has been added, we're about halfway there I think.

[KintCark]

Now that at-runtime LoRA support has been added, we're about halfway there I think.

Yeeeaahhh!!

[nonetrix]

My AMD GPU can't train SDXL even though lower end NVIDIAs do it so this would be great