LORAs were invented so that we don't have to retrain the whole model if we want to add something new.
Retraining the whole Stable Diffusion base model costs a lot of money. But training a LORA on a few thousand images is totally doable with a single GPU.
