I haven't used this and maybe it doesn't solve the problem you're describing, but might be worth looking at.

https://github.com/lmstudio-ai/lms

https://lmstudio.ai/docs/cli