fix(distributed): setup script

[ALameLlama]

Description

This PR fixes #10550

Notes for Reviewers
In this PR I updated the scripts to fix the 3 issues I ran into with the original, you can now also rerun it multiple times, it will also output the nats files so you can mount it into docker e.g

  nats:
    image: nats:2-alpine
    ports:
      - "4222:4222"
      - "8222:8222"
    command:
      - "-c"
      - "/etc/nats/nats-server.conf"
    volumes:
      - /mnt/user/appdata/local_ai/nats/nats-server.conf:/etc/nats/nats-server.conf:ro
      - /mnt/user/appdata/local_ai/nats/nats-auth.conf:/etc/nats/nats-auth.conf:ro

First time run

Configuring NATS operator: localai-operator
[ OK ] generated and stored operator key "OAETPG75FKOOGSV5IZVRZGM4PLPCZ7CP6KHDXMSY6L6WLKPZGXCZQMXW"
[ OK ] added operator "localai-operator"
[ OK ] When running your own nats-server, make sure they run at least version 2.2.0
[ OK ] generated and stored account key "AALMNQPSVL5T5ABYLODE75KFFF5CWBNVY44Z4OCX5THZ2J6IDMD4NXRN"
[ OK ] added account "SYS"
[ OK ] set system account "AALMNQPSVL5T5ABYLODE75KFFF5CWBNVY44Z4OCX5THZ2J6IDMD4NXRN"
[ OK ] edited operator "localai-operator"
[ OK ] generated and stored account key "AAFV7F2MB3D4ZMQKU7XATWUG7KJQWAYGF5CKTT5BBZMSAT7CG2KQ2TVV"
[ OK ] added account "localai"
[ OK ] generated and stored user key "UDQ43KCDNCRWPRUKRIFJ65IZA7H75FNYQRU5ZNRMWSFHOZSJIROJ4NDD"
[ OK ] generated user creds file `~/.local/share/nats/nsc/keys/creds/localai-operator/localai/localai-frontend.creds`
[ OK ] added user "localai-frontend" to account "localai"
[ OK ] added pub "nodes.>"
[ OK ] added pub "gallery.>"
[ OK ] added pub "agent.>"
[ OK ] added pub "jobs.>"
[ OK ] added pub "mcp.>"
[ OK ] added pub "cache.>"
[ OK ] added pub "prefixcache.>"
[ OK ] added pub "finetune.>"
[ OK ] added sub "nodes.>"
[ OK ] added sub "gallery.>"
[ OK ] added sub "agent.>"
[ OK ] added sub "jobs.>"
[ OK ] added sub "mcp.>"
[ OK ] added sub "cache.>"
[ OK ] added sub "prefixcache.>"
[ OK ] added sub "_INBOX.>"
[ OK ] generated user creds file `~/.local/share/nats/nsc/keys/creds/localai-operator/localai/localai-frontend.creds`
[ OK ] edited user "localai-frontend"
[ OK ] wrote credentials to `./nats-keys/localai-frontend.creds`
Success!! - generated `./nats-keys/localai-frontend.creds`
[ OK ] wrote server configuration to `/work/nats-keys/nats-auth.conf`
Success!! - generated `/work/nats-keys/nats-auth.conf`

=== LocalAI NATS JWT setup complete ===

LocalAI environment: ./nats-keys/localai-nats.env
Service credentials: ./nats-keys/localai-frontend.creds
NATS server config:   ./nats-keys/nats-server.conf
NATS auth config:     ./nats-keys/nats-auth.conf

Keep './nats-keys/localai-nats.env' and './nats-keys/localai-frontend.creds' secret.
Do not commit them to source control.

=== LocalAI NATS environment ===
LOCALAI_NATS_ACCOUNT_SEED=SAAMFB5PDFLI3M5GLUIV23DYPEVCGEBTWHO3LQEPM36F2PIR5NJMFHCTIU
LOCALAI_NATS_SERVICE_JWT=eyJ0eXAiOiJKV1QiLCJhbGciOiJlZDI1NTE5LW5rZXkifQ.eyJqdGkiOiJSRzNPNFBESEFMSFlWRFVXRlNZS080Mk5SWUZVNjVIQk1QWk82RzVDR1VLMjNTTllQUzJBIiwiaWF0IjoxNzgyNTUwMjYyLCJpc3MiOiJBQUZWN0YyTUIzRDRaTVFLVTdYQVRXVUc3S0pRV0FZR0Y1Q0tUVDVCQlpNU0FUN0NHMktRMlRWViIsIm5hbWUiOiJsb2NhbGFpLWZyb250ZW5kIiwic3ViIjoiVURRNDNLQ0ROQ1JXUFJVS1JJRko2NUlaQTdINzVGTllRUlU1Wk5STVdTRkhPWlNKSVJPSjROREQiLCJuYXRzIjp7InB1YiI6eyJhbGxvdyI6WyJhZ2VudC5cdTAwM2UiLCJjYWNoZS5cdTAwM2UiLCJmaW5ldHVuZS5cdTAwM2UiLCJnYWxsZXJ5Llx1MDAzZSIsImpvYnMuXHUwMDNlIiwibWNwLlx1MDAzZSIsIm5vZGVzLlx1MDAzZSIsInByZWZpeGNhY2hlLlx1MDAzZSJdfSwic3ViIjp7ImFsbG93IjpbIl9JTkJPWC5cdTAwM2UiLCJhZ2VudC5cdTAwM2UiLCJjYWNoZS5cdTAwM2UiLCJnYWxsZXJ5Llx1MDAzZSIsImpvYnMuXHUwMDNlIiwibWNwLlx1MDAzZSIsIm5vZGVzLlx1MDAzZSIsInByZWZpeGNhY2hlLlx1MDAzZSJdfSwic3VicyI6LTEsImRhdGEiOi0xLCJwYXlsb2FkIjotMSwidHlwZSI6InVzZXIiLCJ2ZXJzaW9uIjoyfX0.d89x-UT_RHtLBXeE9U0sOWrSwV6Cj9N_e0SY2p1PHKkHdFp4YPAQ4BOKTFVxA1BQ4zdJ1aC1nPL1aZglKTyHAA
LOCALAI_NATS_SERVICE_SEED=SUAOUPHM2DOYIPWO3LOGIR35I7TKX7YRPDS6NXCIDUTO5LKOKNFM5HV5ZQ

repeated runs

Configuring NATS operator: localai-operator
[ OK ] using existing operator 'localai-operator'
[ OK ] using existing system account 'SYS'
[ OK ] edited operator "localai-operator"
[ OK ] using existing account 'localai'
[ OK ] using existing user 'localai-frontend'
[ OK ] added pub "nodes.>"
[ OK ] added pub "gallery.>"
[ OK ] added pub "agent.>"
[ OK ] added pub "jobs.>"
[ OK ] added pub "mcp.>"
[ OK ] added pub "cache.>"
[ OK ] added pub "prefixcache.>"
[ OK ] added pub "finetune.>"
[ OK ] added sub "nodes.>"
[ OK ] added sub "gallery.>"
[ OK ] added sub "agent.>"
[ OK ] added sub "jobs.>"
[ OK ] added sub "mcp.>"
[ OK ] added sub "cache.>"
[ OK ] added sub "prefixcache.>"
[ OK ] added sub "_INBOX.>"
[ OK ] generated user creds file `~/.local/share/nats/nsc/keys/creds/localai-operator/localai/localai-frontend.creds`
[ OK ] edited user "localai-frontend"
[ OK ] wrote credentials to `./nats-keys/localai-frontend.creds`
Success!! - generated `./nats-keys/localai-frontend.creds`
[ OK ] wrote server configuration to `/work/nats-keys/nats-auth.conf`
Success!! - generated `/work/nats-keys/nats-auth.conf`

=== LocalAI NATS JWT setup complete ===

LocalAI environment: ./nats-keys/localai-nats.env
Service credentials: ./nats-keys/localai-frontend.creds
NATS server config:   ./nats-keys/nats-server.conf
NATS auth config:     ./nats-keys/nats-auth.conf

Keep './nats-keys/localai-nats.env' and './nats-keys/localai-frontend.creds' secret.
Do not commit them to source control.

=== LocalAI NATS environment ===
LOCALAI_NATS_ACCOUNT_SEED=SAAJUFUTLAIQ2PLDAR5MN5EIOZZRQQ6LQU6L3L3HG255NP3DM2XJOGG62A
LOCALAI_NATS_SERVICE_JWT=eyJ0eXAiOiJKV1QiLCJhbGciOiJlZDI1NTE5LW5rZXkifQ.eyJqdGkiOiI3U0lZMlM0VUFTWkZZT0UyTzIzTDY1RktDQUk3VUJHMlNKSEdNNVEySk1DT0YzMk8zU0tRIiwiaWF0IjoxNzgyNTUwMDg4LCJpc3MiOiJBQ05VSExES0ZZRTU1NEw1R1I3VFNQVTNHTVVKVVdPUEtPRkVXNkVFV0hOSVhGMlFCWkI2MllPRSIsIm5hbWUiOiJsb2NhbGFpLWZyb250ZW5kIiwic3ViIjoiVUI0RVdHSFZCRk1NTzIzVzNUTDNSNlRYNTdHRzI3VFlQNDdJTkVVVVJGU0NNUU4yRllLSzVXSkIiLCJuYXRzIjp7InB1YiI6eyJhbGxvdyI6WyJhZ2VudC5cdTAwM2UiLCJjYWNoZS5cdTAwM2UiLCJmaW5ldHVuZS5cdTAwM2UiLCJnYWxsZXJ5Llx1MDAzZSIsImpvYnMuXHUwMDNlIiwibWNwLlx1MDAzZSIsIm5vZGVzLlx1MDAzZSIsInByZWZpeGNhY2hlLlx1MDAzZSJdfSwic3ViIjp7ImFsbG93IjpbIl9JTkJPWC5cdTAwM2UiLCJhZ2VudC5cdTAwM2UiLCJjYWNoZS5cdTAwM2UiLCJnYWxsZXJ5Llx1MDAzZSIsImpvYnMuXHUwMDNlIiwibWNwLlx1MDAzZSIsIm5vZGVzLlx1MDAzZSIsInByZWZpeGNhY2hlLlx1MDAzZSJdfSwic3VicyI6LTEsImRhdGEiOi0xLCJwYXlsb2FkIjotMSwidHlwZSI6InVzZXIiLCJ2ZXJzaW9uIjoyfX0.8jE6F2nW86aMcKVl1FGs-pmfYdLHrZCaS_TuA3ib1EXwfQQO8sXfDBgwWzfdhDp4lFOcAX1rhMmmU_eEB-MACw
LOCALAI_NATS_SERVICE_SEED=SUAJ36D4MAVCHCZCIQ2ZRCL5NYU62WOF3INDFG234CH5JG2WWSMK7GMBJY

Signed commits

• Yes, I signed my commits.