Merge branch 'dev' into extra-networks-always-visible

          --skip-prepare-environment

          --skip-prepare-environment

          --skip-torch-cuda-test

          --skip-torch-cuda-test

          --test-server

          --test-server

          --do-not-download-clip

          --no-half

          --no-half

          --disable-opt-split-attention

          --disable-opt-split-attention

          --use-cpu all

          --use-cpu all

## 1.5.1

### Minor:

 * support parsing text encoder blocks in some new LoRAs

 * delete scale checker script due to user demand

### Extensions and API:

 * add postprocess_batch_list script callback

### Bug Fixes:

 * fix TI training for SD1

 * fix reload altclip model error

 * prepend the pythonpath instead of overriding it

 * fix typo in SD_WEBUI_RESTARTING

 * if txt2img/img2img raises an exception, finally call state.end()

 * fix composable diffusion weight parsing

 * restyle Startup profile for black users

 * fix webui not launching with --nowebui

 * catch exception for non git extensions

 * fix some options missing from /sdapi/v1/options

 * fix for extension update status always saying "unknown"

 * fix display of extra network cards that have `<>` in the name

 * update lora extension to work with python 3.8

## 1.5.0

### Features:

 * SD XL support

 * user metadata system for custom networks

 * extended Lora metadata editor: set activation text, default weight, view tags, training info

 * Lora extension rework to include other types of networks (all that were previously handled by LyCORIS extension)

 * show github stars for extenstions

 * img2img batch mode can read extra stuff from png info

 * img2img batch works with subdirectories

 * hotkeys to move prompt elements: alt+left/right

 * restyle time taken/VRAM display

 * add textual inversion hashes to infotext

 * optimization: cache git extension repo information

 * move generate button next to the generated picture for mobile clients

 * hide cards for networks of incompatible Stable Diffusion version in Lora extra networks interface

 * skip installing packages with pip if they all are already installed - startup speedup of about 2 seconds

### Minor:

 * checkbox to check/uncheck all extensions in the Installed tab

 * add gradio user to infotext and to filename patterns

 * allow gif for extra network previews

 * add options to change colors in grid

 * use natural sort for items in extra networks

 * Mac: use empty_cache() from torch 2 to clear VRAM

 * added automatic support for installing the right libraries for Navi3 (AMD)

 * add option SWIN_torch_compile to accelerate SwinIR upscale

 * suppress printing TI embedding info at start to console by default

 * speedup extra networks listing

 * added `[none]` filename token.

 * removed thumbs extra networks view mode (use settings tab to change width/height/scale to get thumbs)

 * add always_discard_next_to_last_sigma option to XYZ plot

 * automatically switch to 32-bit float VAE if the generated picture has NaNs without the need for `--no-half-vae` commandline flag.

### Extensions and API:

 * api endpoints: /sdapi/v1/server-kill, /sdapi/v1/server-restart, /sdapi/v1/server-stop

 * allow Script to have custom metaclass

 * add model exists status check /sdapi/v1/options

 * rename --add-stop-route to --api-server-stop

 * add `before_hr` script callback

 * add callback `after_extra_networks_activate`

 * disable rich exception output in console for API by default, use WEBUI_RICH_EXCEPTIONS env var to enable

 * return http 404 when thumb file not found

 * allow replacing extensions index with environment variable

### Bug Fixes:

 * fix for catch errors when retrieving extension index #11290

 * fix very slow loading speed of .safetensors files when reading from network drives

 * API cache cleanup

 * fix UnicodeEncodeError when writing to file CLIP Interrogator batch mode

 * fix warning of 'has_mps' deprecated from PyTorch

 * fix problem with extra network saving images as previews losing generation info

 * fix throwing exception when trying to resize image with I;16 mode

 * fix for #11534: canvas zoom and pan extension hijacking shortcut keys

 * fixed launch script to be runnable from any directory

 * don't add "Seed Resize: -1x-1" to API image metadata

 * correctly remove end parenthesis with ctrl+up/down

 * fixing --subpath on newer gradio version

 * fix: check fill size none zero when resize  (fixes #11425)

 * use submit and blur for quick settings textbox

 * save img2img batch with images.save_image()

 * prevent running preload.py for disabled extensions

 * fix: previously, model name was added together with directory name to infotext and to [model_name] filename pattern; directory name is now not included

## 1.4.1

## 1.4.1

### Bug Fixes:

### Bug Fixes:

- [Alt-Diffusion](https://arxiv.org/abs/2211.06679) support - see [wiki](https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Features#alt-diffusion) for instructions

- [Alt-Diffusion](https://arxiv.org/abs/2211.06679) support - see [wiki](https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Features#alt-diffusion) for instructions

- Now without any bad letters!

- Now without any bad letters!

- Load checkpoints in safetensors format

- Load checkpoints in safetensors format

- Eased resolution restriction: generated image's domension must be a multiple of 8 rather than 64

- Eased resolution restriction: generated image's dimension must be a multiple of 8 rather than 64

- Now with a license!

- Now with a license!

- Reorder elements in the UI from settings screen

- Reorder elements in the UI from settings screen

- Security advice - RyotaK

- Security advice - RyotaK

- UniPC sampler - Wenliang Zhao - https://github.com/wl-zhao/UniPC

- UniPC sampler - Wenliang Zhao - https://github.com/wl-zhao/UniPC

- TAESD - Ollin Boer Bohan - https://github.com/madebyollin/taesd

- TAESD - Ollin Boer Bohan - https://github.com/madebyollin/taesd

- LyCORIS - KohakuBlueleaf

- Restart sampling - lambertae - https://github.com/Newbeeer/diffusion_restart_sampling

- Initial Gradio script - posted on 4chan by an Anonymous user. Thank you Anonymous user.

- Initial Gradio script - posted on 4chan by an Anonymous user. Thank you Anonymous user.

- (You)

- (You)

from modules import extra_networks, shared

from modules import extra_networks, shared

import lora

import networks

class ExtraNetworkLora(extra_networks.ExtraNetwork):

class ExtraNetworkLora(extra_networks.ExtraNetwork):

    def activate(self, p, params_list):

    def activate(self, p, params_list):

        additional = shared.opts.sd_lora

        additional = shared.opts.sd_lora

        if additional != "None" and additional in lora.available_loras and not any(x for x in params_list if x.items[0] == additional):

        if additional != "None" and additional in networks.available_networks and not any(x for x in params_list if x.items[0] == additional):

            p.all_prompts = [x + f"<lora:{additional}:{shared.opts.extra_networks_default_multiplier}>" for x in p.all_prompts]

            p.all_prompts = [x + f"<lora:{additional}:{shared.opts.extra_networks_default_multiplier}>" for x in p.all_prompts]

            params_list.append(extra_networks.ExtraNetworkParams(items=[additional, shared.opts.extra_networks_default_multiplier]))

            params_list.append(extra_networks.ExtraNetworkParams(items=[additional, shared.opts.extra_networks_default_multiplier]))

        names = []

        names = []

        multipliers = []

        te_multipliers = []

        unet_multipliers = []

        dyn_dims = []

        for params in params_list:

        for params in params_list:

            assert params.items

            assert params.items

            names.append(params.items[0])

            names.append(params.positional[0])

            multipliers.append(float(params.items[1]) if len(params.items) > 1 else 1.0)

        lora.load_loras(names, multipliers)

            te_multiplier = float(params.positional[1]) if len(params.positional) > 1 else 1.0

            te_multiplier = float(params.named.get("te", te_multiplier))

            unet_multiplier = float(params.positional[2]) if len(params.positional) > 2 else te_multiplier

            unet_multiplier = float(params.named.get("unet", unet_multiplier))

            dyn_dim = int(params.positional[3]) if len(params.positional) > 3 else None

            dyn_dim = int(params.named["dyn"]) if "dyn" in params.named else dyn_dim

            te_multipliers.append(te_multiplier)

            unet_multipliers.append(unet_multiplier)

            dyn_dims.append(dyn_dim)

        networks.load_networks(names, te_multipliers, unet_multipliers, dyn_dims)

        if shared.opts.lora_add_hashes_to_infotext:

        if shared.opts.lora_add_hashes_to_infotext:

            lora_hashes = []

            network_hashes = []

            for item in lora.loaded_loras:

            for item in networks.loaded_networks:

                shorthash = item.lora_on_disk.shorthash

                shorthash = item.network_on_disk.shorthash

                if not shorthash:

                if not shorthash:

                    continue

                    continue

                alias = alias.replace(":", "").replace(",", "")

                alias = alias.replace(":", "").replace(",", "")

                lora_hashes.append(f"{alias}: {shorthash}")

                network_hashes.append(f"{alias}: {shorthash}")

            if lora_hashes:

            if network_hashes:

                p.extra_generation_params["Lora hashes"] = ", ".join(lora_hashes)

                p.extra_generation_params["Lora hashes"] = ", ".join(network_hashes)

    def deactivate(self, p):

    def deactivate(self, p):

        pass

        pass