blank Image generate when use openvino model with gpu

[ak-sangal]

(c) Microsoft Corporation. All rights reserved.

D:\fastsdcpu>set DEVICE=GPU
D:\fastsdcpu>start-webui.bat
Starting fastsdcpu...
Python command check :OK
Python version: 3.10.0
D:\fastsdcpu\env\Lib\site-packages\torch\onnx_internal\registration.py:162: OnnxExporterWarning: Symbolic function 'aten::scaled_dot_product_attention' already registered for opset 14. Replacing the existing function with new function. This is unexpected. Please report it on https://github.com/pytorch/pytorch/issues.
warnings.warn(
D:\fastsdcpu\env\Lib\site-packages\openvino\runtime_init_.py:10: DeprecationWarning: The openvino.runtime module is deprecated and will be removed in the 2026.0 release. Please replace openvino.runtime with openvino.
warnings.warn(
Settings not found creating default settings
FastSD CPU - v1.0.0 beta 281
Running on Windows platform
OS: Windows-10-10.0.26200-SP0
Processor: Intel64 Family 6 Model 186 Stepping 3, GenuineIntel
Using device : GPU
Output path : D:\fastsdcpu\results
Found 6 LCM models in config/lcm-models.txt
Found 7 stable diffusion models in config/stable-diffusion-models.txt
Found 4 LCM-LoRA models in config/lcm-lora-models.txt
Found 10 OpenVINO LCM models in config/openvino-lcm-models.txt
D:\fastsdcpu\env\Lib\site-packages\controlnet_aux\segment_anything\modeling\tiny_vit_sam.py:654: UserWarning: Overwriting tiny_vit_5m_224 in registry with controlnet_aux.segment_anything.modeling.tiny_vit_sam.tiny_vit_5m_224. This is because the name being registered conflicts with an existing name. Please check if this is not expected.
return register_model(fn_wrapper)
D:\fastsdcpu\env\Lib\site-packages\controlnet_aux\segment_anything\modeling\tiny_vit_sam.py:654: UserWarning: Overwriting tiny_vit_11m_224 in registry with controlnet_aux.segment_anything.modeling.tiny_vit_sam.tiny_vit_11m_224. This is because the name being registered conflicts with an existing name. Please check if this is not expected.
return register_model(fn_wrapper)
D:\fastsdcpu\env\Lib\site-packages\controlnet_aux\segment_anything\modeling\tiny_vit_sam.py:654: UserWarning: Overwriting tiny_vit_21m_224 in registry with controlnet_aux.segment_anything.modeling.tiny_vit_sam.tiny_vit_21m_224. This is because the name being registered conflicts with an existing name. Please check if this is not expected.
return register_model(fn_wrapper)
D:\fastsdcpu\env\Lib\site-packages\controlnet_aux\segment_anything\modeling\tiny_vit_sam.py:654: UserWarning: Overwriting tiny_vit_21m_384 in registry with controlnet_aux.segment_anything.modeling.tiny_vit_sam.tiny_vit_21m_384. This is because the name being registered conflicts with an existing name. Please check if this is not expected.
return register_model(fn_wrapper)
D:\fastsdcpu\env\Lib\site-packages\controlnet_aux\segment_anything\modeling\tiny_vit_sam.py:654: UserWarning: Overwriting tiny_vit_21m_512 in registry with controlnet_aux.segment_anything.modeling.tiny_vit_sam.tiny_vit_21m_512. This is because the name being registered conflicts with an existing name. Please check if this is not expected.
return register_model(fn_wrapper)
Starting web UI mode
No lora models found, please add lora models to D:\fastsdcpu\lora_models directory
D:\fastsdcpu\env\Lib\site-packages\gradio\components\dropdown.py:226: UserWarning: The value passed into gr.Dropdown() is not in the list of choices. Please update the list of choices to include: or set allow_custom_value=True.
warnings.warn(
D:\fastsdcpu\env\Lib\site-packages\gradio\components\base.py:194: UserWarning: show_label has no effect when container is False.
warnings.warn("show_label has no effect when container is False.")
INFO: Could not find files for the given pattern(s).

• Running on local URL: http://127.0.0.1:7860

To create a public link, set share=True in launch().
Torch datatype : torch.float32
Reshape and compile
{'clip_skip': 1,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 512,
'image_width': 512,
'inference_steps': 1,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': '',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/hyper-sd-sdxl-1-step-openvino-int8',
'prompt': 'horror',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 123123,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': False,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': False}
***** Init Text to image (OpenVINO) - rupeshs/hyper-sd-sdxl-1-step-openvino-int8 *****
Fetching 27 files: 100%|████████████████████████████████████████████████████████████| 27/27 [00:00<00:00, 13496.15it/s]
The config attributes {'interpolation_type': 'linear', 'skip_prk_steps': True, 'use_karras_sigmas': False} were passed to LCMScheduler, but are not expected and will be ignored. Please verify your scheduler_config.json configuration file.
The config attributes {'interpolation_type': 'linear', 'skip_prk_steps': True, 'use_karras_sigmas': False} were passed to LCMScheduler, but are not expected and will be ignored. Please verify your scheduler_config.json configuration file.
Pipeline : OVStableDiffusionXLPipeline {
"_class_name": "OVStableDiffusionXLPipeline",
"_diffusers_version": "0.33.0",
"_name_or_path": "D:\om\2024\sd\hypersd\fastsdcpu\Hyper-SDXL-1step-lora",
"feature_extractor": [
null,
null
],
"force_zeros_for_empty_prompt": true,
"image_encoder": [
null,
null
],
"scheduler": [
"diffusers",
"LCMScheduler"
],
"text_encoder": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTextEncoder"
],
"text_encoder_2": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTextEncoder"
],
"tokenizer": [
"transformers",
"CLIPTokenizer"
],
"tokenizer_2": [
"transformers",
"CLIPTokenizer"
],
"unet": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelUnet"
],
"vae": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelVae"
]
}

Using OpenVINO
100%|████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:02<00:00, 2.72s/it]
D:\fastsdcpu\env\Lib\site-packages\diffusers\image_processor.py:147: RuntimeWarning: invalid value encountered in cast
images = (images * 255).round().astype("uint8")
Latency : 60.34 seconds
Reshape and compile
{'clip_skip': 1,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 512,
'image_width': 512,
'inference_steps': 1,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': '',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/sdxl-turbo-openvino-int8',
'prompt': 'horror',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 123123,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': False,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': False}
***** Init Text to image (OpenVINO) - rupeshs/sdxl-turbo-openvino-int8 *****
Fetching 27 files: 100%|███████████████████████████████████████████████████████████████████████| 27/27 [00:00<?, ?it/s]
Pipeline : OVStableDiffusionXLPipeline {
"_class_name": "OVStableDiffusionXLPipeline",
"_diffusers_version": "0.33.0",
"_name_or_path": "stabilityai/sdxl-turbo",
"feature_extractor": [
null,
null
],
"force_zeros_for_empty_prompt": true,
"image_encoder": [
null,
null
],
"scheduler": [
"diffusers",
"EulerAncestralDiscreteScheduler"
],
"text_encoder": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTextEncoder"
],
"text_encoder_2": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTextEncoder"
],
"tokenizer": [
"transformers",
"CLIPTokenizer"
],
"tokenizer_2": [
"transformers",
"CLIPTokenizer"
],
"unet": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelUnet"
],
"vae": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelVae"
]
}

Using OpenVINO
100%|████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:01<00:00, 1.53s/it]
Latency : 53.58 seconds
{'clip_skip': 1,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 512,
'image_width': 512,
'inference_steps': 1,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': '',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/sdxl-turbo-openvino-int8',
'prompt': 'horror',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 123123,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': False,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': False}
Using OpenVINO
100%|████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:01<00:00, 1.12s/it]
Latency : 2.59 seconds
{'clip_skip': 1,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 512,
'image_width': 512,
'inference_steps': 1,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': '',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/sdxl-turbo-openvino-int8',
'prompt': 'horror',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 123123,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': True,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': False}
Using OpenVINO
100%|████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:01<00:00, 1.09s/it]
Latency : 2.51 seconds
{'clip_skip': 1,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 512,
'image_width': 512,
'inference_steps': 1,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': '',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/sdxl-turbo-openvino-int8',
'prompt': 'mountain',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 123123,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': True,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': False}
Using OpenVINO
100%|████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:01<00:00, 1.10s/it]
Latency : 2.48 seconds
Reshape and compile
{'clip_skip': 1,
'controlnet': None,
'diffusion_task': 'text_to_image',
'dirs': {'controlnet': 'D:\fastsdcpu\controlnet_models',
'lora': 'D:\fastsdcpu\lora_models'},
'gguf_model': {'clip_path': None,
'diffusion_path': None,
'gguf_models': 'D:\fastsdcpu\models\gguf',
't5xxl_path': None,
'vae_path': None},
'guidance_scale': 1.0,
'image_height': 512,
'image_width': 512,
'inference_steps': 1,
'init_image': None,
'lcm_lora': {'base_model_id': 'Lykon/dreamshaper-8',
'lcm_lora_id': 'latent-consistency/lcm-lora-sdv1-5'},
'lcm_model_id': 'stabilityai/sd-turbo',
'lora': {'enabled': False,
'fuse': True,
'models_dir': 'D:\fastsdcpu\lora_models',
'path': '',
'weight': 0.5},
'negative_prompt': '',
'number_of_images': 1,
'openvino_lcm_model_id': 'rupeshs/SDXL-Lightning-2steps-openvino-int8',
'prompt': 'mountain',
'rebuild_controlnet_pipeline': False,
'rebuild_pipeline': False,
'seed': 123123,
'strength': 0.6,
'token_merging': 0.0,
'use_gguf_model': False,
'use_lcm_lora': False,
'use_offline_model': True,
'use_openvino': True,
'use_safety_checker': False,
'use_seed': False,
'use_tiny_auto_encoder': False}
***** Init Text to image (OpenVINO) - rupeshs/SDXL-Lightning-2steps-openvino-int8 *****
Pipeline : OVStableDiffusionXLPipeline {
"_class_name": "OVStableDiffusionXLPipeline",
"_diffusers_version": "0.33.0",
"_name_or_path": "rupeshs/SDXL-Lightning-2steps",
"feature_extractor": [
null,
null
],
"force_zeros_for_empty_prompt": true,
"image_encoder": [
null,
null
],
"scheduler": [
"diffusers",
"EulerDiscreteScheduler"
],
"text_encoder": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTextEncoder"
],
"text_encoder_2": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelTextEncoder"
],
"tokenizer": [
"transformers",
"CLIPTokenizer"
],
"tokenizer_2": [
"transformers",
"CLIPTokenizer"
],
"unet": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelUnet"
],
"vae": [
"optimum.intel.openvino.modeling_diffusion",
"OVModelVae"
]
}

Using OpenVINO
100%|████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:01<00:00, 1.50s/it]
Latency : 52.65 seconds