I’ll show you how you can create a simple 360 degree layout scene in blender and turn it into entire 3D environments!

You can use this workflow in your browser or install it locally for free and use it with your favorite Stable Diffusion model or even with the brand new, absolutely mind blowing FLUX image model by Black Forest Labs.

I’ll also show you how you can seamlessly integrate characters or other assets into these 3D environments, how to combine them with my AI compositing workflow for a full low budget virtual production environment and I also want to try traveling to these worlds using my VR headset to see if they hold up in person.

So whether you need background stages for games, digital sets for cg movies or live action vfx shots, this workflow will let you speedrun environment creation for your projects.

Download the FREE WORKFLOWS below!

Prompt for LeonardoAI and SDXL:

((masterpiece)), (cinematic), Equirectangular projection, 360 degree image, photography, [SCENE DESCRIPTION, KEYWORDS]

Prompt for FLUX:

ground level photography of [DETAILED SCENE DESCRIPTION] It is a masterpiece. 360 degree image, equirectangular projection, hdri, wide shot

Installation Guide

1 Install ComfyUI

1. Download ComfyUI: https://github.com/comfyanonymous/ComfyUI

2. Extract the folder to the location where you want to install ComfyUI.

3. install git https://git-scm.com/download/win

   • standalone version

4. Download ComfyUI Manager: https://github.com/ltdrdata/ComfyUI-Manager

5. Extract it, put it into your ComfyUI directory and run it.

6. After it’s done you can run ComfyUI by clicking run_nvidia_gpu

Congratulations, you installed ComfyUI! 🥳 To use my workflows you’ll need some extra models and extensions, but it is super easy to install them!

In the next step I’ll show you where to get and put the models. If you’re having issues check if you can just install them via the ComfyUI Manager. Just search for them and when you click “Install” they will be put in the right directory.

2 Create 360° Images with SDXL

https://lh7-rt.googleusercontent.com/docsz/AD_4nXePF09aJfmm-3j9eDsVa6aZJI2OW28yPCUfooSoCpJs8dWlGbD93crrdvVmrPakGsRi7-3d8Eje87DjaR6I6CjpkOEzoaEulh06EWtVZGwtKyeQUdp9V8Jf-LzGxK_zAISd93hpG_C5_4ENLW-l2ddQaSc7?key=ZPubRx_M7ILc5Lf3Mnb69w

Get the workflow here 👉

Drag and drop the .json into your ComfyUI Interface.

Go to ComfyUI Manager > Install missing custom nodes > install all of them > Restart ComfyUI

Download the Models:

Download these models and put them in the corresponding folders:

1. Checkpoint: https://civitai.com/models/293331/wildcardx-xl-turbo

   📁 ComfyUI_windows_portable\ComfyUI\models\checkpoints

   You can also use any other SDXL checkpoints for all the workflows. I recommend Turbo or lightning ones though for faster generation time especially for the video workflows. You can find more models on CivitAI.com. Check the example images for the settings and match them in your KSampler!

2. CONTROLNET MODEL: https://huggingface.co/xinsir/controlnet-union-sdxl-1.0

   (ControlNet++)

   📁 ComfyUI_windows_portable\ComfyUI\models\controlnet\sdxl

   Go to Manager > Model Manager > Search “Promax” > Install > Refresh

3. UPSCALE MODEL: https://openmodeldb.info/models/4x-ClearRealityV1

📁 \ComfyUI_windows_portable\ComfyUI\models\upscale_models

3 Create 360° Images with FLUX

Get the workflow here 👉

https://lh7-rt.googleusercontent.com/docsz/AD_4nXfEn5zOgcVSvwhp7JoQI2_FTq6yj64GojEe8LHEJ9OjDaK9SyKaNKCCjlyU3_4XRzMmglg5faygPfHszEpx1VB0FO89CqPXPMzSA__c15OHiRq4_Y9-IxgoPFRgI_dkRrYBtLA42DnfVOacQjncZn_OLVOh?key=ZPubRx_M7ILc5Lf3Mnb69w

Based on the workflow by eesahe: https://www.reddit.com/r/StableDiffusion/comments/1euz2a9/union_flux_controlnet_running_on_comfyui_workflow/

Drag and drop the .json into your ComfyUI Interface.

Go to ComfyUI Manager > Install missing custom nodes > install all of them > Restart ComfyUI

This should install “ComfyUI-eesahesNodes” from ComfyUI manager (contains InstantXFluxUnionControlNetLoader)

IMPORTANT: You need a really good GPU for this! 24GB Vram recommended!

1. MODEL https://huggingface.co/black-forest-labs/FLUX.1-dev/tree/main

   flux1-dev.safetensors or https://huggingface.co/black-forest-labs/FLUX.1-schnell/tree/main

   📁 ComfyUI_windows_portable\ComfyUI\models\unet

2. CLIP  https://huggingface.co/comfyanonymous/flux_text_encoders/blob/main/clip_l.safetensors

   and

   https://huggingface.co/comfyanonymous/flux_text_encoders/blob/main/t5xxl_fp16.safetensors

   📁 ComfyUI_windows_portable\ComfyUI\models\clip

3. VAE https://huggingface.co/black-forest-labs/FLUX.1-schnell/blob/main/ae.safetensors

   📁 ComfyUI_windows_portable\ComfyUI\models\vae

4. CONTROLNET MODEL: https://huggingface.co/xinsir/controlnet-union-sdxl-1.0

   📁 ComfyUI_windows_portable\ComfyUI\models\controlnet\flux

5. UPSCALE MODEL: https://openmodeldb.info/models/4x-ClearRealityV1

   📁 \ComfyUI_windows_portable\ComfyUI\models\upscale_models