Regional Prompter with Stable Diffusion

2 min read

Deviation Actions

GymDreams's avatar
By
Published:
3.2K Views
Region-01-001

Have you ever wondered why so many images generated with AI feature a single person? Are you disappointed to find that AI generated couples often look like twins? There’s a reason for that.



Text-to-image engines can’t natively know which part of the text prompt belongs to each person. So when you asked for different outfits for each of your characters, they often mix everything together. Midjourney is one such engine. A follower asked me why I don’t post images of couples often. That’s because I have to generate 100+ images and hope that the RNG gods will bless me with 5 usable images.



Regional Prompter was created to deal with this issue. You can divide the canvas into regions, then individually prompt for things which don’t collide. The two sets before this show the results.



2-3



I divided the canvas into two regions horizontally (1:1) and prompt individually. To show that the AI was not simply associating proper attire with the expected age group, I swapped the clothes.

Region-01-002
Region-01-003

4



You can define base and common regions that make interesting results. For example, here I divided into two regions, but asked for 3 men. It creates an image with 3 men with a progression of age, hair color, and clothing.

Region-01-004

5



If you asked for two men, the split goes all the way through! Try doing this with just txt2img and you know that this is impossible, or at least very difficult.

Region-01-005

6-8



You can get creative and split a single person to look different for different regions.

Region-01-006
Region-01-007
Region-01-008

9-10



Consistency and productivity. Prayers to RNGods not required.

Region-01-009
Region-01-010

Text prompts in Stable Diffusion with Regional Prompter. Source image as is. No upscaling, no post-processing, no in-painting. The results are really that good!



  • Model: A-Zovya Photoreal v1 Ultra

  • Sampler: DPM++ 2M Karras

  • Res: 512x512

  • Steps: 30

  • Control Net: None

  • Regional Prompter: Horizontal 1,1, varying base ratio (0.2-0.5) depending on image



Note: Actual implementation uses 0-based region IDs.





Image Sets



I haven’t posted these images to DeviantArt because it feels spammy, as these are process images to demonstrate the workflow, but if you think that they’re helpful, I will consider posting some here.





Resources



Created using AI tools
© 2023 - 2025 GymDreams
Comments0
anonymous's avatar
Join the community to add your comment. Already a deviant? Log In