Check point Model Juggling

As I frequently switch between different models to generate images, I occasionally make mistakes by forgetting to adjust some settings after changing models.


For example, when generating images with the Pony model, I use the Pony hand LoRA for inpainting hands. However, after switching to the ilxl model, I sometimes mistakenly continue applying the Pony hand LoRA without making adjustments.








Ilxl model (neonCityBlend_ncbIllustriousXL).

 If you look closely at the hands, you can see subtle differences in the art style. (The checkpoint model is for 2D, but the hands appear semi-realistic)


This was created with the Pony Hand LoRA ({lora:pony_good_hands:0.9|lora:detailed_hands:0.9}) applied. 

(Since it was set up using a wildcard, it's unclear which one was actually used.)







So here is my theory


For semi-realistic images generated using Stable Diffusion 1.5, where the depiction of hands is unsatisfactory, wouldn't it be effective to improve the results by inpainting with the ilxl checkpoint and applying the Pony hand LoRA?




The image below was created on 23.09.12 using meichidarkMIX v3.8




Inpainting with check point model : vauxzMerge25D3D_illuVSara 


Prompt :

photo of delicate hand, bare_hand, good_hands, {<lora:pony_good_hands:0.9>|<lora:detailed_hands:0.9>}


NEGATIVE_HANDS, finger_ring, accessories, mutated, extra finger, fused fingers, missing finger





Some additional edits are needed, but...


If we focus on the naturalness of the colors, this is more natural compared to the methods I’ve tried before.






Before Inpaint





After inpaint


Not bad.






How about realistic image?


Before inpainting






After inpainting


......Noticeable.








Before inpainting






After inpainting


Skin tone is still noticeable. And the left hand is weird.

......


Comments

Popular posts from this blog

Solved: Facial Errors in Stable Diffusion Pony Models

Some of results (character full images)

Todays simple discovery (uncannyValley_ilxl10Noob)