The first book series I loved was The Cloakmaster Cycle set in the D&D world of Spelljammer. This was made while thinking of the half man half hippo Gamji.
Other versions:
The first book series I loved was The Cloakmaster Cycle set in the D&D world of Spelljammer. This was made while thinking of the half man half hippo Gamji.
Other versions:
This is really cool! Can you tell a bit more about your prompting methods and models?
Thank you! When I get home tonight I’ll type it up. It was a combination of inpainting, image to image, and using three models I tried together in Stable Diffusion.
That’d be very helpful, I’m looking to start using stable diffusion for dnd purposes, but my results vary in quality haha
I haven’t had time to open up the laptop to get my prompt but here is the rest.
The model is three models joined together in Stable Diffusion: JuggernautXL_v8, animagineXLV3_v30, and digitalLife_v12
I googled for photos of traditional pirate ships and used that in image to image so Stable Diffusion would have a base to work from. It helps reduce getting random weirdness when you’re trying to do something it’s not trained for. In this case when I wanted a pirate ship in space it would give me a boat in water or a spaceship, but image to image helped it get closer to what I wanted but as you can see all but one had some sort of land and they all still had water.
In the negative prompt I typed water 20+ times which got rid of the water but still had land. In the top two images I then used inpainting to paint out the land and used different prompts and iterations until I got something I liked. The title image worked out the best but I think I went through 24 version, 8 at a time (the max versions in SD).
To do the inpainting instead of a mouse I use a Kamvas 16 Pro. I spent $450 on it and I also draw and paint with it.
Does that help?
That definitely helps! Thanks for writing it up, highly appreciate it. I didn’t even know repeating negative prompts had an effect haha. I just started with screwing around with sdxl, and made some very basic stuff, but I’ve yet to try changing it up with inpainting. But the img2img trick, I’m definitely gonna try. Thanks again!
You’re welcome! And for the repeating there is a better way to do weights that I have yet to figure out. This is my back yard way of doing weights. Whenever I’m trying to get a result that isn’t showing up or showing like I want I’ll try repeating that specific thing multiple times to get it. Sometimes I’ve had to have it in there 20+ times to get the result I want.