Stable Diffusion v2.0 and Prompts

Stable Diffusion v2.0 and Prompts

Stable Diffusion v2.0 and prompts

The update brings improvements to SD’s text-to-image diffusion models, includes a powerful image upscaler, updates its Inpainting model, and more.

Also it appears to have made massive updates to the prompting system comparing Stable diffusion v1.4 to v2 gives pretty vast differences. They produced a prompts guide which was online but seems to have disappeared?

But irritatingly it can’t be downloaded as a .pdf, me being a massive nerd said f**k that and used python to pull the svgs and created a pdf.

Here are a few examples of how different things can get

So here are a few examples with the relevant seeds and prompts to show you how dramatically things have changed.   Also, it should be mentioned a lot of celebrities have been removed from the model, NSFW images and famous artists like Rutkowski have been purged due to complaints of their style being essentially stolen by the machine.

What has been removed from Stable Diffusion’s training data, though, is nude and pornographic images. AI image generators are already being used to generate NSFW output, including both photorealistic and anime-style pictures. However, these models can also be used to generate NSFW imagery resembling specific individuals (known as non-consensual pornography) and images of child abuse.

Of course, there are a lot of angry Incels now wailing about censorship. This is bullshit, this stuff is open-source. No doubt a horde of horny teenagers are using PornHub and other sites to train NSFW models. 

Prompt: Gandalf, d & d, fantasy, intricate, elegant, highly detailed, digital painting, artstation, concept art, matte, sharp focus, illustration, hearthstone, art by artgerm and greg rutkowski and alphonse mucha
Negative prompt: cartoon, 3d, ugly face, (disfigured), (bad art), (deformed), (poorly drawn), (extra limbs), strange colours, blurry, boring, sketch, lacklustre, repetitive, cropped, hands

Steps: 60, Sampler: DDIM, CFG scale: 12, Seed: 1940895508, Face restoration: GFPGAN, Size: 512×512, Model hash: 7460a6fa, Batch size: 6, Batch pos: 0

gandalf, d & d, fantasy, intricate, elegant, highly detailed, digital painting, artstation, concept art, matte, sharp focus, illustration, hearthstone, art by artgerm and greg rutkowski and alphonse mucha<br />
Negative prompt: cartoon, 3d, ugly face, (disfigured), (bad art), (deformed), (poorly drawn), (extra limbs), strange colours, blurry, boring, sketch, lacklustre, repetitive, cropped, hands<br />
Steps: 60, Sampler: DDIM, CFG scale: 12, Seed: 1940895508, Face restoration: GFPGAN, Size: 512x512, Model hash: 7460a6fa, Batch size: 6, Batch pos: 0

Stable Diffusion 1.4

gandalf, d & d, fantasy, intricate, elegant, highly detailed, digital painting, artstation, concept art, matte, sharp focus, illustration, hearthstone, art by artgerm and greg rutkowski and alphonse mucha<br />
Negative prompt: cartoon, 3d, ugly face, (disfigured), (bad art), (deformed), (poorly drawn), (extra limbs), strange colours, blurry, boring, sketch, lacklustre, repetitive, cropped, hands<br />
Steps: 60, Sampler: DDIM, CFG scale: 12, Seed: 1940895508, Face restoration: GFPGAN, Size: 512x512, Model hash: 7460a6fa, Batch size: 6, Batch pos: 0

Stable Diffusion 2.0

Prompt: Portrait digital art of Bill Murray from Scrooged (Arcane). wearing a suit, Christmas,

Negative prompt: cartoon, 3d, ugly face, (disfigured), (bad art), (deformed), (poorly drawn), (extra limbs), strange colours, blurry, boring, sketch, lacklustre, repetitive, cropped, hands

Steps: 40, Sampler: DDIM, CFG scale: 13, Seed: 3408805356, Face restoration: GFPGAN, Size: 512×512, Model hash: 7460a6fa, Batch size: 6, Batch pos: 0

Portrait digital art of Bill Murray from Scrooged (Arcane). wearing a suit, Christmas,

Stable Diffusion 1.4

Portrait digital art of Bill Murray from Scrooged (Arcane). wearing a suit, Christmas,<br />
Negative prompt: cartoon, 3d, ugly face, (disfigured), (bad art), (deformed), (poorly drawn), (extra limbs), strange colours, blurry, boring, sketch, lacklustre, repetitive, cropped, hands<br />
Steps: 40, Sampler: DDIM, CFG scale: 13, Seed: 3408805360, Face restoration: GFPGAN, Size: 512x512, Model hash: 09dd2ae4, Batch size: 6, Batch pos: 4

Stable Diffusion 2.0

What’s next

I’ve started writing up how the Stable-Diffusion WebUI works and will probably wite up how to scrape a google SVG slideshow.  

A man lying on a hill looking through a rifle scope

A man lying on a hill looking through a rifle scope

Author’s note: Following the Neil Gaiman Master Class series, he offers the following exercise. Take one of the simple settings below and write a page about it, trying to undermine the reader’s expectations. For example, you’re writing about a man at a party who is talking to a beautiful woman. What he wants is probably obvious. Try to lead the reader in a different direction by not revealing his desire upfront, or by revealing a surprising motivation.

  1. A man lying on a hill looking through a rifle scope
  2. A couple in wedding outfits riding in a car
  3. A child raking a sandbox next to his nanny
  4. Two old women sitting on a bench with knitting needles and yarn
  5. A teenage girl climbing a rock cliff with a man below her
Vidmulia

The sun beat down relentlessly on the hilltop, this was not the desert, but even England can occasionally throw a scorching tantrum of a day at its residents. The small corpses of trees on the hilltop offered little in the way of shade and more in the way of a home for seemingly millions of biting insects that perpetually seemed to attack the prone form lying there. From a distance, he looked like nothing more than another browning bush amongst the trees. It would take a seasoned expert in the woods and a very close range to pick out the inconsistencies that marked his presence. He would appear if one saw his face as hardened to the sun as to the hardships that swarmed around him. 

A rifle was laid out before him, the long barrel covered and intertwined with underbrush, it’s matt finish doesn’t allow the sunlight to reflect off into the distance and dark draped fabric hid the lens for the same reason. Despite the stifling conditions, the bugs and distractions. The man has his eyes locked on the tiny scope gently adjusting his position in incremental tiny movements his deep steady breathing was relaxed as if he were dozing on a beach in Bali. 

On the other end of the lens, the young boy playing in the garden appeared as the complete opposite to the hard lines of the craggy onlooker. He beamed a beatific smile while running around the garden in ever-increasing circles, at this range any sound is impossible, yet the man can see the mouth opening and closing, a one-sided rapid-fire diatribe from the boy at his mother lying nearby on the recliner. He holds out his arms like a plane and seems to glide across the garden like a fighter jet across a green lawn sky.

The steady breath hitches a fraction. The rifleman’s concentration falters at the image before him, his steady movements jerk. But he brings his focus back, forces his breathing to return to its steady cadence. Tracking the boy, back and forth, back and forth across the lawn. He’s never felt conflicted about the missions he’s been on, the things he’s been asked to do but lying here, staring at this child he feels a cold knot forming in his guts. What if they were wrong, what if this wasn’t the time or the place. The sweat trickling down his face made him blink furiously for a moment. He slowly brought down the fabric bandana cinching it over his eye ensuring that no more perspiration could distract him. Sloppy, he chastises himself. His eyes flick to the digital readout in the soil near him. Only 20 seconds remaining until death

The child has stopped running and is now lying on the grass alternately making angel wings in the grass and reaching his hand out to the clouds as if he could grasp them from the sky. The rifleman listens attentively to the AI spotter in his ear, his entire mind and body completely focussed. His hands smoothly guide the rifle up and to the left, counting down to 11 he expels his breath slowly and at the exact moment of emptiness gently squeezes the trigger. The rifle coughs, the projectile rocketing out from the magnetically charged rails at a specially calibrated speed so that it doesn’t set the air on fire by its passage. 

The scope snaps back immediately to the boy who remains in place, lying on his back considering the clouds, but now the scene has started to change, the smile slowly fades and a confused started to erase his smile. His face twitching, eyes blinking. A look of startled pain crossing across his face. The rifleman holds his breath tension locking his body in place, waiting to see if he has succeeded or failed. The boy starts to convulse, arms and legs starting to thrash. The countdown in the man’s head drops down lower 5, 4, 3… 

The projectile slices through the distance shedding its ablative layers, the advanced materials inside using its adaptive surface to produce rudimentary aerofoils micro-adjusting to the target. The house, garden and child approach at an unimaginable speed. At a distance of fewer than 10 meters, the projectile’s internal mechanism activates unwrapping its outer skin like a flower slowing the whole thing down exponentially before allowing the more delicate internals of the device to be exposed to the air. The petals are angled so that the force of air rotates the device into a perfectly aimed corkscrew motion before plunging itself through the boy’s skin and delivering its internal payload into his bloodstream. 

The boy’s convulsing slows, the man notes the splash of red appears on the right upper thigh and feels his chest tightening from lack of breath. He waits, hands gripping the rifle stock until metal creaks. Then the boy’s mouth opens in silent wail unheard by the man but his breath explodes out at the same moment. The sobbing child runs, limping to his mother, the conversation can’t be heard no more than the dead bee that the child had been lying on could be seen from here. But that was irrelevant. He checked the timer -8 seconds from death time.  

He takes his time to ensure that the mission has succeeded and sent a single message via his implant. “Adrenaline delivered on schedule, target alive, awaiting new instructions.”  

122

What technologies should be used?

Initially due to budget constraints, space, health and safety issues, the initial community should focus purely on computer and IT technologies. These provide the most utility for the lowest costs.

As for software a primarily open source approach fits in line with an organisation trying to help the world and future generations without extending  the price tag.

As the community expands, gains members and space more labs and additional technologies can be integrated.

For the sake of expansion and diversity of members these labs should initially be multi-purpose.

116

What methods of teaching will be employed?

There are various themes in pedagogy that cater to different types of learner so classes should do their best to reflect these types in the classroom.

There should be a division between lectures and seminars/lab work, or theory and practice/debate. This means information is distributed en mass initally and the discussed in smaller groups for clarification.

As stated earlier (e8) students who are proficient in a topic, mitosis for example, should be able to help assist teaching those of a lower level covering that subject. By explaining a topic one comes to understand it better.

Each high level student will have a mentor he can refer or defer to in times of need and have dialogues with. A mentor must be at least a number of grades above the student.

E-learning will be progressively worked on as will videos created to explain all topics in the subject, complete with questions to assess comprehension and open questions that students might consider writing experiments for, contemplate on or engage in dialogue about.

New methodologies of teaching should constantly be assessed and debated. Also all new members should have some exposure to teaching seminars and lectures [not just participating].

[Note: In the years since I’ve written this the rise of MOOC’s and available resources for learning everything from code to languages has exploded across the internet, in this case these give the community nearly all the material required to created an extremely nuanced hierarchy of grades without lifting a finger. However, all free open projects should be given as much support as possible via the community to continually help and improve their services. I know these initial thoughts were written on buses and trains around town, each one of them could be the basis of whole books in themselves, however the good news is there is a huge wellspring of available resources now to help any community member learn an incredible amount even if they are the first in the community to express an interest in the field.]

 

114

What methods will be used to monitor and decide the continuation of projects or research?

Some channels of research can take a long time to prove, disprove or found to be impossible or pointless. If time is the only issue this should not be considered an issue. Members have left the normal way of living to exist in a place of study and research, if they wish to spend 30 years of their life investing, time and effort into a theory it is their choice. However, should a commanding piece of evidence occur to completely negate their work or through its success make other other projects redundant the research / product is subject to review. Regular meetings and conferences should be organised meetings and conferences should be created where peers can discuss informally or to an audience the trials and results of their research all research and results are posted automatically online to the community and after the study is completed to the world for peer review.

All studies should be part of an open peer review service held within an extremely searchable format allowing people to quickly find relevant studies or similar experiments in the same area. These studies can subsequently linked to by on-line writers to show references the critiques of the paper, similar studies that have the same conclusion papers that have alternative or conflicting results.

The only significant barrier to continuing or starting research then is capital and the cost of obtaining the necessary equipment or tests (a CERN sized LHC is hard to find). In such cases it will depend of the size of the community, the R&D teams within the community and the importance of the research.