Poor Man's Animation | Jack Of Ai Trades

There are a lot of different ways to create animation with the help of AI, but the one that gives good results often require a paid subscription or a high end graphic card. There are some ways to achieve at least simpler animations of high quality that doesn’t require a subscription or expensive equipment. I call it poor man’s animation.

Both the visual and the audio in the video above is created with AI.

Create animated videos with poor man’s animation

You will need this:

Stable Diffusion and some kind of UI (I have been using Forge but Comfy will most likely work as well)

Some kind of creative base image and the seed and settings used to create it

Flowframes or some other interpolation software

Patience

Creating a longer animation takes a lot of time, so for this purpose I will only create a shorter one. But the principle are the same for longer animations.

My starting image has the following prompts

Prompt:

A raw photo of a group of  musical notes standing in a forest with butterflies flying around them, all surrounded by fireflies, fireflies, (a horror story illustration), (dark fantasy art), scary, frightening, realistic, ethereal lighting, HD, highly detailed, bokeh, macro photography, artistic expression, immersive experience, expert technique, best quality

Negative prompt:

(people:1.5), (humans:1.5), (children:1.5), bad quality, low quality, blurry, worst quality, low quality, painting, 3D render, drawing, crayon, sketch, graphite, impressionist, cartoon, anime, noisy, blurry, soft, deformed, ugly, lowres, low details, JPEG artifacts, airbrushed, semi-realistic, CGI, render, Blender, digital art, manga, amateur

Seed: 1911748625

The next step is to create the same image over and over again, with only very small variations. This can be achieved by using XYZ-plot and changing CFG (or possibly the denoising) between each image. Always keep the same seed!

You can also add noise to the images by adding gibberish to the prompt. As an example the left image contains the original prompt and the right one contains this prompt:

A raw photo of a group of  musical notes standing in a forest with butterflies flying around them, all surrounded by fireflies, fireflies, (a horror story illustration), ---__77rfeEEfh999-__(dark fantasy art), scary, frightening, realistic, ethereal lighting, HD, highly detailed, bokeh, macro photography, artistic expression, immersive experience, expert technique, best quality 000000000000000000000000-----777eeef__gg

The more random letters and number, the more noise you will add to the image. If you plan on making a longer animation you will need a lot of images, and this is an alternative to create lots of images with small variations.

Using these techniques I have now created 26 images with variations. I think that will be enough for my short animation.

Next step is to sort the images according to their variations, and at the same time re-name them so they follow a sequence.

Now I have sorted the images in a way that I believe the animation will flow in a satisfactory way.

Next we will use Flowframes. In settings you want to check out these two specifically. The don’t delete temp folder setting means that after an interpolation you will have more images to work with. The fix scene changes makes it more sensitive to changes between images and will try to fill the gap.

Then you need to set which folder you have your images in, which folder should be your output folder and the settings of the interpolation. You can play around with these settings to find what works best for you.