Experiment 1 - Orb Animation

Overview

Original Orb Animation

In Blender, I rendered an animation of an orb with particles moving around inside.

3D Orb Animation Render

It seemed like a great video for experimenting with various AI tools. Here's a summary of my journey and findings:

Runway

I started by testing the video in Runway, trying different materials to see what results it could generate. However, some of the outputs were far from ideal, and unfortunately, I ran out of credits before being able to test further. Still, I plan to revisit it for improved results if I can.

Note on Still Images: Using a still image from the original animation produced notably better results in both Runway and Minimax. This was an important takeaway that shaped the rest of my experiment. However, by the time I uploaded these videos Runway's Video 2 Video model vastly improved. A month makes a world of difference when it comes to what can be produced with AI.

Runway Result

Minimax

Minimax produced some fascinating results when working with the orb animation. Its advanced algorithms enhanced specific details, such as particle motion and the glow of the orb, creating a more dynamic and visually appealing output.

Minimax Result

ChatGPT

Since ChatGPT doesn’t support video-to-video conversion, I instead used it to generate a prompt based on my original video. Surprisingly, it produced a good starting prompt, which I then entered into Midjourney.

Kling

Kling delivered impressive results in terms of stylization. Its unique approach to visual textures and dynamic effects brought a fresh perspective to the orb animation, creating a dreamy and artistic environment.

Kling Result

Midjourney

The initial output from Midjourney was intriguing but didn't fully capture the environment I envisioned within the orb. However, by refining the prompt and adding a few keywords, I achieved results that were closer to my vision.

Key Takeaways