August 6th, 2024

What Is Rotoscope Animation? The Process Explained (2020)

Rotoscope animation, tracing live-action footage frame by frame, was popularized by Max Fleischer. Modern techniques use software, with innovations like Bob Sabiston's "interpolated rotoscoping" enhancing efficiency in filmmaking.

Read original articleLink Icon
What Is Rotoscope Animation? The Process Explained (2020)

Rotoscope animation is a technique that involves tracing over live-action footage frame by frame to create animated sequences. This method, which dates back to the late 19th century, was popularized by animator Max Fleischer, who used it to enhance the fluidity of character movements in his works. Initially, animators would project live-action images onto a glass panel for tracing, but modern rotoscoping is primarily done using computer software. The technique has been utilized in various films, including Disney classics like "Snow White and the Seven Dwarfs" and contemporary works such as "A Scanner Darkly" and the Amazon series "Undone." Rotoscoping has also been applied in live-action films to create special effects, such as the lightsabers in "Star Wars." The process has evolved with advancements in technology, notably through Bob Sabiston's development of "interpolated rotoscoping," which allows for more efficient animation by reusing traced figures across different frames. This innovation has made rotoscoping more accessible and has contributed to its continued use in modern filmmaking.

- Rotoscoping involves tracing live-action footage to create animation.

- The technique was popularized by Max Fleischer in the early 20th century.

- It has been used in both animated and live-action films for special effects.

- Modern rotoscoping is primarily done using computer software.

- Bob Sabiston's "interpolated rotoscoping" has improved the efficiency of the process.

Link Icon 12 comments
By @KaiserPro - 6 months
One thing that they kind gloss over is that rotoscoping is used a lot in films to separate objects.

For example, I did an exam on prince caspian (https://eu.southcoasttoday.com/story/entertainment/local/200...) to separate his hair from the forest. They didn't have green screen, and even if they did, it would obliterate his hair. (hair is translucent so glows green, and is removed by the software.)

I failed the rotoscoping part, but passed the painting section (where you remove markers, crew or other features not wanted in the final image.)

Whilst "a scanner darkly" is a brilliant example of rotoscoping, its not the example. if you look at this showreel towards the end you see captain marvel, https://www.youtube.com/watch?v=_sYWzFNobEo look at her hair, every individual wisp of hair that extends past her neck is individually masked out.

Good rotoscoping is often the building block of "expensive" looking VFX.

For computer vision its also important so you can get ground truth on tracking various object and training models like segment anything

By @walterbell - 6 months
https://www.framefounder.com/unveiling-the-secrets-of-rotosc...

> Rotoscoping is the process of tracing over live-action footage frame-by-frame to create accurate and detailed mattes or masks.. ensuring a seamless blend between the foreground and background.. requires a keen eye for detail and patience, as it can be a time-consuming process.. Rotoscoping plays a crucial role in integrating visual effects seamlessly into live-action footage. Artists meticulously trace elements like explosions, fire, or magical effects to match the movements and perspectives of the scene. This process ensures the VFX elements appear natural and believably interact with the real-world elements.

Feb 2024, https://arxiv.org/abs/2402.09883

> ..automatically synthetise retro-style 2D animations from videos. The method approaches the challenge mainly as an object segmentation and tracking problem. Video frames are processed with the Segment Anything Model (SAM) and the resulting masks are tracked through subsequent frames with DeAOT, a method of hierarchical propagation for semi-supervised video object segmentation. The geometry of the masks' contours is simplified with the Douglas-Peucker algorithm. Finally, facial traits, pixelation and a basic shadow effect can be optionally added. The results show that the method exhibits an excellent temporal consistency and can correctly process videos with different poses and appearances, dynamic shots, partial shots and diverse backgrounds.

Apr 2023, [SAM 1] "Segment Anything Model and the hard problems of computer vision", 52 comments, https://news.ycombinator.com/item?id=35558522

Jul 2024, "SAM 2: Segment Anything in Images and Videos", 147 comments, https://news.ycombinator.com/item?id=41104523

By @hinkley - 6 months
It’s a new take on what we called a camera lucida, which was a trick with optics that let you superimpose a scene over your view of a piece of paper. You could get the proportions right and then do your magic with color and technique. Not unlike how animators work.

If you’ve seen anything on animation prior to computers you’ve seen the classic technique of putting one sheet of cello over the last thing you drew and flipping between them to copy the shared details before changing tone thing for the next frame.

By @JoeDaDude - 6 months
Rotoscopeing in anime examples.

Flowers of Evil https://www.youtube.com/watch?v=Toc9x19Cmkg

Kaguya-sama Love is War scene: https://www.youtube.com/watch?v=Toc9x19Cmkg

By @tehnub - 6 months
There's a new rotoscoped anime I'm excited to see when it comes to theaters called Ghost Cat Anzu: https://twitter.com/catsuka/status/1811679957568880688.
By @devindotcom - 6 months
Rotoscoping is great but pretty labor intensive and not really creative in itself, though it can obviously be part of a very creative process. That makes it a perfect candidate for AI/ML tools to accelerate and I hope they do (or rather I hope they continue to). Tons of animators and filmmakers love the roto look but don't want to deal with the roto process. Get the outlines and motion tracking done 90% with the AI and everyone can focus on the important stuff.
By @gumby - 6 months
The wikipedia entry on rotoscoping explains the process more compactly and succinctly. https://en.wikipedia.org/wiki/Rotoscoping
By @dang - 6 months
Related. Others?

Rotoscoped Animation of Filmed Parkour - https://news.ycombinator.com/item?id=12380112 - Aug 2016 (49 comments)

By @zoklet-enjoyer - 6 months
Joel Haver has a lot of great rotoscope videos https://youtu.be/tq_KOmXyVDo
By @erichocean - 6 months
No mention of Fire & Ice.
By @pazimzadeh - 6 months
that's how lightsaber effects were done in the original trilogy
By @siamese_puff - 6 months
A cool Keanu Reeves film employs this in A Scanner Darkly.