(Page 1 of 1 pages for this article )

Filed under: GentryMedia Sister Sites •ProVideo Coalition •Motion Graphics •NAB 2011 •Visual Effects •

Updated: Adobe Warp Stabilizer (P)Review

As noted earlier this week, Adobe TV posted a video - attached to the top of this post - that previews a new technology called the Warp Stabilizer. I’ve had a chance to work with a pre-release version of the Warp Stabilizer, and Adobe kindly gave me permission to pass along some of my experiences.

The Warp Stabilizer is an effect that is applied to a layer in an After Effects composition. Upon doing so, it immediately starts analyzing the underlying clip, internally assigning a “cloud” of tracking points as seen in the attached video that distinguish between foreground and background motion. This one-time analysis takes several seconds depending on the size and length of the clip; happily, it processes in the background so you can continue to get other work done on other layers or in other compositions. This is followed by a much quicker Stabilize pass (which is repeated if you make certain changes to the stabilization parameters).

If you do nothing else at this point, the result is a smoothed-out camera movement, automatically scaled up and re-centered to fill the original frame. A single slider allows you to dial in the amount of stiffness or looseness in the resulting camera move (scaling and centering will be automatically adjusted accordingly); a simple popup allows you to switch between smoothed motion and a completely locked-off camera where the identified foreground does not move. This gives the Warp Stabilizer a high “instant gratification” factor for those in hurry, or who just want to quickly raise the production value of less-than-professional footage they’ve been handed.

There is a fair amount of tweakability available as well. For instance, you can switch the type of stabilization from just position through corner pinning to a “warp” mode where the foreground and background are treated differently in an attempt to reduce issues with parallax shift and the such. You can also change how the edges of the original clip are treated, including a few different scaling options, crop or no crop, and a very nice wrinkle called Synthesize Edges: This keeps the clip at its original 100% scale, and looks earlier and later in time for frames where it can borrow image information to fill out any missing pixels along the edges (think automatic cloning brush that works across time). Additional parameters give control over how these pixels are found and blended in with the original image.

If you’ve watched the video above, you also no doubt noted that Warp Stabilizer also includes rolling shutter reduction, reducing issues that arise with some cameras (such as HDSLRs) where the image sensor is scanned over a period of time rather than all at once, causing “jellocam” effects if the camera or action moves too much during a single frame.

The Warp Stabilizer works amazingly well on a wide variety of clips. That said, I have been able to trip up the Warp Stabilizer with clips where it’s the background rather than foreground which needs to be stabilized (such as tracking dots on a stage with actors moving about in front) or where there are focus issues with the original clip; you can work around this by masking out the offending action, stabilizing what’s left, and then turning off the masks or mattes to reveal the entire original clip - I’ll be elaborating on this workflow in the near future. The other potential downside is that the warp stabilization process is not currently reversible - a requirement for some visual effects work. If you need this, the old Stabilizer is still around; now it’s just considered a Track Type when you choose to Track Motion.

For those who like to know more about how a technology works under the hood, in the Comments below Karl Soule of Adobe has provided links to a video and paper that the Warp Stabilizer grew out of. Also, the Warp Stabilizer is one of the subjects I will be covering Tuesday morning April 12 at NAB’s Post|Production World as part of my advanced rotoscoping and tracking session (along with the After Effects Roto Brush, Imagineer’s mocha plus mocha shape, and The Foundry’s CameraTracker). I will be joined by David Simons of Adobe’s Advanced Product Development team, who worked on both the Warp Stabilizer and Roto Brush. Stay tuned…

The content contained in our books, videos, blogs, and articles for other sites are all copyright Crish Design, except where otherwise attributed.

(Page 1 of 1 pages for this article )

                   

 

Orad News and Products from NAB 2012 Jeremiah Karpowicz | 05/18 Learn about what we discovered when we stopped by the Orad booth Shaun Dail from Orad took the time to tell us about what they had to show and talk about at NAB 2012. He tells us about TD Control, a sports specific MAM system as well as their…

NAB 2012: Assorted Snapshots Adam Wilt | 05/08 A few cool things I saw at the show that didn’t fit into any other articles. NAB is too big a show in too short a time to see more than a fraction of it. I’ve covered a few things in some depth (as have other PVC folks), but there’s plenty more that slips by without proper coverage. Here, I have a few photos…

After Effects Apprentice Free Video: Working with Nested 3D Compositions Chris and Trish Meyer | 05/07 How you can be two places at once inside After Effects As we mentioned awhile back, we’ve been busy the past year and a half creating an extensive, multi-course video training…

You must be registered to comment. This is an effort to reduce spam. Please REGISTER HERE.

This feature is already done exceptionally by Mocha for AE which is included with CS5. And Mocha not only stabilizes but object tracks and rotoscopes. It seems Adobe could have come up with something more original and not redundant of existing software.

Posted by Tom Daigon  on  04/05  at  02:16 PM

---

I know mocha; I like mocha; this is not mocha. For one, mocha can track or stabilize, but the version that comes bundled with After Effects cannot synthesize a new smoothed-out camera movement based on internal tracking data. mocha also does not do rolling shutter artifact reduction. (Although mocha does a lot - like mattes for roto etc. - that this does not do.)

I imagine more will be revealed at NAB…

Posted by Chris Meyer  on  04/05  at  02:55 PM

---

At Mamo World

http://www.mamoworld.com/index.php?option=com_content&view=article&id=96:tutorial-stabilize-motion-without-the-need-to-zoom-in&catid=35:tutorials&Itemid=62&lang=en

there is a tutorial that actually utilizes the data (imported by Mochaimport - a wonderful adjunct to Mocha for AE) to smooth out the stabilization.
It isnt a “push one button” solution but it uses a smooth expression to achieve this result. It does not address rolling shutter however.

Posted by Tom Daigon  on  04/05  at  03:06 PM

---

There’s another video (from several years ago) that explains the technology a little more in-depth. This was from Siggraph 2008, so this technology has been cooking in the labs for quite a while:

http://www.youtube.com/watch?v=3TlCGh5Pc90

Posted by .(JavaScript must be enabled to view this email address)  on  04/05  at  03:36 PM

---

Make that 2009. (slip of the keyboard!)

Posted by .(JavaScript must be enabled to view this email address)  on  04/05  at  03:44 PM

---

Here’s the latest academic paper on Warp subspace Stabilization:

http://web.cecs.pdx.edu/~fliu/project/subspace_stabilization/index.htm

Posted by .(JavaScript must be enabled to view this email address)  on  04/05  at  04:46 PM

---

Sounds great. Hope it’s they will add this to AE CS5, not release with CS6…

by the way, this is a link to a software that does that:

zjucvg.net/acts/acts.html

Unfortunately it only import/export image sequences, so it takes a few more steps. The quality is much better than any 2D stabilizer I’ve worked with.

Posted by Ivan Oliveira  on  04/07  at  04:19 AM

---

I’m not sure what this really gives in terms of final results over what is already available? Stabilising handheld shots I have found never gives good results for one very good reason. All these software stabilisers are great at smoothing out the motion, but they cannot get rid of motion blur as a result of the shaky camerawork itself.

So although you end up with a smoothed out shot, you always end up still seeing the motion blur as a result of the original shaky camera movement.

Posted by Simon Wyndham  on  04/07  at  05:05 AM

---

Name:

Email:

Location:

URL:

Smileys

Remember my personal information

Notify me of follow-up comments?

Submit the word you see below: