Articles, Blog

#ProjectSmoothOperator: Adobe MAX 2018 (Sneak Peek) | Adobe Creative Cloud

September 3, 2019


Working with video
can be a little difficult, even the most basic tasks. So, I think this is
a really cool tool. Nicola Win Tsin is here with me to tell you
about Project Smooth Operator. Give him a warm welcome. ♪ Smooth operator ♪ -♪ Smooth operator ♪♪
-Thank you. Hi, everyone,
how’s everybody doing? (cheering) Good, I’m super excited
to be here. I’m also a little nervous
so bear with me. So I want to start
by showing you something. It’s an aerial shot of a car
driving through the desert. It’s a really beautiful shot,
isn’t it? Here’s the thing, though. When I try to publish this
to Instagram Stories, this is what I get. The car comes into view
and then immediately disappears. What’s happening
is that Instagram Stories expects a vertical video, but we give it a horizontal one, and so it kept the center,
discarded the sides, and this is what
we’re left with. The car’s only visible
for a couple seconds before it vanishes. It’s not that great. To make this right,
I have to go into Premiere and manually adjust things using
key frames and all that stuff. But that’s a lot of work. What if, instead,
we could identify the action and just follow it? This is what
Project Smooth Operator does. So I’m processing
the same video here, and the bright part
that you see that is currently shifting
to the left with the car, it’s our crop, it’s what
makes it to the final output. What’s happening is that Sensei
is analyzing the video to determine
the most important regions to include
in the final output. And once processing is done, this is the result. (cheering, applause) Thank you. The car stays in frame. The output
is still vertical, but we preserved the original
content of the video. All right, let me show you
another example of turning a horizontal video
into a vertical one. This is an action shot
of a skier doing a backflip. It’s really impressive, so we want to make sure
we capture this properly. And now that processing is done,
here’s the result. It’s nice, right? (cheering, applause) Wow. It feels very natural, although under the hood the crop
is swaying left and right to really follow the skier
and capture that backflip 180. All right. Now, we all have videos
on our phones that might be cool enough
to post if things were in view, but maybe not important enough that we would edit them
in Premiere. This is a video
of my co-worker, Allison, playing with her dog
in the park. Now I want you to take
a second here to really appreciate
what Sensei is doing for you. This is a video with
multiple important regions. The crop switches between
Allison and the dog, and performs
this natural panning to include both
in the final output. (applause) And, so, we don’t miss out
on any important moments like Allison
throwing the Frisbee or the dog catching
the Frisbee. All right, let me show you
one more example. This one is more extreme. It’s a skydiving video. It’s a really fast-paced video
with a lot of action, with multiple people
weaving in and out of frame, the camera comes close
and goes far again, and it even goes upside down
several times. Again, Sensei identifies
the salient regions and seamlessly shifts the crop
to include and retain the most essential parts
of the video. And after processing,
this is what we get. (applause) Yeah. Thank you. The output, this time
we did one to one, so the output is square. And as you can see, we retained all the action
in the video. With Project Smooth Operator, you can focus on jumping
and not dying. We’ll take care of making sure
everyone makes it to the final video. Thank you. Good stuff. Thank you, Nico.

9 Comments

  • Reply jmalmsten October 17, 2018 at 6:09 pm

    So… Automated Pan Scan? The cineast in me has horror flashbacks to the age of VHS conversions of cinemascope films… Shudders

  • Reply Jimmy Flanagan October 17, 2018 at 6:23 pm

    Useless like Instagram.

  • Reply eliluong October 18, 2018 at 5:18 am

    only uses command line

  • Reply Michael Henry October 18, 2018 at 5:33 pm

    Awesome. Can't wait for this to exist!

  • Reply Raccoon October 18, 2018 at 7:36 pm

    They need to get rid of the celebs, year in and year out, they sit there awkwardly trying to make the content more exciting. This is a nerd conference. How about putting designers up there who will actually ask questions…such cringe.

  • Reply Pedro Marinho October 20, 2018 at 11:01 am

    Funny how Instagram shaped an entire Adobe tool to fuel people's desire to share videos.

  • Reply : jiaan November 9, 2018 at 8:09 am

    i see phyton

  • Reply Jan Huang December 21, 2018 at 11:34 pm

    This is great!!! I will watch it again!

  • Reply Sophia Anastasiou April 8, 2019 at 4:42 pm

    This woman is very annoying through the whole sneak peek series! I wish they used all these new tools to cut her out.

  • Leave a Reply