Photoshop CS5's Showpiece — Content-Aware Fill 378
Barence writes "If you're looking for reasons to upgrade to Photoshop CS5 when it arrives, a new demo video might just persuade you. Narrated by Bryan O'Neil-Hughes, a product manager on the Photoshop team, the video shows the new content-aware fill tool, which has the potential to revolutionise the way you clean up photos. If you're not happy with an item in your picture, select it, delete it, and Photoshop will analyse the surrounding area and plug the gap as if it never existed."
Re:I for one (Score:1, Informative)
Content-aware fill is different from content-aware resizing. Content-aware fill is basically a clone brush that automatically decides how to make the cloned area match into its surroundings instead of just copying and pasting content.
Re:I for one (Score:4, Informative)
Re:I for one (Score:4, Informative)
Liquid rescale is an implementation of the Seam Carving technology which was incorporated into Photoshop CS4 as a feature titled Content Aware Scale.
This new feature comes from an algorithm titled PatchMatch which was presented at SIGGRAPH 2009:
http://www.cs.princeton.edu/gfx/pubs/Barnes_2009_PAR/index.php [princeton.edu]
Re:I for one (Score:3, Informative)
Welcome my "getting modded Insightful for not RTFA and spreading bullshit" overlords at Slashdot.
Content-aware scaling has been included in Photoshop since CS4.
But this is no scaling, it's filling. The first 3 minutes of the video are not so interesting (nothing one could not do with a clone stamp in 2 seconds), but the last 2 minutes are breath-taking.
GREYCstoration or liquidrescale don't even come close.
Re:Youtube video quality (Score:1, Informative)
I'm guessing you know very little about Photoshop. The one that he undid the first time was because he used the Healing Brush tool (which has been in PS for several versions now) to show how poorly the closest tool that Photoshop currently has would do the job. He then showed us how the Content Aware Fill Tool would do it. This was very clearly explained in the voiceover. Also, this isn't intended to be the only tool you use. He's showing us how far you can get by using the new tool. You'll still need to go through the image carefully and touch up edges here and there. But as a first step, to use the words of the Vice President, this is a big fucking deal!
Re:Watch the vid in the article (Score:3, Informative)
Nope not put you out of a job, just lower your wages to $8.95 an hour because monkeys can now do your job.
Welcome to what us in Photography have had to deal with. I just saw an AD on the TV for a mall photo studio that will give you 20 shots in their studio for $9.95. and 8X10 prints start at $4.95 each. Yes I know it's done by no talent kids or minimum wage people, but the average consumer does not know that. They still think that it's all in the cost of the equipment and has nothing to do with skill and experience.
Another youtube video about content-aware fill (Score:5, Informative)
Includes more detail about the algo
- Developed with researches at Princeton
- Demo'd at SIGGRAPH in Aug. 2009
- Old spot-healing tool tried to find one match for the hole; new tool copies multiple patches from the surrounding BG to fit into the hole, as well as finding & copying surrounding patterns
http://www.youtube.com/watch?v=S9vbHRcrbdQ&feature=related [youtube.com]
Gimp Resynth (Score:3, Informative)
That capability has been available for a while in the Gimp as part of the Resynth plugin:
http://www.logarithmic.net/pfh/resynthesizer [logarithmic.net]
It lets you resynthesize a texture, fill in a selection with surrounding content, and synthesize images "in the theme" of another image.
Re:Having watched the whole thing to the end... (Score:4, Informative)
A few days ago I was reading about some of the algorithms for doing this [ucla.edu], shown at Siggraph in recent years. I think it's real.
Re:Damn..... (Score:1, Informative)
Reminds me of this old story:
Content-Aware Image Resizing
http://tech.slashdot.org/article.pl?sid=07/08/25/1835256
What about Resynthesizer? Well.. example within (Score:5, Informative)
It's a very cool GIMP plugin for some things, but...
This is my source image:
http://s3.images.com/huge.28.142421.JPG [images.com]
I want to remove the lady on the right, so I select her:
http://img714.imageshack.us/img714/1346/resynthesizerselection.jpg [imageshack.us]
And then, per the Resynthesizer page's recommendations, I use "Script-Fu/Enhance/Smart remove selection..."
http://img121.imageshack.us/img121/228/resynthesizerresultradi.jpg [imageshack.us]
Oh dear.
Anybody with access to the Photoshop beta feature want to give that image a stab? For all I know it fails just as spectacularly - but from the research it's based on, I highly suspect it'll fare better.
Re:Enhance (Score:3, Informative)
Re:What about Resynthesizer? Well.. example within (Score:4, Informative)
obvious question: workflow / parameters?
Generally I use the foreground select tool* to select the smallest area to cover the object, then grow selection by a few pixels so that none of the object's edges are poking out and confusing it, then filters - map - resynthesize (ie, use the plugin rather than the script), and have the "tilable" options disabled since they tend to grab samples from the opposite edge of the image (if I want a tilable image, I'll use the tiling filter separately...)
Probably the biggest factor for simple success is to have the object you want to remove be on its own (surrounded on all sides by similar textures) -- if it isn't, then you need to do things the long way -- eg, if you want to remove the leftmost wheelchair from this [shishnet.org] image, and you want it to be replaced by grass when three of its borders are touching non-grass, then you'll find that it ends up somewhat messy [shishnet.org] since it attempts to merge four different edge textures. In this case you'll need to copy a section of your desired fill texture (ie, a rectangle of pure grass) into a separate image (specifically, a single layer image with no transparency); then on the original image select the object to remove, open resynthesizer, and select the "fill texture" image as the texture source; this way the generated texture will both match the surroundings of the original as much as possible, while being filled with the "surroundings" that you've specifically chosen. Having taken a sample of "pure grass" and a sample of "pure stone", then removing the top and bottom halves of the wheelchair with each respectively, the results are nicer [shishnet.org]. (with the exception that the first two images were produced with a mouse and twenty minutes of careful selecting, and the final one was 5 minutes work with a laptop nipple, so there are still some bits of wheelchair poking out of the sides...)
Incidentally, does photoshop have SIOX [siox.org] yet? Having the features "vaguely scribble in the general area of an object to have the object selected precisely" and "automatically and realistically remove a selection" could potentially combine to form "one-click realistic object removal" \o/