Insert 3D objects in photos

tbd

With a single image and a small amount of annotation, our method creates a physical model of the scene that is suitable for realistically rendering synthetic objects with diffuse, specular, and even glowing materials while accounting for lighting interactions between the objects and the scene.

http://kevinkarsch.com/publications/sa11.html

[flash=800,600:1ygv39d3]http://vimeo.com/moogaloop.swf?clip_id=28962540&server=vimeo.com&show_title=1&show_byline=1&show_portrait=0&color=&fullscreen=1" type="application/x-shockwave-flash" allowfullscreen="true" allowscriptaccess="always" width="400" height="225"[/flash:1ygv39d3]

tomasz

It is amazing that it is being done from a single photograph, just with a small user input.
The animations are most impressive.

Gaieus

Marian

That's totally awesome.

mitcorb

This is quite innovative. I believe quite a few people would be interested in this method. EDIT: I think Mr. Karsch, et al need to give this at least a working name.

michaliszissiou

Playing with the new zbrush4R2 now... this could be a great help.
Just thinking, great finding, wrong place
In the SU community, users could be interested for the opposite app.
Build the house import photo elements.

mitcorb

I don't have Photoshop CS any version, but doesn't one of the CS's do a similar procedure?
@michalis: yes, that would be desirable. My previous comment was made on the basis that many who post here regard modeling as a means to an end--that is, illustrating an idea with proper lighting, and so on. And, they do it well.
It appears that this Karsch method has been simplified, or refined for quick workflow?

michaliszissiou

Indeed CS extended version has some tools but not that good.
ZBrush 4 r2 has great hdri lighting and a lot of other tricky tools for this job. Most of all this realtime preview magic and hi def rendering in seconds.
Cinema4d has another interesting tool.
This approach here looks more interesting though.

sepo

amazing...is this actually available ?

Mike Lucey

Thanks for the headsup Tavi. This is one that I hope makes it to a released application.

The developers say,'Our system has applications in the movie and gaming industry, as well as home decorating and user content creation, among others'

So it does indeed look like they have something in mind! Now fingers crossed in the hope that none of the big players buy it up and make things 'complicated'.

Mike

driven

@mike lucey said:

Now fingers crossed in the hope that none of the big players buy it up and make things 'complicated'.

Mike

I don't mind if google buys it for sketchup...

Mike Lucey

Yep John, that would suit us just fine. Hopefully John B and the GSU Team will have noticed this thread

thomthom

This. Is. Magic!

Anssi

Fantastic, even if it would work only for rectangular rooms...

Anssi

ichi

Mind-blowing
can't wait for the release