lightform - Video Projection Mapping.

https://lightform.com/


Lightform is a San Francisco, California. company developing AR hardware and software founded by Brett Jones, Raj Sodhi and Kevin Karsch in 2014


Lightform has two main products: the hardware, LF1, and the software, Lightform Creator. LF1 is a 3D scanner and media player that provides AR effects when it is paired with an image projector. LF1 performs this function by capturing the object that would be enhanced through AR application with its camera. After calibrating the image data according to the projector lens, the images are sent to the user’s laptop. Using the Lightform Creator, users can then apply AR effects based on their needs.



https://en.wikipedia.org/wiki/Projection_mapping

Projection mapping, similar to video mapping and spatial augmented reality, is a projection technique^[1][2] used to turn objects, often irregularly shaped, into a display surface for video projection. These objects may be complex industrial landscapes, such as buildings, small indoor objects or theatrical stages. By using specialized software, a two- or three-dimensional object is spatially mapped on the virtual program which mimics the real environment it is to be projected on. The software can interact with a projector to fit any desired image onto the surface of that object.^[3] This technique is used by artists and advertisers alike who can add extra dimensions, optical illusions, and notions of movement onto previously static objects. The video is commonly combined with, or triggered by, audio to create an audio-visual narrative. In recent years this technique has also been widely used in the context of cultural heritage as it has proved to be an excellent edutainment^[4] tool thanks to the combined use of a digital dramaturgy.

Ink Mapping: Video Mapping Projection on Tattoos, by Oskar & Gaspar

https://vimeo.com/143296099

Ink Mapping: Video Mapping Projection on Tattoos, by Oskar & Gaspar from Oskar & Gaspar on Vimeo.

Using the Unity game engine in the iDome

The guy behind this Paul Bourke is amazing. He makes it look easy. His whole website is full of similar feats of video warping magic.

Using the Unity game engine in the iDome
http://paulbourke.net/dome/UnityiDome/

Creating fisheye views with the Unity3D engine
http://paulbourke.net/dome/unity3d/

Bot & Dolly - Video Mapping

Box by Bot & Dolly - Video Mapping

Box explores the synthesis of real and digital space through projection-mapping on moving surfaces. The short film documents a live performance, captured entirely in camera. 

Bot & Dolly produced this work to serve as both an artistic statement and technical demonstration. It is the culmination of multiple technologies, including large scale robotics, projection mapping, and software engineering. We believe this methodology has tremendous potential to radically transform theatrical presentations, and define new genres of expression.

Find out exactly how "Box" was created in our exclusive behind the scenes video: 
http://www.youtube.com/watch?list=PL6...

http://www.botndolly.com/box



Box by Bot & Dolly | Behind the Scenes

Published on Oct 1, 2013 A behind the scenes look at Box, Bot & Dolly's wildly popular latest live performance film which documents a first-ever live synchronized performance using 3D projection mapping, robots, and actors.D projection mapping, robots, and actors.

URBANSCREEN | Projection Mapping The Interior Of A Massive Gas tank

 What do you do with an empty, 112-meter high,  gas storage tank?

http://www.urbanscreen.com/

http://thecreatorsproject.vice.com/blog/urbanscreen-projection-mapping-the-interior-of-a-massive-gas-tank

URBANSCREEN is based in Bremen, Germany. Established in 2005, their team currently consists of eight contributors, artists brought together from different disciplines representing architecture, music, stage design and media-art.
Large-scale projection on urban surfaces is their creative company's field of activity. They conceive and produce custom-made, site-specific media installations using high artistic standards and an interdisciplinary approach to stylistic devices. The main focus of their approach is to take up existent or inherent structures of architecture, its thematic context and surroundings. Through an architectural staging, they examine the intersection of a site’s concept of space, location, and appearance. Tailored site-specific projection procedures enable them to interlink various media – such as computer-generated imagery, artificial illumination and dance performance – in order to characterize architecture and the versatile levels of it that can be experienced vis-à-vis a building itself.

Real Time Face Substitution

This is a sign of things to come.
You can see this is very raw and has lots of problems, but it's close and soon will be nearly perfect.



Arturo Castro put together this technical demo for face swapping technique.

The application works in real time and it's developed using the opensource framework for creative coding openFrameworks: openFrameworks.cc

Most of the "magic" happens with Jason Saragih' c++ library for face tracking. The face tracking library returns a mesh that matches the contour of the eyes, nose, mouth and other facial features.

That way the mesh obtained from a photo is matched to my own face in the video. Applying some color interpolation algorithms from Kevin Atkinson's image clone code: methodart.blogspot.com/​ gives it the blending effect that can be seen in the final footage.

Also uising Kyle McDonald's ofxFaceTracker addon for openframeworks github.com/​kylemcdonald/​ofxFaceTracker which wraps Jason's library for easier use.



Read story:
Watch This Dude’s Face Become Other FacesReal Time Face Substitution Should Be Renamed Real Time Horror Show

Kinect Based Whole Building Breakout

From SlashDot:
"If you remember Breakout — rows of blocks a the top of the screen and a paddle to bounce a ball into them to destroy a block — then you might not feel nostalgic about it. After all, it was a very limited sort of game. However, take one Kinect and one building and you have something quite different when you use it to create a Breakout game. The bricks, ball and paddle all projected onto an old building and the player moves from side-to-side to control the paddle. The player's position is being detected by a Kinect, is there no end to the fun you can have with this gadget. The really clever bit, and you might not notice it unless you look closely at the video, is that the ball bounces off real architectural features of the building — like the windows, for example"



.

Gigantic kinect brick game on a builing
This will definitely take your classic video game into epic and interesting proportions! The Kinect Gigantic Brick Game on a Building is as the name suggests; a Kinect-controlled Brick Game which the display is projected on the side of a tall building. This video by WECOMEINPEACE displays this very spectacular Kinect hack and how this project attracts bystanders directly and indirectly. In the video, the side of the tall building serves as the “monitor” for the brick game. Using a variety of high-powered projectors, the building displays the Kinect brick game. Using the Kinect, the user then commences to use his gestures to play the game. Arm movements control the main racket that bounces the ball and with the larger than life screen to view the game, it certainly adds more majesty to an otherwise old game. Kinect games are getting much love and soon, our own buildings might have an interactive Kinect game readily available.

Le casse-brique est un jeu-vidéo auquel tout le monde a joué. Mais c’est une toute autre expérience lorsque celui-ci prend des proportions monumentales et qu’on y joue avec tout son corps.
Brick propose au joueur de déplacer le palet grâce aux mouvements de son corps, pour faire rebondir une balle et casser les briques. L’installation ludique utilise principalement deux technologies :
- la Kinect pour la détection du mouvement du joueur
- le mapping, qui adapte le jeu aux moindres particularités du bâtiment.
Ainsi, la balle rebondit sur les vrais éléments de l’architecture, les fenêtres, colonnes, et gouttières, pour une expérience aussi grandiose qu’amusante.

Conception : Wilfried Della Rossa, Kimi Do, Thomas Mathieu
Visuals : Wilfried Della Rossa, Thomas Mathieu
Programming : Thomas Mathieu

Fwd: Must see 3D show...

Thanks Jean, 

It called video mapping. See these two past articles on it.

• More amazing Digital Video Mapping
• 3D video illusion.

---------- Forwarded message ----------
From: Jean P
Date: Jul 26, 2011 7:49 AM
Subject: Fwd: Must see 3D show...
To:
Pretty amazing.... in case you haven't seen this
________________________________


absolutely amazing !
http://www.youtube.com/watch?v=XVTga6GmbGw&feature=related

Virtual Fashion Show

www.demoslam.com | Some trendsetting Japanese girls try on clothes using nothing but a projector.

Now imagine adding 3D position data using something like the Microsoft Kinect , and you could do real time video mapping on to a live person.

By this I mean as the person in front of the projector moves, so could the virtual dress image with her. If she were to turn around the image of the dress could turn around with her giving a much more realistic image of her wearing a dress.

Multiple projector edge blending for increased resolution.

This was a cool demo where they used a canon digital camera to capture high res images of the projectors overlaps and then use that to correct the images to product one larger resolution projector image.

I have seen other systems that can edge blend projector images but they required more accurate placement of the projectors and the edge blends were predetermined.

http://www.zaxel.com

Read about Zaxtar

Video Matchmoving

In cinematography, match moving is a visual-effects technique that allows the insertion of computer graphics into live-action footage with correct position, scale, orientation, and motion relative to the photographed objects in the shot. The term is used loosely to refer to several different ways of extracting motion information from a motion picture, particularly camera movement. Match moving is related to rotoscoping and photogrammetry. It is sometimes referred to as motion tracking.

This is an incredible demo.



2D3

boujou

There is a free demo Version of Boujou available here. The pay for version cost $10,000 USD

Another similar software package:
Syntheyes Also very expensive.

Wikipedia on Match_moving

More amazing Digital Video Mapping

The 600 Years from the macula on Vimeo.

Digital Video Mapping during 600 years anniversary of the astrological tower clock situated at Old Town Square in center of Prague. Mapping: The Macula  Coworking animators: Michal Kotek Lukáš Duběda Sound: data-live  Production: Tomato...

3D video illusion.

3D Illusion brought to you by VideoBash.com

This is one of the best demo's of Digital Video Mapping I have yet to see.

Here is another clip of this building.

Samsung was introduced a large-scale commercial 3D-Outdoor projection in the Netherlands, was demonstrated at the Beurs van Berlage in Amsterdam this past May.

This is very similar to some of the tricks Disney and other were doing with PANI projectors but with still images. They take images of the building and then compensate in the projected image for the difference in the surface colors, texture, reflectivity and distances they where projecting on to. (Example)



Here are some other examples of video mapping.



http://www.youtube.com/watch?v=0UAVFod6bXg