We are using a technique called 'Structure from Motion' to reconstruct the relative positions of cameras and the 3D structure of the scene using only photos. See this blogpost for an example.

As a first experiment, we want to improve the transitions from one photo to another by using the scene structure. We generate a triangular mesh to approximate the scene geometry and map the images onto it. This way, we can render the approximate 3D geometry while we move from one camera to another, giving a better perception of the motion.

We are getting nice and smooth transitions between photos. The occasional artifacts are to be expected since we use only an approximate scene geometry, so we take that as a good start.

Another goal we have is to enable natural navigation of the photos in 3D space. We rely on the superior accuracy of the camera positions recovered from SfM compared to those from GPS and compass. To experiment with the navigation, we have reconstructed an area with approximately 800 photos in Malmö, Sweden (will take some time to load). As you start navigating, you may notice that these are photos from different users and in different seasons. This is exactly what we are aiming at - to build a global fabric of photos both in space and in time!

While the results are still work in progress, we would really like to share these with you and hear your feedbacks (Twitter or Github)!

/Yubin and Pau