Colab Notebooks: 3D Ken Burns Effect

What’s this about:

3D Ken Burns Effect (developed by Simon Niklaus et al) allows generating animated 3D video footage of a single photo.

Things to try out:

In the Colab Notebook you will find the component autozoom.py. Try to finetune it with following parameters:

objectTo = process_autozoom({
'dblShift': 10.0,
'dblZoom': 10000000000000000000000000000000000000000000000000000000,
'objectFrom': objectFrom
})
numpyResult = process_kenburns
({'dblSteps': numpy.linspace(0.0, 8.0, 400).tolist(),
'objectFrom': objectFrom,
'objectTo': objectTo,
'boolInpaint': True

})

This will exaggerate the camera movement — and you will fly through the whole scenery. Like in this example:

Do some experiments with parameters, and you will experience your photos from a fully new perspective. The Notebook provides many useful functions, like serial image=>video transfer.

Links:

• 3D Ken Burns Effect from a Single Image on ArXiv
• Colab Notebook (provided by Andi Bayo and improved by Manuel Romero)

Read more:

• Very spatial! AI-based parallax 3D videos from photos.
• Re-animated History
• Beyond the Boundaries
• Watch my series dreAIms

Index of Series "Google Colab Notebook".

Full essay "12 Colab Notebooks that matter"