This post briefly explains how the augmented reality part of my app would work and look like (in a very crude way).