I am actually going to try and build such a thing, I will write a blogpost on my research and progress so far. Will update this thread the moment I get started with writing the first post.
My goal is to have the camera output drawn on a canvas and use ThreeJS to create overlaps based on AR markers.