Document image matching and annotation lifting

Two images of the same document could differ significantly due to faxing, scanner distortions, or degradation through multigeneration copying. Additionally, one of the images may have extensive annotations not present in the other. We give a method for registering two such images and separating out annotations. We further present an algorithm for detecting and repairing broken strokes in the annotations. Our methods have been tested on a wide variety of documents with reliable results; for the special case of form dropout our results are better than had been obtained previously with special-purpose algorithms.