So final solution was to compare the mask canvas and the canvas to draw to directly. Now the mask only changes the areas i want shadowed. Lucky for me javascript can direct write to image data pretty quickly. It's doing 200k+ pixel compares in just a couple of milliseconds if not...See more

Still needs lots of work ... but it's getting there.