Good instructibles !
Just thought, what if you added a depth screw to contact the router bit bearing at the apex of the U channel.
You could dial in the cut depth.
Of course with the setup you show, adding shims between the jig and the fence to increase the diameter would also work.