Love the finished piece, but really like the idea of those silicone bumpers.
Don't need a death grip on the shaft so having the compliance in the bumper means you can make it tight but still have some give for small adjustments.

Beautiful work, I bet the brass against that walnut really pops!