The LBD has a great solution.
You don't need a 2" diameter hole saw, just one that is almost as big (1-1/2" will do) Clamp the board to your DP so it doesn't move.
This will cradle the ball and if your board didn't move, swapping out the hole saw for the 1/8" bit will keep it centered.