All the dowels I tried to buy were 1/32" to 1/16" under. probably starting to sell like 2x4's (size before sanding). plywood as well. 

I was using them for the same purpose but my holes were then too large. The remaining holes were drilled out with the next smaller brad point, then sized up with a twist drill.