Interesting idea. If that doesn't workout, you could try to make the crank arm out of wood with a hole small enough to press fit and add a set screw. You could reuse the handle from that crank.
--Nathan, TX. Hire the lazy man. He may not do as much work but that's because he will find a better way.