Yeah I thought of that as well. The trick with that set is the lid closes tight against the base. You could place two rectangles of cork (or other) that would line up with the two rectangular openings in the base.
Another idea would be a piece of felt that gets folded up inside the box when stored and laid out in the lid when playing.