Just because you've gotten away with this in the past doesn't mean you will in the future.
Just as important as my concern for your safety is, my concern others, with limited woodworking experience, assume your method is a reasonable and safe one.
In addition to that ANY metal that come in contact with the blade could become shrapnel, there is that it is very possible your hand would end up in contact with the blade, because of the chaos that ensued when the metal push device came in contact with the blade.