I've never had a problem casting 1/2" blanks from polyester resin (I live in a warm climate). I've cast as small as 1/8" diameter with no problems curing (I use the recommended 10 drops per oz in Silmar 41). If you found things taking too long to get to full cure in your conditions, you could always resort to heat to help the cure.
I found color swirls don't look as good on the outside as they do on the inside. If I cast too close to my finished size I don't turn away enough of the ugly / plain outside to reveal the good swirls on the inside. But that may have more to do with how I swirl my colors than the size of the blank. A different swirl technique could maybe eliminate the issue.
Drilling shouldn't be any more difficult if you have sharp drill bits with a good profile on them.
Good luck with your casting.
Ed