Ack, My Husband and I had that problem with Xerxes (which we have since resolved by feeding him flake food) - your Betta is probably just a really picky eater like ours is. If you want a couple of solutions I suggest reading through the "Help with Xerxes" thread :)
We do intend to try these suggestions out Dude.. I would just rather try the flake food suggestion before the straving suggestion. Call me a crazy paranoid fish parent. *shrugs* I'm beginning to understand just how serious people are being when they say every Betta has a unique personality...