I heard people had success if they put shrimps/fish in first before the betta, since the fish would have the mindset of "this territory belongs to the shrimp". Or would at least just tolerate the shrimp.
Yeah, you can try putting him in. If anything goes south, you can just take him out.