I actually did not just go out and buy a fish and a tank and throw them together in the same day. I got my fish tank about a week and a half ago, cleaned it and the gravel out, assembled my two gallon jugs of water put a litlle bit of water conditioner in it, Put in the filter which also oxygenates and let it run by itself for about a week. In the meantime I looked up fish compatiable and some of the cycles, asked people on a couple of diffrent forums and I got these, Bettas, Guppies, danios, and Paradise fish. So I decided on the danio. They did say keep under two fish though and I only have a single one in there. I don't mean to sound rash but it's kind of frustrating being told it's ok then it's not because all I want is the fish to be healthy and thrive. Side note I do plan on getting a 10 to 15 gallon tank in about 2 months.
Alot of people get given bad advice then end up here. Its not a problem - we've all been there before - and this is where people can tell you how to fix the problems you have. The only issues is occasionally people refuse to acknowledge they have a problem.
Like I say, Danio's need alot more room than that (and from Paradise Fish size, I reckon they would too - though I've never looked one up before.)
Your LFS won't have an issue with you taking it back, and financially there shouldn't be an issue with that - they cost about £2.00 last time I looked.
Read up on cycling though - theres an old view that if you leave the tank for a day or a week it'll cycle it - and its a myth. It doesn't matter if you leave it for a day or a week, it doesn't help cycle the tank. Theres 3 ways I'd recommend to cycle a tank, brief overview below.
1. Fishlessly. Add ammonia daily, bacteria builds up the breaks the ammonia down into nitrite. Another bacteria builds up that breaks nitrite into nitrate. Takes 2 or more weeks, and needs a decent quality liquid testing kit that tests ammonia, nitrite and nitrate. Recommended.
2. Mature media donation - someone who has a mature tank can give you some of their media to move into your filter. This media already has the nitrifying bacteria in it, and fish can be added straight away.
3. Fish in cycle. Actually I wouldn't recommend this, its alot more work than either option above. Basically you put fish in there, they c**p out ammonia. You have to do water changes and daily tests and do a big water change whenever theres traces of ammonia etc. Labour intensive doing alot of water changes, but thats the only way to minimise the risk to any fish in the tank.
Anything you need clearing up, let me know - if I don't answer someone else will. Like I say, I'm happy to help as are others - try not to take offence if I criticise something you've done as its not a criticism of you, its me making clear the right and wrong ways to do something.