Sigh, I love fish but just can't eat it when from a store or restaurant. I got spoiled by central and northern Ontario Canada a LONG time ago. I mean go out in a canoe and catch some small mouth bass, walleye or pike and hit shore, filet and cook. The flavor is just totally different than from a store as, in the store, or restaurant, the fish is seldom actually fresh.
Consider this... I lived in north east Florida for sixteen years. Especially right on the coast many places would advertise "catch of the day" but it just was seldom actually true. I knew several people that worked the fishing boats and they went out for a week at a time. They come in and places buy and sell as catch of the day yet who knows if the fish was caught on the first or last day of the week on water?
Many fish just don't have any real shelf life as to flavor even if frozen or put on ice. Take small mouth bass as an example. You just can't filet and freeze or put on ice as within 2-3 hours the flavor will change. Fresh out of the water small mouth has a lemony flavor but 2 hours on ice and that is gone.
Now scallops are a totally different matter! I could eat them by the bucket even out of a store. Problem with them is if you don't pay a fortune they are probably fake and actually usually white fish. I've also read that shark is also sometimes used for fake scallops. Oddly I do seldom but like mayo based crab salad. With what I've said above it may seem odd but I prefer imitation crab for a salad as, while it may taste just a touch fishy, at least it has some taste. To me crab and lobster are just bland and all they do is serve as a way to carry the flavored butter.