Some stores--and these will almost always be among the individually-owned fish stores as opposed to chain pet stores--will go so far as to separate hard water and soft water fish species. Many do not. I have very soft water where I live, and the individually owned stores do maintain a bank of tanks separate from the others, and in these they use calcareous substrate to keep fish like livebearers, rift lake cichlids, etc, in better health.
There is no "happy medium" if one has fish species with widely-varying requirements for water parameters. Soft water species develop internal problems leading to death because of the minerals (calcium and magnesium are primary) in moderately hard or harder water, such as blockage of the kidneys over time. And hard water species kept in soft water develop serious internal problems due to the lack of mineral entering their bloodstream and kidneys. These minerals must come from the water which they are continually assimilating through their cells.
However, most fish stores hope to sell their fish quickly. The longer they have them the more it costs to feed them, heat/light the tanks, water changes (yes, all good fish stores do major weekly water changes), etc, so it is more profitable to sell them as soon as possible. The fish with a few exceptions are able to manage/tolerate this for a short time. But once they are home in a permanent tank, if they still do not have suitable water the weakening that may have begun (or may not, depending) in the store will worsen and this causes stress at the least but usually other internal problems for the fish and it either contracts some secondary issue it should be able to fight off, or it simply dies sooner than the normal lifespan. Surviving is not the same as thriving.