Close up of the leaves possible?
I'm no expert on plants, but my first instinct was Rhododendron, and very poor looking ones at that. Flowering by no means means the plants healthy, it could just be using up stored energy reserves and still going through it's regular cycles.
As I said, I'm not great at terrestrial plant ID's, but I could show my mum the pictures and she would most likely be able to ID it.
Are the leaves there the whole year? What is your soil like (pH, drainage etc)?.
Certainly some sort of deficiency there, and it looks like the ground is covered in weeds and mosses.
Moving them into a pot could kill them if you damage the root systems, as the plants already look poorly
Whatever it is, I would suggest moving all the weeds, grass and moss by hand (make sure you don't leave any dandelion roots, they are a bugger to get out , break easily and if you leave part of the root they will just grow back).
It needs some nutrition, something acidic is probably preferred (since it looks Rhododendron like), try getting some fine chipped pine bark and digging lots of it into to the soil around its roots, then watering every few weeks with a soluble plant food that provides NPK (these aren't expensive or hard to find at garden centres, the packets are fairly clear and should say "complete plant food"). It's pretty important you make sure the ground doesn't dry out too much over the summer, so keep an eye on the ground.
Get everything right for the plant, and getting bashed around loads should be no problem, rhododendrons are pretty tough and tenacious plants, so I very much doubt that's why its looking bad.