BigRoots,
The area in the first pic, looks to be a great location for Ginseng as it is already a great location for many of it's companion plants, some of which are great sellable root herbs! The other root herbs might be other plants you might want to look into expanding. This spot could use a few larger trees in it for shade but hopefully the herb and weed concentrations will provide enough shade for good Ginseng health!
The plants that you say are unhealthy, are more than likely victims of slugs, snails and rodents and not really victims of the weather. In the future, a mixture of Copper Dragon and Sevin Dust will keep slugs, snails and most other legged or winged creatures (insects, rodents, rabbits and deer) off of the plants during the crucial emerging and early summer growing stages. Make sure to not place any Copper Dragon and Sevin Dust on plants that have blooms or are beginning to bloom so you won't risk interrupting the pollination processes. Place the mixture around these plants at least 8 to 12 inches away. During the same time, a good line of cheap but common household Salt and a little Copper Dragon and Sevin Dust around the outside perimeter of the Ginseng beds and plots will usually keep most if not all slugs, snails and many other pests out of the beds and plots. Just make sure to keep the Salt a few feet away from any Ginseng plants to insure no harm, no foul!
Frank