You are right about experiencing loss when it comes to growing ginseng... it just happens.
You might as well plan on it. It is going to happen.
Even with wild plants... what you see early in the season will not be there later in the summer because deer really do eat the tops a lot.
A few years back I hunted Morels (Late April) up a little hollow on some land I owned, and found 20+ nice 3 prong ginseng plants. When seng season opened I went back to that hollow and only found 5-6 of those still had a top up.
Yesterday on my place when I got to one of my best beds (lots of nice big 6 year old 3 prongs)... I found that the large majority of them had been mowed down by deer.
They did leave this one for me. Thank God at least I did get to plant those berries.
Now I am looking forward to some grilled back strap this fall... pay back time