Im with Latt, Im sure it will grow but im not sure it will thrive without a little help.It may be different in your area but here, that type soil is found in flat woodland bottoms that at times are too wet for ginseng and the forest is usually full of Red Oaks... Im guessing your soil is very acidic. If it was me, that spot looks manageable with a tractor so I would probably work the soil up about 8or10 inches after adding the necessary lime or gypsum required (per soil test), that will help keep the soil loose once worked in. If that spot isn't drained well and gets swampy in winter and spring, I would for sure mound my beds. Then give it a go.
Hillhopper