The stopper was that the first time I hit a loose bit on a gravel road she's gonna go down with no chance for recovery. I am sure it will happen anyway with any bike, it just feels like it will happen twice as much. Even experienced adv riders have dropped it in reviews, with exactly that dynamic.
Having dropped my Enduro off-road I can vouch for the fact that (in my inexperienced hands at least) that it's a big handful of a thing in anything remotely slippery. That said, if I really was expecting to tackle more off-road stuff I'd get knobblies.