Nested group_subtrees must be disallowed

[simen]

To make implementation of clients simpler, checkpoint must enforce that nested subtrees are not allowed in a groups subtrees. If an added path is a subtree of any existing subtree allready in the group, it must be ignored. If an added path is a supertree of any existing subtrees, they must be removed before adding the supertree.