Moving nested parent when child cant be placed

[GabrielKGardner]

How do I go about switching from moving a child element to moving the parent element?

Requirements

1. Only the children can have handles to move them around and re-sort inside of the correct Group
2. Children from other groups can not mix
3. When the child goes past its group it needs to switch from moving the child element to moving the parent element

Group A A_foo A_bar Group B B_baz B_qux Group C C_john C_tim 

❌Wrong

Group A A_bar Group B A_foo (❌ child moved into the wrong group and didn't move the parent) B_baz B_qux Group C C_john C_tim 

✔️ Correct

Group B B_baz B_qux Group A (✔️ instead of moving just the child it moved the whole parent) A_bar A_foo Group C C_tim C_john (✔️ children are still able to rearranged )