I wrote on Twitter how to do that.
Go to your deviation, on the page of your deviation find "Featured in Groups", then point the mouse cursor on the group and button with pencil will show up. Click on button with pencil and option about removing your deviation from the group.
I've tested it and it works, so you don't need to be part of administration or be member of group to remove that.