Further to Jean's advice, make use of SU's "hide rest of model" feature when you are editing a group. Make a keyboard shortcut for it as well, then you can instantly turn it on or off when you are inferencing with background entities.