So fix problems didn't find anything. But I few times I have gotten a message when saying saying that something minor is messed up and sketchup will fix it.
The rogue components aren't anywhere near other groups or components, which is why I didn't see them pop up at first. The component origins are close to the geometry, and there aren't any pieces of things in the component (that I can see at least) out in the distance. However, the model is miles(literally) away from the origin point in sketchup (due to the need to maintain the origin from CAD.