Hard to say when there’s no image to judge. But with a simulation running if you box select it captures any pins within the box. If you inadvertently click on the cloth object at the beginning of a box selection there is a chance you pick the cloth object