As far as I'm concerned if a passage can be done by that person with no damage it's going passage for them. If not they should stay out.
If you leave it up to each diver whether it is OK to damage the cave for them to do what they want then the entire cave is open to damage. Passages that should never be touched are destroyed by people who have no business being there.
Leave the cave the way it was before you got there and the caves will be there for everyone and the passages you aren't good enough to do will still be there when you are good enough.
If no one is good enough then no one should be in there. There should be no one digging, scraping or dragging - and absolutely no one breaking off pieces of the cave.

