WSPolypNet: Weakly Supervised Polyp Localization in Colonoscopy Videos

Colonoscopy video polyp annotation requires temporally consistent presence judgment, frame-level localization, and boundary refinement, while video-level labels do not directly provide these spatial annotations. The target setting therefore concerns semi-automated assistance for producing spatially useful annotations from continuous video clips without relying on frame-level bounding boxes or pixel masks.

WSPolypNet uses a 3D CNN to learn spatiotemporal representations from continuous colonoscopy frames and generate class activation maps. CAMs from the full view and four corner crops are mapped back to the original frame coordinates and fused by pixel-wise maximum response. Smoothing and non-maximum suppression produce candidate points, which are passed to MedSAM2 as point prompts. MedSAM2 propagates masks bidirectionally through time; candidate trajectories are ranked using CAM-region responses, and frame-wise localization is used as a fallback when propagation confidence is below 0.755 or the propagated mask is empty. The resulting pipeline connects weakly supervised coarse localization with temporally propagated, more finely bounded masks.

The authors report Recall of 94.51% and CorLoc@0.3, @0.5, and @0.7 of 47.80%, 43.68%, and 35.01%, respectively, compared with 36.87%, 33.72%, and 27.94% for the single-view configuration. For small polyps, reported CorLoc@0.5 rises from 16.01% to 30.97%, whereas it falls from 71.84% to 65.75% for large polyps. The frozen assessment describes the method as an executable local mechanism connecting weak supervision, point prompting, propagation, trajectory selection, and fallback, while noting that the evidence does not fully establish reliable boundary alignment and overall spatiotemporal consistency.

The method assumes preprocessed continuous colonoscopy video clips with video-level binary labels, a usable 3D CNN/CAM classifier, and a MedSAM2 model that accepts point prompts and propagates masks through video. The current workflow selects and propagates one high-confidence point and mainly localizes one polyp; it is intended as annotation assistance rather than a complete annotation replacement. It does not resolve multiple polyps in the same video or complete temporal coverage of polyps that appear only briefly in longer videos. Performance also varies with polyp size, and the paper does not specify generalization beyond the current data and setup. The authors present reduced spatial-labeling demand as a potential benefit, not as an established result.