Xuban commited on
Commit
c1cd367
·
verified ·
1 Parent(s): d9ccf7b

Add MobileSAM comparison

Browse files
Files changed (1) hide show
  1. README.md +16 -3
README.md CHANGED
@@ -39,14 +39,27 @@ prompts and ground-truth masks as reference:
39
 
40
  | Protocol | mIoU |
41
  |---|---|
42
- | Crop space, 96x96 (upstream evaluation protocol) | **0.707** |
43
- | Full image, end-to-end via `LibrePicoSAM3.predict()` | **0.714** |
44
 
45
- Measured on 500 randomly sampled non-crowd instances (seed 0, no area filter).
46
  The PicoSAM3 paper reports 65.45 mIoU on COCO; our sampling and filtering may
47
  differ from theirs, so we publish the number we measured rather than restating
48
  theirs as reproduced.
49
 
 
 
 
 
 
 
 
 
 
 
 
 
 
50
  ## Provenance
51
 
52
  - **Architecture**: ported from [pbonazzi/picosam3](https://github.com/pbonazzi/picosam3)
 
39
 
40
  | Protocol | mIoU |
41
  |---|---|
42
+ | Crop space, 96x96 (upstream evaluation protocol) | **0.692** |
43
+ | Full image, end-to-end via `LibrePicoSAM3.predict()` | **0.697** |
44
 
45
+ Measured on 2000 randomly sampled non-crowd instances (seed 0, no area filter).
46
  The PicoSAM3 paper reports 65.45 mIoU on COCO; our sampling and filtering may
47
  differ from theirs, so we publish the number we measured rather than restating
48
  theirs as reproduced.
49
 
50
+ ### Against MobileSAM
51
+
52
+ Same 150 COCO instances, same box prompts, single-threaded CPU:
53
+
54
+ | Model | Params | mIoU | CPU latency |
55
+ |---|---|---|---|
56
+ | LibrePicoSAM3 | 1.37M | 0.691 | **8.6 ms/prompt** |
57
+ | LibreMobileSAM | 10.13M | **0.800** | 407 ms/prompt |
58
+
59
+ MobileSAM is the better segmenter; prefer it when a GPU is available or quality
60
+ dominates. PicoSAM3 trades ~11 mIoU points for 7x fewer parameters and ~47x
61
+ lower CPU latency, which is what makes CPU-only and in-sensor deployment viable.
62
+
63
  ## Provenance
64
 
65
  - **Architecture**: ported from [pbonazzi/picosam3](https://github.com/pbonazzi/picosam3)