arthurdjn commited on
Commit
475246f
·
verified ·
1 Parent(s): 004c0f0

Upload kpfcnn-base.s3dis.hugues-thomas

Browse files
Files changed (2) hide show
  1. README.md +109 -0
  2. model.safetensors +3 -0
README.md ADDED
@@ -0,0 +1,109 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: torch-pointcloud
4
+ tags:
5
+ - point-cloud
6
+ - 3d
7
+ - pytorch
8
+ - torch-pointcloud
9
+ - kpconv
10
+ - segmentation
11
+ datasets:
12
+ - s3dis
13
+ model-index:
14
+ - name: kpfcnn-base.s3dis.hugues-thomas
15
+ results:
16
+ - task:
17
+ type: point-cloud-segmentation
18
+ dataset:
19
+ name: S3DIS (6-fold)
20
+ type: s3dis
21
+ metrics:
22
+ - name: mIoU
23
+ type: mean_iou
24
+ value: 66.44
25
+ ---
26
+
27
+ # Model card for kpfcnn-base.s3dis.hugues-thomas
28
+
29
+ A KPConv point cloud segmentation model (deformable kernel point convolution). Trained on S3DIS (6-fold).
30
+
31
+ ## Model Details
32
+
33
+ - **Model Type:** Point cloud semantic segmentation
34
+ - **Model Stats:**
35
+ - Params (M): 24.4
36
+ - Input channels: 5
37
+ - Classes: 13
38
+ - Features: 128
39
+ - **Dataset:** S3DIS (6-fold)
40
+ - **Metrics:** mIoU 66.44 (reference 66.4)
41
+ - **Paper:** [KPConv: Flexible and Deformable Convolution for Point Clouds](https://arxiv.org/abs/1904.08889)
42
+ - **Converted from:** [HuguesTHOMAS/KPConv-PyTorch](https://github.com/HuguesTHOMAS/KPConv-PyTorch) (MIT)
43
+ - **Library:** [torch-pointcloud](https://github.com/arthurdjn/pytorch-pointcloud)
44
+
45
+ ## Install
46
+
47
+ ```bash
48
+ pip install torch-pointcloud
49
+ ```
50
+
51
+ ## Usage
52
+
53
+ ```python
54
+ import torch
55
+ import torch_pointcloud as tp
56
+ from torch_pointcloud.utils.data import collate
57
+
58
+ model, info = tp.create_model(
59
+ "kpfcnn-base.s3dis.hugues-thomas",
60
+ task="segmentation",
61
+ pretrained=True,
62
+ return_info=True,
63
+ )
64
+ model = model.eval()
65
+
66
+ # synthetic sample with the keys a dataset provides
67
+ num_points = 8192
68
+ sample = {
69
+ "pos": torch.randn(num_points, 3),
70
+ "color": torch.rand(num_points, 3) * 255,
71
+ "segment": torch.zeros(num_points, dtype=torch.long),
72
+ }
73
+ data = info["transform"](sample)
74
+ data = collate([data])
75
+
76
+ with torch.no_grad():
77
+ logits = model(data.get("x"), data["pos"], data["batch"])
78
+ ```
79
+
80
+ ## Feature extraction
81
+
82
+ ```python
83
+ with torch.no_grad():
84
+ features = model.forward_features(data.get("x"), data["pos"], data["batch"])
85
+
86
+ model.reset_classifier(num_classes=0)
87
+ with torch.no_grad():
88
+ features = model(data.get("x"), data["pos"], data["batch"]) # (N, 128)
89
+ ```
90
+
91
+ ## Citation
92
+
93
+ ```bibtex
94
+ @inproceedings{thomas2019kpconv,
95
+ title = {KPConv: Flexible and Deformable Convolution for Point Clouds},
96
+ author = {Hugues Thomas and Charles R. Qi and Jean-Emmanuel Deschaud and Beatriz Marcotegui and François Goulette and Leonidas J. Guibas},
97
+ booktitle = {ICCV},
98
+ year = {2019}
99
+ }
100
+ ```
101
+
102
+ ```bibtex
103
+ @inproceedings{armeni2016s3dis,
104
+ title = {{3D} Semantic Parsing of Large-Scale Indoor Spaces},
105
+ author = {Armeni, Iro and Sener, Ozan and Zamir, Amir R. and Jiang, Helen and Brilakis, Ioannis and Fischer, Martin and Savarese, Silvio},
106
+ booktitle = {CVPR},
107
+ year = {2016}
108
+ }
109
+ ```
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a38136ed5843544006c2003bd0c69fe822edb2c3c853472309dd0564510b59ba
3
+ size 97716276