Questions about LNP about mamba3d HOT 2 CLOSED

I apologize for not detailing this part in the paper. Yes, the $K$ in the Patch Embedding and the $k$ in the LNP represent two different KNN operations. The $K$-NN in the Patch Embedding is performed on the original point cloud, while the $k$-NN in the LNP is performed on $L$ central points.

In the LNP, we use $k$-NN on the $L$ central points and then obtain the corresponding features, thus obtaining the $F_K$ of size $( L \times k \times C )$.

In fact, for the sake of computational simplicity and because the CLS token does not explicitly contain the local geometric information of the point cloud, we first remove it in the LNP block and then concatenate it back after processing through the LNP block. However, you can still obtain $L×k×C$ from the $(L+1)×C$, as you are using the xyz coordinates to calculate KNN, for each of the $L$ central points, you can get the indices of its $k$ neighbors. After that, for each central point, you use the $k$ indices to retrieve $k$ tokens from $L+1$ tokens, although you might need to pay attention to the index shift caused by the CLS token.

Thank you for pointing this out. Does this your questions?

from mamba3d.

Thanks for your reply! My problems were solved perfectly.

from mamba3d.