Skip to content

[HM3D]--Connected Components Utility; CC-based Semantic BBox generation; Mesh connectivity reporting#1669

Merged
jturner65 merged 19 commits intofacebookresearch:mainfrom
jturner65:SemanticConnectivity
Feb 23, 2022
Merged

[HM3D]--Connected Components Utility; CC-based Semantic BBox generation; Mesh connectivity reporting#1669
jturner65 merged 19 commits intofacebookresearch:mainfrom
jturner65:SemanticConnectivity

Conversation

@jturner65
Copy link
Copy Markdown
Contributor

@jturner65 jturner65 commented Feb 16, 2022

Motivation and Context

This PR adds the following functionality :

  • Derive connected components on a set of vertices conditioned on some vertex attribute, such as color. It finds all cc's that share the same vertex attribute value, finds the AABB of the resultant vertex cloud, and aggregates the results into a map keyed by semantic object IDX.

  • Semantic BBoxes are being generated when needed (currently only in HM3D dataset) using CC with largest BBox (by volume) for a particular semantic annotation.

  • Reporting tools are provided through viewer, including the ability to go through all the scenes in a dataset to derive and save the report to csv file. A python binding is also provided to give access to this data.

How Has This Been Tested

All existing local c++ and python tests pass.

Types of changes

  • Docs change / refactoring / dependency upgrade
  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)

Checklist

  • My code follows the code style of this project.
  • My change requires a change to the documentation.
  • I have updated the documentation accordingly.
  • I have read the CONTRIBUTING document.
  • I have completed my CLA (see CONTRIBUTING)
  • I have added tests to cover my changes.
  • All new and existing tests passed.

@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Feb 16, 2022
Copy link
Copy Markdown
Contributor

@Skylion007 Skylion007 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Performance improvements

Comment thread src/esp/assets/GenericSemanticMeshData.cpp Outdated
Comment thread src/esp/assets/GenericSemanticMeshData.cpp Outdated
Comment thread src/esp/assets/ResourceManager.cpp Outdated
Comment thread src/utils/viewer/viewer.cpp Outdated
Comment thread src/esp/assets/ResourceManager.cpp Outdated
Comment thread src/esp/assets/GenericSemanticMeshData.cpp Outdated
@jturner65
Copy link
Copy Markdown
Contributor Author

Thanks as always @Skylion007 :)

@jturner65 jturner65 force-pushed the SemanticConnectivity branch from bd9a58f to cc94d43 Compare February 21, 2022 15:44
Comment thread src/esp/assets/ResourceManager.cpp Outdated
Comment thread src/esp/geo/Geo.h
Also add semantic OBJ bbox setting based on largest volume CC.
@jturner65 jturner65 force-pushed the SemanticConnectivity branch from 444757b to a92bcaa Compare February 22, 2022 17:26
@jturner65 jturner65 force-pushed the SemanticConnectivity branch from b3ca2ab to 1711567 Compare February 22, 2022 19:36
@jturner65 jturner65 changed the title [WIP]--Semantic connectivity reporting [HM3D]--Semantic connectivity reporting Feb 22, 2022
@jturner65 jturner65 changed the title [HM3D]--Semantic connectivity reporting [HM3D]--Connected Components Utility; CC-based Semantic BBox generation; Mesh connectivity reporting Feb 22, 2022
@jturner65 jturner65 marked this pull request as ready for review February 22, 2022 19:55
@Skylion007 Skylion007 self-requested a review February 23, 2022 16:36
Copy link
Copy Markdown
Contributor

@aclegg3 aclegg3 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jturner65 jturner65 dismissed Skylion007’s stale review February 23, 2022 17:49

Addressed changes

@jturner65 jturner65 merged commit 49afedd into facebookresearch:main Feb 23, 2022
@jturner65 jturner65 deleted the SemanticConnectivity branch February 23, 2022 17:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed Do not delete this pull request or issue due to inactivity.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants