Skip to content

Conversation

@devin-ai-integration
Copy link
Contributor

@devin-ai-integration devin-ai-integration bot commented Dec 31, 2025

Summary

This PR updates the Orion notebook examples to use the new artifact handler pattern from the VLM Run SDK:

  • 13_orion_3d_reconstruction.ipynb - 3D reconstruction from images/video
  • 14_orion_document_understanding.ipynb - OCR, layout detection, redaction, classification

Key Changes

3D Reconstruction Notebook:

  • Switched from PLY to SPZ file format for Gaussian splat models
  • Added spz library dependency (Niantic Labs) for loading compressed splat files
  • Updated helper functions: download_spz, load_gaussian_splat_spz, render_gaussian_splat
  • Uses vlmrun.types.ReconRef for reconstruction responses
  • Uses client.artifacts.get() to retrieve 3D model artifacts

Document Understanding Notebook:

  • Updated to use vlmrun.types.ImageRef for image responses
  • Uses client.artifacts.get() to retrieve image artifacts (e.g., redacted documents)
  • Modified chat_completion helper to return session_id for artifact retrieval
  • Cleared cell outputs for cleaner notebook state

Review & Testing Checklist for Human

  • Critical: Verify the spz library installation works correctly in Colab (clones from GitHub and installs)
  • Critical: Test 3D reconstruction example end-to-end - ensure SPZ files download and render correctly with Plotly
  • Critical: Test document redaction example - verify client.artifacts.get() returns the blurred image correctly
  • Confirm OCR, layout detection, and multi-document classification examples still work
  • Verify all imports resolve correctly (vlmrun.types.ReconRef, vlmrun.types.ImageRef)

Recommended test plan: Open each notebook in Google Colab, run all cells sequentially, and verify:

  1. 3D reconstruction produces interactive Plotly visualizations
  2. Document redaction returns properly blurred images
  3. No import errors or API failures occur

Notes

- Normalize notebook metadata formatting
- Fix unicode characters in comments
- Clear cell outputs for cleaner notebook state

Co-Authored-By: [email protected] <[email protected]>
@devin-ai-integration
Copy link
Contributor Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
  • Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

  • Disable automatic comment and CI monitoring

@devin-ai-integration devin-ai-integration bot changed the title Clean up Orion 3D reconstruction and document understanding notebooks Update Orion notebooks with artifact handler support Dec 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant