Skip to content

Add skip-raw-tensors property to gvaclassify and related components#780

Open
msmiatac wants to merge 14 commits intomainfrom
remove_raw_tensors_internal_toggle
Open

Add skip-raw-tensors property to gvaclassify and related components#780
msmiatac wants to merge 14 commits intomainfrom
remove_raw_tensors_internal_toggle

Conversation

@msmiatac
Copy link
Copy Markdown
Contributor

Description

  • Removed deprecated environment variable handling for raw tensor copying.
  • Introduced a new property skip-raw-tensors to control the attachment of raw output tensors in gvaclassify.
  • Updated relevant classes and methods to handle the new property, ensuring compatibility with existing functionality.

Comment thread src/monolithic/gst/inference_elements/gvaclassify/gstgvaclassify.h Outdated
Comment thread src/monolithic/gst/inference_elements/gvaclassify/gstgvaclassify.c Outdated
Comment thread src/monolithic/gst/inference_elements/common/post_processor/converter_facade.h Outdated
Comment thread src/monolithic/gst/inference_elements/common/post_processor/converter_facade.cpp Outdated
Copy link
Copy Markdown
Contributor

@oonyshch oonyshch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mostly LGTM, please check comments 🙌

return model_proc_output_info;
}

bool shouldSkipRawTensors() const {
Copy link
Copy Markdown
Contributor

@oonyshch oonyshch Apr 15, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

overall, clean and readable accessor. one small thought: since shouldSkipRawTensors() is in protected, only derived converter classes can call it , and that's the right scope. pls consider adding a brief comment like: Returns true if raw output tensors should not be attached to inference results

msmiatac and others added 4 commits April 16, 2026 15:49
…fy.h

Co-authored-by: Lena Onyshchenko <olena.onyshchenko@intel.com>
…fy.c

Co-authored-by: Lena Onyshchenko <olena.onyshchenko@intel.com>
…nverter_facade.h

Co-authored-by: Lena Onyshchenko <olena.onyshchenko@intel.com>
…nverter_facade.cpp

Co-authored-by: Lena Onyshchenko <olena.onyshchenko@intel.com>
msmiatac and others added 7 commits April 16, 2026 15:51
…ob_to_meta_converter.h

Co-authored-by: Lena Onyshchenko <olena.onyshchenko@intel.com>
…nverters/to_tensor/text.h

Co-authored-by: Lena Onyshchenko <olena.onyshchenko@intel.com>
…nverters/to_tensor/text.cpp

Co-authored-by: Lena Onyshchenko <olena.onyshchenko@intel.com>
…nverters/to_tensor/label.cpp

Co-authored-by: Lena Onyshchenko <olena.onyshchenko@intel.com>
…nverters/to_tensor/docTR_ocr.cpp

Co-authored-by: Lena Onyshchenko <olena.onyshchenko@intel.com>
…nverters/to_tensor/blob_to_tensor_converter.h

Co-authored-by: Lena Onyshchenko <olena.onyshchenko@intel.com>
scheduling-policy : Scheduling policy across streams sharing same model instance: throughput (select first incoming frame), latency (select frames with earliest presentation time out of the streams sharing same model-instance-id; recommended batch-size less than or equal to the number of streams)
flags: readable, writable
String. Default: "throughput"
skip-raw-tensors : Skip attaching raw output tensors to metadata for gvaclassify post-processing. When false, converters may attach both interpreted results and raw tensor payloads. When true, only interpreted metadata is attached.
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you add a note (here or in a README) about the purpose of "raw tensors", use-cases of "raw tensors", please? Or add a link to where "raw tensors" are already described, please?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good point! I'll add more information on "raw tensors" purpose and use cases.

return model_proc_output_info;
}

bool shouldSkipRawTensors() const {
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  1. Can we use a common 'get' naming as it is done for other accessors/getters methods ?
    getSkipRawTensors or just skipRawTensors , i.e. without 'should'
  2. Add short comment as @oonyshch pointed out

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants