Skip to content

🐛 [Bug] Unknown output type. Only a single tensor or a TensorList type is supported. #469

Closed
@kiddyjinjin

Description

@kiddyjinjin

Bug Description

I meet some error msg when trying to trans a fastbert model using trtorch:

^[[1;35mDEBUG: ^[[0m[TRTorch Conversion Context] - Evaluating %4 : Tensor?[] = prim::ListConstruct(%rel_diff_idxs.13)
^[[1;35mDEBUG: ^[[0m[TRTorch Conversion Context] - Found the value to be: [<torch.torch.classes._trtorch_eval_ivalue_types.TensorContainer object at 0x876f0f10>]
terminate called after throwing an instance of 'trtorch::Error'
what(): [enforce fail at core/conversion/conversion.cpp:196] Unknown output type. Only a single tensor or a TensorList type is supported.

Expected behavior

support different kinds of graph output. not only tensor and tensorlist.

Environment

Build information about the TRTorch compiler can be found by turning on debug messages

  • TRTorch Version (e.g. 0.2.0): latest master version
  • PyTorch Version (e.g. 1.0): 1.8.1
  • CPU Architecture:
  • OS (e.g., Linux): linux centos6u3
  • How you installed PyTorch (conda, pip, libtorch, source): source
  • Build command you used (if compiling from source):
  • Are you using local sources or building from archives: local sources
  • Python version: python 3.6.5
  • CUDA version: cuda 10.2
  • GPU models and configuration: fastbert
  • Any other relevant information:

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions