-
Notifications
You must be signed in to change notification settings - Fork 4
Expand file tree
/
Copy pathefficientdet-lite0_fp32.log
More file actions
398 lines (398 loc) · 44 KB
/
efficientdet-lite0_fp32.log
File metadata and controls
398 lines (398 loc) · 44 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
&&&& RUNNING TensorRT.trtexec [TensorRT v8001] # /usr/src/tensorrt/bin/trtexec --onnx=/home/jetson/tensorrt-examples/cpp/efficientdet/efficientdet-lite0.onnx --workspace=200
[11/20/2021-17:57:43] [I] === Model Options ===
[11/20/2021-17:57:43] [I] Format: ONNX
[11/20/2021-17:57:43] [I] Model: /home/jetson/tensorrt-examples/cpp/efficientdet/efficientdet-lite0.onnx
[11/20/2021-17:57:43] [I] Output:
[11/20/2021-17:57:43] [I] === Build Options ===
[11/20/2021-17:57:43] [I] Max batch: explicit
[11/20/2021-17:57:43] [I] Workspace: 200 MiB
[11/20/2021-17:57:43] [I] minTiming: 1
[11/20/2021-17:57:43] [I] avgTiming: 8
[11/20/2021-17:57:43] [I] Precision: FP32
[11/20/2021-17:57:43] [I] Calibration:
[11/20/2021-17:57:43] [I] Refit: Disabled
[11/20/2021-17:57:43] [I] Sparsity: Disabled
[11/20/2021-17:57:43] [I] Safe mode: Disabled
[11/20/2021-17:57:43] [I] Restricted mode: Disabled
[11/20/2021-17:57:43] [I] Save engine:
[11/20/2021-17:57:43] [I] Load engine:
[11/20/2021-17:57:43] [I] NVTX verbosity: 0
[11/20/2021-17:57:43] [I] Tactic sources: Using default tactic sources
[11/20/2021-17:57:43] [I] timingCacheMode: local
[11/20/2021-17:57:43] [I] timingCacheFile:
[11/20/2021-17:57:43] [I] Input(s)s format: fp32:CHW
[11/20/2021-17:57:43] [I] Output(s)s format: fp32:CHW
[11/20/2021-17:57:43] [I] Input build shapes: model
[11/20/2021-17:57:43] [I] Input calibration shapes: model
[11/20/2021-17:57:43] [I] === System Options ===
[11/20/2021-17:57:43] [I] Device: 0
[11/20/2021-17:57:43] [I] DLACore:
[11/20/2021-17:57:43] [I] Plugins:
[11/20/2021-17:57:43] [I] === Inference Options ===
[11/20/2021-17:57:43] [I] Batch: Explicit
[11/20/2021-17:57:43] [I] Input inference shapes: model
[11/20/2021-17:57:43] [I] Iterations: 10
[11/20/2021-17:57:43] [I] Duration: 3s (+ 200ms warm up)
[11/20/2021-17:57:43] [I] Sleep time: 0ms
[11/20/2021-17:57:43] [I] Streams: 1
[11/20/2021-17:57:43] [I] ExposeDMA: Disabled
[11/20/2021-17:57:43] [I] Data transfers: Enabled
[11/20/2021-17:57:43] [I] Spin-wait: Disabled
[11/20/2021-17:57:43] [I] Multithreading: Disabled
[11/20/2021-17:57:43] [I] CUDA Graph: Disabled
[11/20/2021-17:57:43] [I] Separate profiling: Disabled
[11/20/2021-17:57:43] [I] Time Deserialize: Disabled
[11/20/2021-17:57:43] [I] Time Refit: Disabled
[11/20/2021-17:57:43] [I] Skip inference: Disabled
[11/20/2021-17:57:43] [I] Inputs:
[11/20/2021-17:57:43] [I] === Reporting Options ===
[11/20/2021-17:57:43] [I] Verbose: Disabled
[11/20/2021-17:57:43] [I] Averages: 10 inferences
[11/20/2021-17:57:43] [I] Percentile: 99
[11/20/2021-17:57:43] [I] Dump refittable layers:Disabled
[11/20/2021-17:57:43] [I] Dump output: Disabled
[11/20/2021-17:57:43] [I] Profile: Disabled
[11/20/2021-17:57:43] [I] Export timing to JSON file:
[11/20/2021-17:57:43] [I] Export output to JSON file:
[11/20/2021-17:57:43] [I] Export profile to JSON file:
[11/20/2021-17:57:43] [I]
[11/20/2021-17:57:44] [I] === Device Information ===
[11/20/2021-17:57:44] [I] Selected Device: NVIDIA Tegra X1
[11/20/2021-17:57:44] [I] Compute Capability: 5.3
[11/20/2021-17:57:44] [I] SMs: 1
[11/20/2021-17:57:44] [I] Compute Clock Rate: 0.9216 GHz
[11/20/2021-17:57:44] [I] Device Global Memory: 3964 MiB
[11/20/2021-17:57:44] [I] Shared Memory per SM: 64 KiB
[11/20/2021-17:57:44] [I] Memory Bus Width: 64 bits (ECC disabled)
[11/20/2021-17:57:44] [I] Memory Clock Rate: 0.01275 GHz
[11/20/2021-17:57:44] [I]
[11/20/2021-17:57:44] [I] TensorRT version: 8001
[11/20/2021-17:57:46] [I] [TRT] [MemUsageChange] Init CUDA: CPU +203, GPU +0, now: CPU 221, GPU 2982 (MiB)
[11/20/2021-17:57:46] [I] Start parsing network model
[11/20/2021-17:57:46] [I] [TRT] ----------------------------------------------------------------
[11/20/2021-17:57:46] [I] [TRT] Input filename: /home/jetson/tensorrt-examples/cpp/efficientdet/efficientdet-lite0.onnx
[11/20/2021-17:57:46] [I] [TRT] ONNX IR version: 0.0.7
[11/20/2021-17:57:46] [I] [TRT] Opset version: 11
[11/20/2021-17:57:46] [I] [TRT] Producer name:
[11/20/2021-17:57:46] [I] [TRT] Producer version:
[11/20/2021-17:57:46] [I] [TRT] Domain:
[11/20/2021-17:57:46] [I] [TRT] Model version: 0
[11/20/2021-17:57:46] [I] [TRT] Doc string:
[11/20/2021-17:57:46] [I] [TRT] ----------------------------------------------------------------
[11/20/2021-17:57:47] [11/20/2021-17:57:47] [I] [TRT] No importer registered for op: EfficientNMS_TRT. Attempting to import as plugin.
[11/20/2021-17:57:47] [I] [TRT] Searching for plugin: EfficientNMS_TRT, plugin_version: 1, plugin_namespace:
[11/20/2021-17:57:47] [I] [TRT] Successfully created plugin: EfficientNMS_TRT
[11/20/2021-17:57:47] [I] Finish parsing network model
[11/20/2021-17:57:47] [I] [TRT] [MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 237, GPU 3026 (MiB)
[11/20/2021-17:57:47] [I] [TRT] [MemUsageSnapshot] Builder begin: CPU 248 MiB, GPU 3054 MiB
[11/20/2021-17:57:48] [I] [TRT] ---------- Layers Running on DLA ----------
[11/20/2021-17:57:48] [I] [TRT] ---------- Layers Running on GPU ----------
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] preprocessor/transpose
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] preprocessor/scale_value:0 + preprocessor/scale + preprocessor/mean_value:0 + preprocessor/mean
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/stem/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite0/stem/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_0/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite0/blocks_0/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_0/conv2d/Conv2D
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_1/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_1/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_1/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite0/blocks_1/Relu6_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_1/conv2d_1/Conv2D
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_2/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_2/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_2/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite0/blocks_2/Relu6_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_2/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_2/Add
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_3/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_3/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_3/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite0/blocks_3/Relu6_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_3/conv2d_1/Conv2D
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_4/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_4/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_4/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite0/blocks_4/Relu6_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_4/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_4/Add
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_5/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_5/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_5/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite0/blocks_5/Relu6_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_5/conv2d_1/Conv2D
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_6/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_6/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_6/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite0/blocks_6/Relu6_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_6/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_6/Add
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_7/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_7/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_7/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite0/blocks_7/Relu6_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_7/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_7/Add
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_8/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_8/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_8/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite0/blocks_8/Relu6_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_8/conv2d_1/Conv2D
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_9/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_9/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_9/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite0/blocks_9/Relu6_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_9/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_9/Add
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_10/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_10/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_10/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite0/blocks_10/Relu6_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_10/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_10/Add
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_11/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_11/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_11/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite0/blocks_11/Relu6_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_11/conv2d_1/Conv2D
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_12/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_12/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_12/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite0/blocks_12/Relu6_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_12/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_12/Add
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_13/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_13/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_13/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite0/blocks_13/Relu6_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_13/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_13/Add
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_14/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_14/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_14/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite0/blocks_14/Relu6_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_14/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_14/Add
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_15/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite0/blocks_15/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_15/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite0/blocks_15/Relu6_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite0/blocks_15/conv2d_1/Conv2D
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/resample_p6/conv2d/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/resample_p6/max_pooling2d/MaxPool
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/resample_p7/max_pooling2d_1/MaxPool
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] Resize__784
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_0/fnode0/add_n/add, StatefulPartitionedCall/fpn_cells/cell_0/fnode0/op_after_combine5/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode0/op_after_combine5/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode0/op_after_combine5/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] Resize__804
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode1/resample_0_2_6/conv2d/BiasAdd + StatefulPartitionedCall/fpn_cells/cell_0/fnode1/add_n/add + StatefulPartitionedCall/fpn_cells/cell_0/fnode1/op_after_combine6/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode1/op_after_combine6/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode1/op_after_combine6/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode5/resample_0_2_10/conv2d/BiasAdd + StatefulPartitionedCall/fpn_cells/cell_0/fnode5/add_n/add
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] Resize__846
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode2/resample_0_1_7/conv2d/BiasAdd + StatefulPartitionedCall/fpn_cells/cell_0/fnode2/add_n/add + StatefulPartitionedCall/fpn_cells/cell_0/fnode2/op_after_combine7/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode2/op_after_combine7/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode2/op_after_combine7/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode4/resample_0_1_9/conv2d/BiasAdd + StatefulPartitionedCall/fpn_cells/cell_0/fnode4/add_n/add
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] Resize__864
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode3/resample_0_0_8/conv2d/BiasAdd + StatefulPartitionedCall/fpn_cells/cell_0/fnode3/add_n/add + StatefulPartitionedCall/fpn_cells/cell_0/fnode3/op_after_combine8/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode3/op_after_combine8/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode3/op_after_combine8/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode4/resample_2_8_9/max_pooling2d_2/MaxPool
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_0/fnode4/add_n/add_1, StatefulPartitionedCall/fpn_cells/cell_0/fnode4/op_after_combine9/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode4/op_after_combine9/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode4/op_after_combine9/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode5/resample_2_9_10/max_pooling2d_3/MaxPool
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_0/fnode5/add_n/add_1, StatefulPartitionedCall/fpn_cells/cell_0/fnode5/op_after_combine10/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode5/op_after_combine10/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode5/op_after_combine10/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode6/resample_2_10_11/max_pooling2d_4/MaxPool
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_0/fnode6/add_n/add, StatefulPartitionedCall/fpn_cells/cell_0/fnode6/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_0/fnode6/op_after_combine11/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode6/op_after_combine11/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode6/op_after_combine11/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode7/resample_1_11_12/max_pooling2d_5/MaxPool
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_0/fnode7/add_n/add, StatefulPartitionedCall/fpn_cells/cell_0/fnode7/op_after_combine12/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode7/op_after_combine12/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode7/op_after_combine12/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] Resize__922
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_1/fnode0/add_n/add, StatefulPartitionedCall/fpn_cells/cell_1/fnode0/op_after_combine5/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode0/op_after_combine5/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode0/op_after_combine5/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] Resize__940
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_1/fnode1/add_n/add, StatefulPartitionedCall/fpn_cells/cell_1/fnode1/op_after_combine6/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode1/op_after_combine6/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode1/op_after_combine6/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] Resize__958
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_1/fnode2/add_n/add, StatefulPartitionedCall/fpn_cells/cell_1/fnode2/op_after_combine7/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode2/op_after_combine7/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode2/op_after_combine7/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] Resize__976
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_1/fnode3/add_n/add, StatefulPartitionedCall/fpn_cells/cell_1/fnode3/op_after_combine8/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode3/op_after_combine8/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode3/op_after_combine8/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode4/resample_2_8_9/max_pooling2d_6/MaxPool
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_1/fnode4/add_n/add, StatefulPartitionedCall/fpn_cells/cell_1/fnode4/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_1/fnode4/op_after_combine9/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode4/op_after_combine9/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode4/op_after_combine9/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode5/resample_2_9_10/max_pooling2d_7/MaxPool
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_1/fnode5/add_n/add, StatefulPartitionedCall/fpn_cells/cell_1/fnode5/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_1/fnode5/op_after_combine10/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode5/op_after_combine10/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode5/op_after_combine10/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode6/resample_2_10_11/max_pooling2d_8/MaxPool
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_1/fnode6/add_n/add, StatefulPartitionedCall/fpn_cells/cell_1/fnode6/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_1/fnode6/op_after_combine11/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode6/op_after_combine11/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode6/op_after_combine11/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode7/resample_1_11_12/max_pooling2d_9/MaxPool
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_1/fnode7/add_n/add, StatefulPartitionedCall/fpn_cells/cell_1/fnode7/op_after_combine12/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode7/op_after_combine12/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode7/op_after_combine12/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] Resize__1034
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_2/fnode0/add_n/add, StatefulPartitionedCall/fpn_cells/cell_2/fnode0/op_after_combine5/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode0/op_after_combine5/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode0/op_after_combine5/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] Resize__1052
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_2/fnode1/add_n/add, StatefulPartitionedCall/fpn_cells/cell_2/fnode1/op_after_combine6/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode1/op_after_combine6/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode1/op_after_combine6/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] Resize__1070
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_2/fnode2/add_n/add, StatefulPartitionedCall/fpn_cells/cell_2/fnode2/op_after_combine7/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode2/op_after_combine7/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode2/op_after_combine7/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] Resize__1088
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_2/fnode3/add_n/add, StatefulPartitionedCall/fpn_cells/cell_2/fnode3/op_after_combine8/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode3/op_after_combine8/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode3/op_after_combine8/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode4/resample_2_8_9/max_pooling2d_10/MaxPool
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/BiasAdd + StatefulPartitionedCall/class_net/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/BiasAdd + StatefulPartitionedCall/box_net/Relu6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_2/fnode4/add_n/add, StatefulPartitionedCall/fpn_cells/cell_2/fnode4/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_2/fnode4/op_after_combine9/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode4/op_after_combine9/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode4/op_after_combine9/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/BiasAdd + StatefulPartitionedCall/class_net/Relu6_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/BiasAdd + StatefulPartitionedCall/box_net/Relu6_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode5/resample_2_9_10/max_pooling2d_11/MaxPool
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/separable_conv2d_1/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/separable_conv2d_1/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/BiasAdd_1 + StatefulPartitionedCall/class_net/Relu6_3
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/BiasAdd_1 + StatefulPartitionedCall/box_net/Relu6_3
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_2/fnode5/add_n/add, StatefulPartitionedCall/fpn_cells/cell_2/fnode5/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_2/fnode5/op_after_combine10/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode5/op_after_combine10/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/BiasAdd + StatefulPartitionedCall/class_net/Relu6_2
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/BiasAdd + StatefulPartitionedCall/box_net/Relu6_2
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode5/op_after_combine10/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/separable_conv2d_1/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/separable_conv2d_1/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/BiasAdd_1 + StatefulPartitionedCall/class_net/Relu6_4
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/BiasAdd_1 + StatefulPartitionedCall/box_net/Relu6_4
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode6/resample_2_10_11/max_pooling2d_12/MaxPool
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/separable_conv2d_2/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/separable_conv2d_2/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/BiasAdd_2 + StatefulPartitionedCall/class_net/Relu6_6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/BiasAdd_2 + StatefulPartitionedCall/box_net/Relu6_6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_2/fnode6/add_n/add, StatefulPartitionedCall/fpn_cells/cell_2/fnode6/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_2/fnode6/op_after_combine11/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/separable_conv2d_1/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/separable_conv2d_1/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode6/op_after_combine11/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/BiasAdd_1 + StatefulPartitionedCall/class_net/Relu6_5
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/BiasAdd_1 + StatefulPartitionedCall/box_net/Relu6_5
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd__1396 + StatefulPartitionedCall/Reshape
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd__1434 + StatefulPartitionedCall/Reshape_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode6/op_after_combine11/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/separable_conv2d_2/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/separable_conv2d_2/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/BiasAdd_2 + StatefulPartitionedCall/class_net/Relu6_7
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/BiasAdd_2 + StatefulPartitionedCall/box_net/Relu6_7
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode7/resample_1_11_12/max_pooling2d_13/MaxPool
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/separable_conv2d_3/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/separable_conv2d_3/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/separable_conv2d_1/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/separable_conv2d_1/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/BiasAdd_3 + StatefulPartitionedCall/class_net/Relu6_9
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/BiasAdd_3 + StatefulPartitionedCall/box_net/Relu6_9
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd_1
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_2/fnode7/add_n/add, StatefulPartitionedCall/fpn_cells/cell_2/fnode7/op_after_combine12/Relu6)
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/separable_conv2d_2/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/separable_conv2d_2/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode7/op_after_combine12/conv/separable_conv2d/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/BiasAdd_2 + StatefulPartitionedCall/class_net/Relu6_8
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/BiasAdd_2 + StatefulPartitionedCall/box_net/Relu6_8
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd_1__1338 + StatefulPartitionedCall/Reshape_2
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd_1__1367 + StatefulPartitionedCall/Reshape_3
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode7/op_after_combine12/conv/BiasAdd
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/separable_conv2d_3/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/separable_conv2d_3/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/BiasAdd_3 + StatefulPartitionedCall/class_net/Relu6_10
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/BiasAdd_3 + StatefulPartitionedCall/box_net/Relu6_10
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/separable_conv2d_4/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/separable_conv2d_4/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/separable_conv2d_2/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/separable_conv2d_2/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/BiasAdd_4 + StatefulPartitionedCall/class_net/Relu6_12
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/BiasAdd_4 + StatefulPartitionedCall/box_net/Relu6_12
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd_2
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd_2
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/separable_conv2d_3/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/separable_conv2d_3/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/BiasAdd_3 + StatefulPartitionedCall/class_net/Relu6_11
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/BiasAdd_3 + StatefulPartitionedCall/box_net/Relu6_11
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd_2__1280 + StatefulPartitionedCall/Reshape_4
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd_2__1309 + StatefulPartitionedCall/Reshape_5
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/separable_conv2d_4/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/separable_conv2d_4/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/BiasAdd_4 + StatefulPartitionedCall/class_net/Relu6_13
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/BiasAdd_4 + StatefulPartitionedCall/box_net/Relu6_13
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/separable_conv2d_3/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/separable_conv2d_3/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd_3
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd_3
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/separable_conv2d_4/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/separable_conv2d_4/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/BiasAdd_4 + StatefulPartitionedCall/class_net/Relu6_14
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/BiasAdd_4 + StatefulPartitionedCall/box_net/Relu6_14
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd_3__1222 + StatefulPartitionedCall/Reshape_6
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd_3__1251 + StatefulPartitionedCall/Reshape_7
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/separable_conv2d_4/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/separable_conv2d_4/depthwise
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd_4
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd_4
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd_4__1164 + StatefulPartitionedCall/Reshape_8
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd_4__1193 + StatefulPartitionedCall/Reshape_9
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape:0 copy
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_2:0 copy
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_4:0 copy
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_6:0 copy
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_8:0 copy
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_1:0 copy
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_3:0 copy
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_5:0 copy
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_7:0 copy
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_9:0 copy
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] nms/anchors:0
[11/20/2021-17:57:48] [I] [TRT] [GpuLayer] nms/non_maximum_suppression
[11/20/2021-17:57:49] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +158, GPU +280, now: CPU 409, GPU 3335 (MiB)
[11/20/2021-17:57:52] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +241, GPU +137, now: CPU 650, GPU 3472 (MiB)
[11/20/2021-17:57:52] [11/20/2021-17:58:33] [I] [TRT] Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output.
[11/20/2021-18:04:13] [I] [TRT] Detected 1 inputs and 4 output network tensors.
[11/20/2021-18:04:14] [I] [TRT] Total Host Persistent Memory: 297280
[11/20/2021-18:04:14] [I] [TRT] Total Device Persistent Memory: 13392896
[11/20/2021-18:04:14] [I] [TRT] Total Scratch Memory: 41486592
[11/20/2021-18:04:14] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 12 MiB, GPU 195 MiB
[11/20/2021-18:04:14] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 900, GPU 3465 (MiB)
[11/20/2021-18:04:14] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 900, GPU 3465 (MiB)
[11/20/2021-18:04:14] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 900, GPU 3465 (MiB)
[11/20/2021-18:04:14] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 900, GPU 3465 (MiB)
[11/20/2021-18:04:14] [I] [TRT] [MemUsageSnapshot] Builder end: CPU 899 MiB, GPU 3465 MiB
[11/20/2021-18:04:14] [I] [TRT] Loaded engine size: 16 MB
[11/20/2021-18:04:14] [I] [TRT] [MemUsageSnapshot] deserializeCudaEngine begin: CPU 910 MiB, GPU 3453 MiB
[11/20/2021-18:04:14] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 913, GPU 3453 (MiB)
[11/20/2021-18:04:14] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 913, GPU 3453 (MiB)
[11/20/2021-18:04:14] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 913, GPU 3453 (MiB)
[11/20/2021-18:04:14] [I] [TRT] [MemUsageSnapshot] deserializeCudaEngine end: CPU 913 MiB, GPU 3453 MiB
[11/20/2021-18:04:14] [I] Engine built in 390.452 sec.
[11/20/2021-18:04:14] [I] [TRT] [MemUsageSnapshot] ExecutionContext creation begin: CPU 881 MiB, GPU 3438 MiB
[11/20/2021-18:04:14] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 881, GPU 3438 (MiB)
[11/20/2021-18:04:14] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 881, GPU 3438 (MiB)
[11/20/2021-18:04:14] [I] [TRT] [MemUsageSnapshot] ExecutionContext creation end: CPU 882 MiB, GPU 3438 MiB
[11/20/2021-18:04:14] [I] Created input binding for images:0 with dimensions 1x320x320x3
[11/20/2021-18:04:14] [I] Created output binding for num_detections with dimensions 1x1
[11/20/2021-18:04:14] [I] Created output binding for detection_boxes with dimensions 1x100x4
[11/20/2021-18:04:14] [I] Created output binding for detection_scores with dimensions 1x100
[11/20/2021-18:04:14] [I] Created output binding for detection_classes with dimensions 1x100
[11/20/2021-18:04:14] [I] Starting inference
[11/20/2021-18:04:17] [I] Warmup completed 5 queries over 200 ms
[11/20/2021-18:04:17] [I] Timing trace has 67 queries over 3.08872 s
[11/20/2021-18:04:17] [I]
[11/20/2021-18:04:17] [I] === Trace details ===
[11/20/2021-18:04:17] [I] Trace averages of 10 runs:
[11/20/2021-18:04:17] [I] Average on 10 runs - GPU latency: 45.8679 ms - Host latency: 45.9954 ms (end to end 46.0078 ms, enqueue 11.4107 ms)
[11/20/2021-18:04:17] [I] Average on 10 runs - GPU latency: 45.9935 ms - Host latency: 46.1213 ms (end to end 46.1336 ms, enqueue 10.8668 ms)
[11/20/2021-18:04:17] [I] Average on 10 runs - GPU latency: 45.9738 ms - Host latency: 46.1024 ms (end to end 46.1148 ms, enqueue 10.7901 ms)
[11/20/2021-18:04:17] [I] Average on 10 runs - GPU latency: 45.9727 ms - Host latency: 46.1006 ms (end to end 46.113 ms, enqueue 10.8352 ms)
[11/20/2021-18:04:17] [I] Average on 10 runs - GPU latency: 46.0053 ms - Host latency: 46.1333 ms (end to end 46.1457 ms, enqueue 10.8227 ms)
[11/20/2021-18:04:17] [I] Average on 10 runs - GPU latency: 45.8835 ms - Host latency: 46.0112 ms (end to end 46.0236 ms, enqueue 10.7799 ms)
[11/20/2021-18:04:17] [I]
[11/20/2021-18:04:17] [I] === Performance summary ===
[11/20/2021-18:04:17] [I] Throughput: 21.6919 qps
[11/20/2021-18:04:17] [I] Latency: min = 45.8821 ms, max = 47.1323 ms, mean = 46.0873 ms, median = 46.0159 ms, percentile(99%) = 47.1323 ms
[11/20/2021-18:04:17] [I] End-to-End Host Latency: min = 45.8942 ms, max = 47.1448 ms, mean = 46.0997 ms, median = 46.0281 ms, percentile(99%) = 47.1448 ms
[11/20/2021-18:04:17] [I] Enqueue Time: min = 10.603 ms, max = 11.8926 ms, mean = 10.9387 ms, median = 10.8059 ms, percentile(99%) = 11.8926 ms
[11/20/2021-18:04:17] [I] H2D Latency: min = 0.118652 ms, max = 0.123535 ms, mean = 0.120089 ms, median = 0.119873 ms, percentile(99%) = 0.123535 ms
[11/20/2021-18:04:17] [I] GPU Compute Time: min = 45.754 ms, max = 47.0054 ms, mean = 45.9594 ms, median = 45.8879 ms, percentile(99%) = 47.0054 ms
[11/20/2021-18:04:17] [I] D2H Latency: min = 0.00512695 ms, max = 0.00878906 ms, mean = 0.00779383 ms, median = 0.00793457 ms, percentile(99%) = 0.00878906 ms
[11/20/2021-18:04:17] [I] Total Host Walltime: 3.08872 s
[11/20/2021-18:04:17] [I] Total GPU Compute Time: 3.07928 s
[11/20/2021-18:04:17] [I] Explanations of the performance metrics are printed in the verbose logs.
[11/20/2021-18:04:17] [I]
&&&& PASSED TensorRT.trtexec [TensorRT v8001] # /usr/src/tensorrt/bin/trtexec --onnx=/home/jetson/tensorrt-examples/cpp/efficientdet/efficientdet-lite0.onnx --workspace=200
[11/20/2021-18:04:17] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 881, GPU 3438 (MiB)