-
Notifications
You must be signed in to change notification settings - Fork 4
Expand file tree
/
Copy pathefficientdet-lite3_fp16.log
More file actions
533 lines (533 loc) · 63.1 KB
/
efficientdet-lite3_fp16.log
File metadata and controls
533 lines (533 loc) · 63.1 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
&&&& RUNNING TensorRT.trtexec [TensorRT v8001] # /usr/src/tensorrt/bin/trtexec --onnx=/home/jetson/tensorrt-examples/cpp/efficientdet/efficientdet-lite3.onnx --workspace=200 --fp16
[11/17/2021-22:11:23] [I] === Model Options ===
[11/17/2021-22:11:23] [I] Format: ONNX
[11/17/2021-22:11:23] [I] Model: /home/jetson/tensorrt-examples/cpp/efficientdet/efficientdet-lite3.onnx
[11/17/2021-22:11:23] [I] Output:
[11/17/2021-22:11:23] [I] === Build Options ===
[11/17/2021-22:11:23] [I] Max batch: explicit
[11/17/2021-22:11:23] [I] Workspace: 200 MiB
[11/17/2021-22:11:23] [I] minTiming: 1
[11/17/2021-22:11:23] [I] avgTiming: 8
[11/17/2021-22:11:23] [I] Precision: FP32+FP16
[11/17/2021-22:11:23] [I] Calibration:
[11/17/2021-22:11:23] [I] Refit: Disabled
[11/17/2021-22:11:23] [I] Sparsity: Disabled
[11/17/2021-22:11:23] [I] Safe mode: Disabled
[11/17/2021-22:11:23] [I] Restricted mode: Disabled
[11/17/2021-22:11:23] [I] Save engine:
[11/17/2021-22:11:23] [I] Load engine:
[11/17/2021-22:11:23] [I] NVTX verbosity: 0
[11/17/2021-22:11:23] [I] Tactic sources: Using default tactic sources
[11/17/2021-22:11:23] [I] timingCacheMode: local
[11/17/2021-22:11:23] [I] timingCacheFile:
[11/17/2021-22:11:23] [I] Input(s)s format: fp32:CHW
[11/17/2021-22:11:23] [I] Output(s)s format: fp32:CHW
[11/17/2021-22:11:23] [I] Input build shapes: model
[11/17/2021-22:11:23] [I] Input calibration shapes: model
[11/17/2021-22:11:23] [I] === System Options ===
[11/17/2021-22:11:23] [I] Device: 0
[11/17/2021-22:11:23] [I] DLACore:
[11/17/2021-22:11:23] [I] Plugins:
[11/17/2021-22:11:23] [I] === Inference Options ===
[11/17/2021-22:11:23] [I] Batch: Explicit
[11/17/2021-22:11:23] [I] Input inference shapes: model
[11/17/2021-22:11:23] [I] Iterations: 10
[11/17/2021-22:11:23] [I] Duration: 3s (+ 200ms warm up)
[11/17/2021-22:11:23] [I] Sleep time: 0ms
[11/17/2021-22:11:23] [I] Streams: 1
[11/17/2021-22:11:23] [I] ExposeDMA: Disabled
[11/17/2021-22:11:23] [I] Data transfers: Enabled
[11/17/2021-22:11:23] [I] Spin-wait: Disabled
[11/17/2021-22:11:23] [I] Multithreading: Disabled
[11/17/2021-22:11:23] [I] CUDA Graph: Disabled
[11/17/2021-22:11:23] [I] Separate profiling: Disabled
[11/17/2021-22:11:23] [I] Time Deserialize: Disabled
[11/17/2021-22:11:23] [I] Time Refit: Disabled
[11/17/2021-22:11:23] [I] Skip inference: Disabled
[11/17/2021-22:11:23] [I] Inputs:
[11/17/2021-22:11:23] [I] === Reporting Options ===
[11/17/2021-22:11:23] [I] Verbose: Disabled
[11/17/2021-22:11:23] [I] Averages: 10 inferences
[11/17/2021-22:11:23] [I] Percentile: 99
[11/17/2021-22:11:23] [I] Dump refittable layers:Disabled
[11/17/2021-22:11:23] [I] Dump output: Disabled
[11/17/2021-22:11:23] [I] Profile: Disabled
[11/17/2021-22:11:23] [I] Export timing to JSON file:
[11/17/2021-22:11:23] [I] Export output to JSON file:
[11/17/2021-22:11:23] [I] Export profile to JSON file:
[11/17/2021-22:11:23] [I]
[11/17/2021-22:11:23] [I] === Device Information ===
[11/17/2021-22:11:23] [I] Selected Device: NVIDIA Tegra X1
[11/17/2021-22:11:23] [I] Compute Capability: 5.3
[11/17/2021-22:11:23] [I] SMs: 1
[11/17/2021-22:11:23] [I] Compute Clock Rate: 0.9216 GHz
[11/17/2021-22:11:23] [I] Device Global Memory: 3964 MiB
[11/17/2021-22:11:23] [I] Shared Memory per SM: 64 KiB
[11/17/2021-22:11:23] [I] Memory Bus Width: 64 bits (ECC disabled)
[11/17/2021-22:11:23] [I] Memory Clock Rate: 0.01275 GHz
[11/17/2021-22:11:23] [I]
[11/17/2021-22:11:23] [I] TensorRT version: 8001
[11/17/2021-22:11:24] [I] [TRT] [MemUsageChange] Init CUDA: CPU +203, GPU +0, now: CPU 221, GPU 2638 (MiB)
[11/17/2021-22:11:24] [I] Start parsing network model
[11/17/2021-22:11:24] [I] [TRT] ----------------------------------------------------------------
[11/17/2021-22:11:24] [I] [TRT] Input filename: /home/jetson/tensorrt-examples/cpp/efficientdet/efficientdet-lite3.onnx
[11/17/2021-22:11:24] [I] [TRT] ONNX IR version: 0.0.7
[11/17/2021-22:11:24] [I] [TRT] Opset version: 11
[11/17/2021-22:11:24] [I] [TRT] Producer name:
[11/17/2021-22:11:24] [I] [TRT] Producer version:
[11/17/2021-22:11:24] [I] [TRT] Domain:
[11/17/2021-22:11:24] [I] [TRT] Model version: 0
[11/17/2021-22:11:24] [I] [TRT] Doc string:
[11/17/2021-22:11:24] [I] [TRT] ----------------------------------------------------------------
[11/17/2021-22:11:24] [11/17/2021-22:11:25] [I] [TRT] No importer registered for op: EfficientNMS_TRT. Attempting to import as plugin.
[11/17/2021-22:11:25] [I] [TRT] Searching for plugin: EfficientNMS_TRT, plugin_version: 1, plugin_namespace:
[11/17/2021-22:11:25] [I] [TRT] Successfully created plugin: EfficientNMS_TRT
[11/17/2021-22:11:25] [I] Finish parsing network model
[11/17/2021-22:11:25] [I] [TRT] [MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 259, GPU 2743 (MiB)
[11/17/2021-22:11:25] [I] [TRT] [MemUsageSnapshot] Builder begin: CPU 270 MiB, GPU 2743 MiB
[11/17/2021-22:11:26] [I] [TRT] ---------- Layers Running on DLA ----------
[11/17/2021-22:11:26] [I] [TRT] ---------- Layers Running on GPU ----------
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] preprocessor/transpose
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] preprocessor/scale_value:0 + preprocessor/scale + preprocessor/mean_value:0 + preprocessor/mean
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/stem/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/stem/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_0/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_0/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_0/conv2d/Conv2D
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_1/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_1/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_1/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_1/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_1/conv2d_1/Conv2D
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_2/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_2/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_2/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_2/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_2/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_2/Add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_3/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_3/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_3/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_3/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_3/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_3/Add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_4/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_4/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_4/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_4/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_4/conv2d_1/Conv2D
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_5/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_5/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_5/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_5/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_5/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_5/Add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_6/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_6/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_6/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_6/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_6/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_6/Add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_7/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_7/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_7/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_7/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_7/conv2d_1/Conv2D
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_8/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_8/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_8/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_8/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_8/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_8/Add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_9/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_9/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_9/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_9/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_9/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_9/Add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_10/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_10/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_10/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_10/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_10/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_10/Add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_11/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_11/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_11/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_11/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_11/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_11/Add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_12/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_12/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_12/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_12/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_12/conv2d_1/Conv2D
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_13/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_13/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_13/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_13/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_13/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_13/Add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_14/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_14/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_14/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_14/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_14/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_14/Add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_15/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_15/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_15/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_15/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_15/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_15/Add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_16/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_16/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_16/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_16/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_16/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_16/Add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_17/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_17/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_17/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_17/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_17/conv2d_1/Conv2D
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_18/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_18/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_18/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_18/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_18/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_18/Add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_19/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_19/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_19/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_19/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_19/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_19/Add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_20/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_20/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_20/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_20/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_20/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_20/Add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_21/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_21/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_21/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_21/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_21/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_21/Add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_22/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_22/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_22/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_22/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_22/conv2d_1/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_22/Add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_23/conv2d/Conv2D + StatefulPartitionedCall/efficientnet-lite3/blocks_23/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_23/depthwise_conv2d/depthwise + StatefulPartitionedCall/efficientnet-lite3/blocks_23/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/efficientnet-lite3/blocks_23/conv2d_1/Conv2D
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/resample_p6/conv2d/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/resample_p6/max_pooling2d/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/resample_p7/max_pooling2d_1/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1138
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_0/fnode0/add_n/add, StatefulPartitionedCall/fpn_cells/cell_0/fnode0/op_after_combine5/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode0/op_after_combine5/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode0/op_after_combine5/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1158
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode1/resample_0_2_6/conv2d/BiasAdd + StatefulPartitionedCall/fpn_cells/cell_0/fnode1/add_n/add + StatefulPartitionedCall/fpn_cells/cell_0/fnode1/op_after_combine6/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode1/op_after_combine6/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode1/op_after_combine6/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode5/resample_0_2_10/conv2d/BiasAdd + StatefulPartitionedCall/fpn_cells/cell_0/fnode5/add_n/add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1200
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode2/resample_0_1_7/conv2d/BiasAdd + StatefulPartitionedCall/fpn_cells/cell_0/fnode2/add_n/add + StatefulPartitionedCall/fpn_cells/cell_0/fnode2/op_after_combine7/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode2/op_after_combine7/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode2/op_after_combine7/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode4/resample_0_1_9/conv2d/BiasAdd + StatefulPartitionedCall/fpn_cells/cell_0/fnode4/add_n/add
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1218
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode3/resample_0_0_8/conv2d/BiasAdd + StatefulPartitionedCall/fpn_cells/cell_0/fnode3/add_n/add + StatefulPartitionedCall/fpn_cells/cell_0/fnode3/op_after_combine8/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode3/op_after_combine8/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode3/op_after_combine8/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode4/resample_2_8_9/max_pooling2d_2/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_0/fnode4/add_n/add_1, StatefulPartitionedCall/fpn_cells/cell_0/fnode4/op_after_combine9/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode4/op_after_combine9/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode4/op_after_combine9/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode5/resample_2_9_10/max_pooling2d_3/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_0/fnode5/add_n/add_1, StatefulPartitionedCall/fpn_cells/cell_0/fnode5/op_after_combine10/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode5/op_after_combine10/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode5/op_after_combine10/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode6/resample_2_10_11/max_pooling2d_4/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_0/fnode6/add_n/add, StatefulPartitionedCall/fpn_cells/cell_0/fnode6/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_0/fnode6/op_after_combine11/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode6/op_after_combine11/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode6/op_after_combine11/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode7/resample_1_11_12/max_pooling2d_5/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_0/fnode7/add_n/add, StatefulPartitionedCall/fpn_cells/cell_0/fnode7/op_after_combine12/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode7/op_after_combine12/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_0/fnode7/op_after_combine12/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1276
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_1/fnode0/add_n/add, StatefulPartitionedCall/fpn_cells/cell_1/fnode0/op_after_combine5/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode0/op_after_combine5/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode0/op_after_combine5/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1294
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_1/fnode1/add_n/add, StatefulPartitionedCall/fpn_cells/cell_1/fnode1/op_after_combine6/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode1/op_after_combine6/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode1/op_after_combine6/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1312
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_1/fnode2/add_n/add, StatefulPartitionedCall/fpn_cells/cell_1/fnode2/op_after_combine7/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode2/op_after_combine7/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode2/op_after_combine7/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1330
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_1/fnode3/add_n/add, StatefulPartitionedCall/fpn_cells/cell_1/fnode3/op_after_combine8/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode3/op_after_combine8/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode3/op_after_combine8/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode4/resample_2_8_9/max_pooling2d_6/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_1/fnode4/add_n/add, StatefulPartitionedCall/fpn_cells/cell_1/fnode4/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_1/fnode4/op_after_combine9/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode4/op_after_combine9/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode4/op_after_combine9/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode5/resample_2_9_10/max_pooling2d_7/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_1/fnode5/add_n/add, StatefulPartitionedCall/fpn_cells/cell_1/fnode5/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_1/fnode5/op_after_combine10/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode5/op_after_combine10/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode5/op_after_combine10/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode6/resample_2_10_11/max_pooling2d_8/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_1/fnode6/add_n/add, StatefulPartitionedCall/fpn_cells/cell_1/fnode6/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_1/fnode6/op_after_combine11/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode6/op_after_combine11/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode6/op_after_combine11/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode7/resample_1_11_12/max_pooling2d_9/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_1/fnode7/add_n/add, StatefulPartitionedCall/fpn_cells/cell_1/fnode7/op_after_combine12/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode7/op_after_combine12/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_1/fnode7/op_after_combine12/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1388
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_2/fnode0/add_n/add, StatefulPartitionedCall/fpn_cells/cell_2/fnode0/op_after_combine5/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode0/op_after_combine5/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode0/op_after_combine5/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1406
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_2/fnode1/add_n/add, StatefulPartitionedCall/fpn_cells/cell_2/fnode1/op_after_combine6/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode1/op_after_combine6/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode1/op_after_combine6/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1424
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_2/fnode2/add_n/add, StatefulPartitionedCall/fpn_cells/cell_2/fnode2/op_after_combine7/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode2/op_after_combine7/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode2/op_after_combine7/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1442
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_2/fnode3/add_n/add, StatefulPartitionedCall/fpn_cells/cell_2/fnode3/op_after_combine8/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode3/op_after_combine8/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode3/op_after_combine8/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode4/resample_2_8_9/max_pooling2d_10/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_2/fnode4/add_n/add, StatefulPartitionedCall/fpn_cells/cell_2/fnode4/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_2/fnode4/op_after_combine9/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode4/op_after_combine9/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode4/op_after_combine9/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode5/resample_2_9_10/max_pooling2d_11/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_2/fnode5/add_n/add, StatefulPartitionedCall/fpn_cells/cell_2/fnode5/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_2/fnode5/op_after_combine10/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode5/op_after_combine10/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode5/op_after_combine10/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode6/resample_2_10_11/max_pooling2d_12/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_2/fnode6/add_n/add, StatefulPartitionedCall/fpn_cells/cell_2/fnode6/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_2/fnode6/op_after_combine11/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode6/op_after_combine11/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode6/op_after_combine11/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode7/resample_1_11_12/max_pooling2d_13/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_2/fnode7/add_n/add, StatefulPartitionedCall/fpn_cells/cell_2/fnode7/op_after_combine12/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode7/op_after_combine12/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_2/fnode7/op_after_combine12/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1500
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_3/fnode0/add_n/add, StatefulPartitionedCall/fpn_cells/cell_3/fnode0/op_after_combine5/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode0/op_after_combine5/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode0/op_after_combine5/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1518
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_3/fnode1/add_n/add, StatefulPartitionedCall/fpn_cells/cell_3/fnode1/op_after_combine6/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode1/op_after_combine6/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode1/op_after_combine6/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1536
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_3/fnode2/add_n/add, StatefulPartitionedCall/fpn_cells/cell_3/fnode2/op_after_combine7/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode2/op_after_combine7/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode2/op_after_combine7/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1554
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_3/fnode3/add_n/add, StatefulPartitionedCall/fpn_cells/cell_3/fnode3/op_after_combine8/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode3/op_after_combine8/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode3/op_after_combine8/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode4/resample_2_8_9/max_pooling2d_14/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_3/fnode4/add_n/add, StatefulPartitionedCall/fpn_cells/cell_3/fnode4/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_3/fnode4/op_after_combine9/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode4/op_after_combine9/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode4/op_after_combine9/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode5/resample_2_9_10/max_pooling2d_15/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_3/fnode5/add_n/add, StatefulPartitionedCall/fpn_cells/cell_3/fnode5/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_3/fnode5/op_after_combine10/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode5/op_after_combine10/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode5/op_after_combine10/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode6/resample_2_10_11/max_pooling2d_16/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_3/fnode6/add_n/add, StatefulPartitionedCall/fpn_cells/cell_3/fnode6/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_3/fnode6/op_after_combine11/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode6/op_after_combine11/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode6/op_after_combine11/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode7/resample_1_11_12/max_pooling2d_17/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_3/fnode7/add_n/add, StatefulPartitionedCall/fpn_cells/cell_3/fnode7/op_after_combine12/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode7/op_after_combine12/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_3/fnode7/op_after_combine12/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1612
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_4/fnode0/add_n/add, StatefulPartitionedCall/fpn_cells/cell_4/fnode0/op_after_combine5/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode0/op_after_combine5/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode0/op_after_combine5/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1630
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_4/fnode1/add_n/add, StatefulPartitionedCall/fpn_cells/cell_4/fnode1/op_after_combine6/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode1/op_after_combine6/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode1/op_after_combine6/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1648
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_4/fnode2/add_n/add, StatefulPartitionedCall/fpn_cells/cell_4/fnode2/op_after_combine7/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode2/op_after_combine7/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode2/op_after_combine7/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1666
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_4/fnode3/add_n/add, StatefulPartitionedCall/fpn_cells/cell_4/fnode3/op_after_combine8/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode3/op_after_combine8/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode3/op_after_combine8/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode4/resample_2_8_9/max_pooling2d_18/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_4/fnode4/add_n/add, StatefulPartitionedCall/fpn_cells/cell_4/fnode4/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_4/fnode4/op_after_combine9/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode4/op_after_combine9/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode4/op_after_combine9/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode5/resample_2_9_10/max_pooling2d_19/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_4/fnode5/add_n/add, StatefulPartitionedCall/fpn_cells/cell_4/fnode5/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_4/fnode5/op_after_combine10/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode5/op_after_combine10/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode5/op_after_combine10/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode6/resample_2_10_11/max_pooling2d_20/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_4/fnode6/add_n/add, StatefulPartitionedCall/fpn_cells/cell_4/fnode6/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_4/fnode6/op_after_combine11/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode6/op_after_combine11/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode6/op_after_combine11/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode7/resample_1_11_12/max_pooling2d_21/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_4/fnode7/add_n/add, StatefulPartitionedCall/fpn_cells/cell_4/fnode7/op_after_combine12/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode7/op_after_combine12/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_4/fnode7/op_after_combine12/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1724
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_5/fnode0/add_n/add, StatefulPartitionedCall/fpn_cells/cell_5/fnode0/op_after_combine5/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode0/op_after_combine5/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode0/op_after_combine5/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1742
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_5/fnode1/add_n/add, StatefulPartitionedCall/fpn_cells/cell_5/fnode1/op_after_combine6/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode1/op_after_combine6/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode1/op_after_combine6/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1760
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_5/fnode2/add_n/add, StatefulPartitionedCall/fpn_cells/cell_5/fnode2/op_after_combine7/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode2/op_after_combine7/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode2/op_after_combine7/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] Resize__1778
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_5/fnode3/add_n/add, StatefulPartitionedCall/fpn_cells/cell_5/fnode3/op_after_combine8/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode3/op_after_combine8/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode3/op_after_combine8/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode4/resample_2_8_9/max_pooling2d_22/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/BiasAdd + StatefulPartitionedCall/class_net/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/BiasAdd + StatefulPartitionedCall/box_net/Relu6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_5/fnode4/add_n/add, StatefulPartitionedCall/fpn_cells/cell_5/fnode4/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_5/fnode4/op_after_combine9/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode4/op_after_combine9/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode4/op_after_combine9/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/BiasAdd + StatefulPartitionedCall/class_net/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/BiasAdd + StatefulPartitionedCall/box_net/Relu6_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode5/resample_2_9_10/max_pooling2d_23/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/separable_conv2d_1/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/separable_conv2d_1/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/BiasAdd_1 + StatefulPartitionedCall/class_net/Relu6_4
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/BiasAdd_1 + StatefulPartitionedCall/box_net/Relu6_4
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_5/fnode5/add_n/add, StatefulPartitionedCall/fpn_cells/cell_5/fnode5/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_5/fnode5/op_after_combine10/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode5/op_after_combine10/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/BiasAdd + StatefulPartitionedCall/class_net/Relu6_2
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/BiasAdd + StatefulPartitionedCall/box_net/Relu6_2
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode5/op_after_combine10/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/separable_conv2d_1/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/separable_conv2d_1/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/BiasAdd_1 + StatefulPartitionedCall/class_net/Relu6_5
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/BiasAdd_1 + StatefulPartitionedCall/box_net/Relu6_5
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode6/resample_2_10_11/max_pooling2d_24/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/separable_conv2d_2/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/separable_conv2d_2/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-3/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-3/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/BiasAdd_2 + StatefulPartitionedCall/class_net/Relu6_8
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/BiasAdd_2 + StatefulPartitionedCall/box_net/Relu6_8
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-3/BiasAdd + StatefulPartitionedCall/class_net/Relu6_3
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-3/BiasAdd + StatefulPartitionedCall/box_net/Relu6_3
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(PWN(StatefulPartitionedCall/fpn_cells/cell_5/fnode6/add_n/add, StatefulPartitionedCall/fpn_cells/cell_5/fnode6/add_n/add_1), StatefulPartitionedCall/fpn_cells/cell_5/fnode6/op_after_combine11/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/separable_conv2d_1/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/separable_conv2d_1/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode6/op_after_combine11/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/BiasAdd_1 + StatefulPartitionedCall/class_net/Relu6_6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/BiasAdd_1 + StatefulPartitionedCall/box_net/Relu6_6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode6/op_after_combine11/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/separable_conv2d_2/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/separable_conv2d_2/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/BiasAdd_2 + StatefulPartitionedCall/class_net/Relu6_9
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/BiasAdd_2 + StatefulPartitionedCall/box_net/Relu6_9
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode7/resample_1_11_12/max_pooling2d_25/MaxPool
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/separable_conv2d_3/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/separable_conv2d_3/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-3/separable_conv2d_1/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-3/separable_conv2d_1/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/BiasAdd_3 + StatefulPartitionedCall/class_net/Relu6_12
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/BiasAdd_3 + StatefulPartitionedCall/box_net/Relu6_12
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-3/BiasAdd_1 + StatefulPartitionedCall/class_net/Relu6_7
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-3/BiasAdd_1 + StatefulPartitionedCall/box_net/Relu6_7
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd__2158 + StatefulPartitionedCall/Reshape
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd__2204 + StatefulPartitionedCall/Reshape_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] PWN(StatefulPartitionedCall/fpn_cells/cell_5/fnode7/add_n/add, StatefulPartitionedCall/fpn_cells/cell_5/fnode7/op_after_combine12/Relu6)
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/separable_conv2d_2/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/separable_conv2d_2/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode7/op_after_combine12/conv/separable_conv2d/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/BiasAdd_2 + StatefulPartitionedCall/class_net/Relu6_10
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/BiasAdd_2 + StatefulPartitionedCall/box_net/Relu6_10
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/fpn_cells/cell_5/fnode7/op_after_combine12/conv/BiasAdd
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/separable_conv2d_3/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/separable_conv2d_3/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/separable_conv2d_1/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/separable_conv2d_1/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/BiasAdd_3 + StatefulPartitionedCall/class_net/Relu6_13
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/BiasAdd_3 + StatefulPartitionedCall/box_net/Relu6_13
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd_1
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/separable_conv2d_4/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/separable_conv2d_4/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-3/separable_conv2d_2/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-3/separable_conv2d_2/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-0/BiasAdd_4 + StatefulPartitionedCall/class_net/Relu6_16
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-0/BiasAdd_4 + StatefulPartitionedCall/box_net/Relu6_16
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-3/BiasAdd_2 + StatefulPartitionedCall/class_net/Relu6_11
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-3/BiasAdd_2 + StatefulPartitionedCall/box_net/Relu6_11
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd_1__2084 + StatefulPartitionedCall/Reshape_2
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd_1__2121 + StatefulPartitionedCall/Reshape_3
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/separable_conv2d_3/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/separable_conv2d_3/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/BiasAdd_3 + StatefulPartitionedCall/class_net/Relu6_14
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/BiasAdd_3 + StatefulPartitionedCall/box_net/Relu6_14
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/separable_conv2d_4/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/separable_conv2d_4/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/separable_conv2d_2/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/separable_conv2d_2/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-1/BiasAdd_4 + StatefulPartitionedCall/class_net/Relu6_17
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-1/BiasAdd_4 + StatefulPartitionedCall/box_net/Relu6_17
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd_2
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd_2
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-3/separable_conv2d_3/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-3/separable_conv2d_3/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-3/BiasAdd_3 + StatefulPartitionedCall/class_net/Relu6_15
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-3/BiasAdd_3 + StatefulPartitionedCall/box_net/Relu6_15
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd_2__2010 + StatefulPartitionedCall/Reshape_4
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd_2__2047 + StatefulPartitionedCall/Reshape_5
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/separable_conv2d_4/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/separable_conv2d_4/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-2/BiasAdd_4 + StatefulPartitionedCall/class_net/Relu6_18
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-2/BiasAdd_4 + StatefulPartitionedCall/box_net/Relu6_18
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/separable_conv2d_3/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/separable_conv2d_3/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd_3
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd_3
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-3/separable_conv2d_4/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-3/separable_conv2d_4/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-3/BiasAdd_4 + StatefulPartitionedCall/class_net/Relu6_19
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-3/BiasAdd_4 + StatefulPartitionedCall/box_net/Relu6_19
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd_3__1936 + StatefulPartitionedCall/Reshape_6
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd_3__1973 + StatefulPartitionedCall/Reshape_7
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/separable_conv2d_4/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/separable_conv2d_4/depthwise
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd_4
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd_4
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/class_net/class-predict/BiasAdd_4__1862 + StatefulPartitionedCall/Reshape_8
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/box_net/box-predict/BiasAdd_4__1899 + StatefulPartitionedCall/Reshape_9
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape:0 copy
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_2:0 copy
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_4:0 copy
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_6:0 copy
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_8:0 copy
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_1:0 copy
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_3:0 copy
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_5:0 copy
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_7:0 copy
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] StatefulPartitionedCall/Reshape_9:0 copy
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] nms/anchors:0
[11/17/2021-22:11:26] [I] [TRT] [GpuLayer] nms/non_maximum_suppression
[11/17/2021-22:11:27] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +159, GPU +148, now: CPU 441, GPU 2892 (MiB)
[11/17/2021-22:11:28] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +240, GPU +243, now: CPU 681, GPU 3135 (MiB)
[11/17/2021-22:11:28] [11/17/2021-22:13:14] [I] [TRT] Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output.
[11/17/2021-22:33:05] [I] [TRT] Detected 1 inputs and 4 output network tensors.
[11/17/2021-22:33:06] [I] [TRT] Total Host Persistent Memory: 453568
[11/17/2021-22:33:06] [I] [TRT] Total Device Persistent Memory: 20593152
[11/17/2021-22:33:06] [I] [TRT] Total Scratch Memory: 88388864
[11/17/2021-22:33:06] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 28 MiB, GPU 421 MiB
[11/17/2021-22:33:06] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 952, GPU 3429 (MiB)
[11/17/2021-22:33:06] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 952, GPU 3429 (MiB)
[11/17/2021-22:33:06] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 952, GPU 3429 (MiB)
[11/17/2021-22:33:06] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 951, GPU 3429 (MiB)
[11/17/2021-22:33:06] [I] [TRT] [MemUsageSnapshot] Builder end: CPU 941 MiB, GPU 3429 MiB
[11/17/2021-22:33:06] [I] [TRT] Loaded engine size: 27 MB
[11/17/2021-22:33:06] [I] [TRT] [MemUsageSnapshot] deserializeCudaEngine begin: CPU 947 MiB, GPU 3446 MiB
[11/17/2021-22:33:06] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 953, GPU 3446 (MiB)
[11/17/2021-22:33:06] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 953, GPU 3446 (MiB)
[11/17/2021-22:33:06] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 953, GPU 3446 (MiB)
[11/17/2021-22:33:06] [I] [TRT] [MemUsageSnapshot] deserializeCudaEngine end: CPU 953 MiB, GPU 3446 MiB
[11/17/2021-22:33:06] [I] Engine built in 1303.79 sec.
[11/17/2021-22:33:06] [I] [TRT] [MemUsageSnapshot] ExecutionContext creation begin: CPU 887 MiB, GPU 3418 MiB
[11/17/2021-22:33:06] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 887, GPU 3418 (MiB)
[11/17/2021-22:33:06] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 887, GPU 3418 (MiB)
[11/17/2021-22:33:06] [I] [TRT] [MemUsageSnapshot] ExecutionContext creation end: CPU 888 MiB, GPU 3418 MiB
[11/17/2021-22:33:06] [I] Created input binding for images:0 with dimensions 1x512x512x3
[11/17/2021-22:33:06] [I] Created output binding for num_detections with dimensions 1x1
[11/17/2021-22:33:06] [I] Created output binding for detection_boxes with dimensions 1x100x4
[11/17/2021-22:33:06] [I] Created output binding for detection_scores with dimensions 1x100
[11/17/2021-22:33:06] [I] Created output binding for detection_classes with dimensions 1x100
[11/17/2021-22:33:06] [I] Starting inference
[11/17/2021-22:33:10] [I] Warmup completed 2 queries over 200 ms
[11/17/2021-22:33:10] [I] Timing trace has 18 queries over 3.37888 s
[11/17/2021-22:33:10] [I]
[11/17/2021-22:33:10] [I] === Trace details ===
[11/17/2021-22:33:10] [I] Trace averages of 10 runs:
[11/17/2021-22:33:10] [I] Average on 10 runs - GPU latency: 187.314 ms - Host latency: 187.636 ms (end to end 187.643 ms, enqueue 186.407 ms)
[11/17/2021-22:33:10] [I]
[11/17/2021-22:33:10] [I] === Performance summary ===
[11/17/2021-22:33:10] [I] Throughput: 5.32721 qps
[11/17/2021-22:33:10] [I] Latency: min = 186.777 ms, max = 189.414 ms, mean = 187.708 ms, median = 187.416 ms, percentile(99%) = 189.414 ms
[11/17/2021-22:33:10] [I] End-to-End Host Latency: min = 186.784 ms, max = 189.422 ms, mean = 187.715 ms, median = 187.423 ms, percentile(99%) = 189.422 ms
[11/17/2021-22:33:10] [I] Enqueue Time: min = 176.878 ms, max = 191.727 ms, mean = 186.451 ms, median = 187.122 ms, percentile(99%) = 191.727 ms
[11/17/2021-22:33:10] [I] H2D Latency: min = 0.30426 ms, max = 0.332031 ms, mean = 0.315197 ms, median = 0.315704 ms, percentile(99%) = 0.332031 ms
[11/17/2021-22:33:10] [I] GPU Compute Time: min = 186.455 ms, max = 189.094 ms, mean = 187.387 ms, median = 187.095 ms, percentile(99%) = 189.094 ms
[11/17/2021-22:33:10] [I] D2H Latency: min = 0.00524902 ms, max = 0.00805664 ms, mean = 0.00584581 ms, median = 0.00561523 ms, percentile(99%) = 0.00805664 ms
[11/17/2021-22:33:10] [I] Total Host Walltime: 3.37888 s
[11/17/2021-22:33:10] [I] Total GPU Compute Time: 3.37296 s
[11/17/2021-22:33:10] [11/17/2021-22:33:10] [11/17/2021-22:33:10] [I] Explanations of the performance metrics are printed in the verbose logs.
[11/17/2021-22:33:10] [I]
&&&& PASSED TensorRT.trtexec [TensorRT v8001] # /usr/src/tensorrt/bin/trtexec --onnx=/home/jetson/tensorrt-examples/cpp/efficientdet/efficientdet-lite3.onnx --workspace=200 --fp16
[11/17/2021-22:33:10] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 887, GPU 3419 (MiB)