Create some sort of serialization / deserialization functionality

[narendasan]

With INT8 about to land, would be a pain to have to calibrate from scratch every time. There should be some mechanism to save and load modules with the TRT engine included.

[salexspb]

That would be awesome to have proper serialization! I would also add that for large scale deployments this is a must have even for fp16. As if you have a lot of models, converting all of them on restart would be quite expensive. And in general in some systems doing tuning in production is generally undesirable.