very slow for bert

[dpny518]

I tested the speed of this versus bert as a service to generate 1 sentence embeddings but this one is a lot slower, do you have suggestions to keep the model in memory or how speed this up?

[YC-wind]

1.you can freeze the graph as a pb file, then save current session;
2.you can use GPU or TPU to speed this up.