As we discussed before, all layer should be implemented in Python side. So remove FullyConnectedOp in `paddle::operators`.