refine pybind when *_op.cc contains several operators

[luotao1]

fix #7059 (comment)

• for most op contains several operators, such as conv_op, conv_cudnn_op, etc
  • auto pybind it by REGEX MATCH REGISTER_OP(***,, where *** is the name for USE_OP/USE_CPU_ONLY_OP etc .
• for other op whose REGISTER_OP is manually, such as compare_op:
  

  Paddle/paddle/operators/compare_op.cc

  Lines 81 to 105 in fba6a10

  	#define REGISTER_LOGICAL_OP(op_type, _equation) \
  	struct _##op_type##Comment { \
  	static char type[]; \
  	static char equation[]; \
  	}; \
  	char _##op_type##Comment::type[]{#op_type}; \
  	char _##op_type##Comment::equation[]{_equation}; \
  	REGISTER_OPERATOR( \
  	op_type, ::paddle::operators::CompareOp, \
  	::paddle::operators::CompareOpProtoMaker<_##op_type##Comment>, \
  	::paddle::operators::CompareOpInferShape<_##op_type##Comment>, \
  	::paddle::framework::EmptyGradOpMaker);
  	REGISTER_LOGICAL_OP(less_than, "Out = X < Y");
  	REGISTER_LOGICAL_KERNEL(less_than, CPU, paddle::operators::LessThanFunctor);
  	REGISTER_LOGICAL_OP(less_equal, "Out = X <= Y");
  	REGISTER_LOGICAL_KERNEL(less_equal, CPU, paddle::operators::LessEqualFunctor);
  	REGISTER_LOGICAL_OP(greater_than, "Out = X > Y");
  	REGISTER_LOGICAL_KERNEL(greater_than, CPU,
  	paddle::operators::GreaterThanFunctor);
  	REGISTER_LOGICAL_OP(greater_equal, "Out = X >= Y");
  	REGISTER_LOGICAL_KERNEL(greater_equal, CPU,
  	paddle::operators::GreaterEqualFunctor);
  	REGISTER_LOGICAL_OP(equal, "Out = X == Y");
  	REGISTER_LOGICAL_KERNEL(equal, CPU, paddle::operators::EqualFunctor);

  • manually pybind them.

[typhoonzero]

This line of comment can be:

Define operators that don't need pybind here.

[luotao1]

Done. Thank you.

[typhoonzero]

Is it necessary to add some debug message here to see the registered operators?

[luotao1]

As there are hundreds of operators, the registered message are a lot too. If we want to see them, we can refer to paddle/pybind/pybind.h.

[typhoonzero]

LGTM++

[tonyyang-svail]

hi @luotao1, just to confirm the reason for "it's enough to just adding one operator to pybind in a *_op.cc file" is that the linking of a single operator causes the linking of the whole object file, therefore all operators in that object file will be registered.