Consider refine the code and logic of building model wrappers _Originally posted by @ZwwWayne in https://github.com/open-mmlab/mmengine/pull/351#discussion_r916521455_