Bugs in the DDP implementation

[GloryyrolG]

Hi,

Good suggestions:) However, there are some problems in the DDP usage, e.g., the metric acc1 is not gathered from different machines.

Regards

[Lyken17]

Thanks for reporting. I will try to make a fix soon.