Is there any existing implement of training with different type RL models?

[mypersonpage]

Now there is only selfplay or training with AI-SIMPLE.
If I want to train with different type RL models, e.g. a player using ppo and the other one using A3C,
how can I deal with it?

[lafmdp]

Here is a toy example for 2 players loading different models. You can check it at ./rlpytorch/model_loader.py
https://github.com/lafmdp/ELF