Only VP task needs NetworkingHead?

[lqf0624]

Thanks for your work. I read your code and only found "Networking Head" mentioned in your paper in section 4.2. I wonder whether it's necessary to implement Networking Head in other tasks. Does it only used in time-sensitive tasks?

[duowuyms]

Hi! Thank you for your attention to our work!
In section 4.2, we use VP as the example to illustrate the functionality of networking head. However, in practice, the networking head is implemented on all three tasks. For example, in the abr codes, you can find a action_head in rl_policy.py, which is the so-called networking head in our paper. We rename it as action head in the codes to match the RL paradigm for better understanding.