Thank you for sharing such excellent work. I would like to ask about the calculation of advantage values. Initially, the data comes from the absolute_advantage in progress or stage 2. However, before stage 2 is trained, how is this data from progress calculated? Is it computed using Monte Carlo returns?
Thank you for sharing such excellent work. I would like to ask about the calculation of advantage values. Initially, the data comes from the absolute_advantage in progress or stage 2. However, before stage 2 is trained, how is this data from progress calculated? Is it computed using Monte Carlo returns?