View Forum Topic

Forums
CS4660
Assignment 2 - CartPole problem

Author	Message
imcano Posts: 7	Posted 01:24 Sep 02, 2018 \| To anyone having trouble with the cartpole problem: One thing that helped me out was testing out how much of an impact each observation (Cart Position, Cart Velocity, Pole Angle, Pole Velocity at Tip) had in the game. Maybe you could use an if statement to see how a negative/positive value will effect the total_reward. From here, you could see which observations are the most important. If this doesn't help maybe think of how you might win the game or what outcomes happen when a particular action is taken. (If I move left/right how will the CartPole respond, how should I react?)
jpatel77 Posts: 44	Posted 08:44 Sep 02, 2018 \| Yes. Or maybe you can think in terms of physics. As you pointed out, Theta alone cannot justify the action all the time. The momentum plays a very important role here, and as the cg of the pole approaches the center line, it becomes very sensetise to the action. It is at this point the pole momentum needs to be tackled. Last edited by jpatel77 at 08:44 Sep 02, 2018.

Author

Message

imcano

Posts: 7

Posted 01:24 Sep 02, 2018 |

To anyone having trouble with the cartpole problem:

One thing that helped me out was testing out how much of an impact each observation (Cart Position, Cart Velocity, Pole Angle, Pole Velocity at Tip) had in the game. Maybe you could use an if statement to see how a negative/positive value will effect the total_reward. From here, you could see which observations are the most important.

If this doesn't help maybe think of how you might win the game or what outcomes happen when a particular action is taken. (If I move left/right how will the CartPole respond, how should I react?)

jpatel77

Posts: 44

Posted 08:44 Sep 02, 2018 |

Yes. Or maybe you can think in terms of physics. As you pointed out, Theta alone cannot justify the action all the time. The momentum plays a very important role here, and as the cg of the pole approaches the center line, it becomes very sensetise to the action. It is at this point the pole momentum needs to be tackled.

Last edited by jpatel77 at 08:44 Sep 02, 2018.