Total runs:
106
Run Growth:
17
Growth Rate:
16.04%
Sponsored by
APIMaster
keras-io / ppo-cartpole
Model's Last Updated: January 13 2022
Introduction of ppo-cartpole
Model Details of ppo-cartpole
Keras Implementation of Proximal Policy Optimization on Cartpole Environment 🔨🤖
This repo contains the model and the notebook to this Keras example on PPO for Cartpole .
Full credits to: Ilias Chrysovergis
Background Information
CartPole-v0
A pole is attached by an un-actuated joint to a cart, which moves along a frictionless track. The system is controlled by applying a force of +1 or -1 to the cart. The pendulum starts upright, and the goal is to prevent it from falling over. A reward of +1 is provided for every timestep that the pole remains upright. The episode ends when the pole is more than 15 degrees from vertical, or the cart moves more than 2.4 units from the center. After 200 steps the episode ends. Thus, the highest return we can get is equal to 200.
Proximal Policy Optimization
PPO is a policy gradient method and can be used for environments with either discrete or continuous action spaces. It trains a stochastic policy in an on-policy way. Also, it utilizes the actor critic method. The actor maps the observation to an action and the critic gives an expectation of the rewards of the agent for the observation given. Firstly, it collects a set of trajectories for each epoch by sampling from the latest version of the stochastic policy. Then, the rewards-to-go and the advantage estimates are computed in order to update the policy and fit the value function. The policy is updated via a stochastic gradient ascent optimizer, while the value function is fitted via some gradient descent algorithm. This procedure is applied for many epochs until the environment is solved.
Runs of keras-io ppo-cartpole on huggingface.co
38
Total runs
0
24-hour runs
-1
3-day runs
3
7-day runs
26
30-day runs
More Information About ppo-cartpole huggingface.co Model
Url of ppo-cartpole
ppo-cartpole huggingface.co Url
Provider of ppo-cartpole huggingface.co
Other API from keras-io
Updated:July 05 2024
Total runs:
50
Run Growth:
-19
Growth Rate:
-38.00%
Total runs:
42
Run Growth:
9
Growth Rate:
21.43%
Total runs:
39
Run Growth:
-26
Growth Rate:
-66.67%
Total runs:
39
Run Growth:
-6
Growth Rate:
-15.38%
Total runs:
36
Run Growth:
-2
Growth Rate:
-5.56%
Total runs:
35
Run Growth:
2
Growth Rate:
5.71%
Total runs:
35
Run Growth:
-5
Growth Rate:
-14.29%
Total runs:
33
Run Growth:
-1
Growth Rate:
-3.03%
Total runs:
33
Run Growth:
16
Growth Rate:
48.48%
Total runs:
32
Run Growth:
-23
Growth Rate:
-71.88%
Total runs:
32
Run Growth:
-10
Growth Rate:
-31.25%
Total runs:
31
Run Growth:
-6
Growth Rate:
-19.35%
Total runs:
30
Run Growth:
-30
Growth Rate:
-100.00%
Total runs:
28
Run Growth:
3
Growth Rate:
10.71%
Total runs:
26
Run Growth:
14
Growth Rate:
53.85%
Total runs:
25
Run Growth:
2
Growth Rate:
8.00%
Total runs:
24
Run Growth:
9
Growth Rate:
37.50%
Total runs:
23
Run Growth:
9
Growth Rate:
39.13%
Total runs:
22
Run Growth:
-15
Growth Rate:
-68.18%
Total runs:
22
Run Growth:
-82
Growth Rate:
-372.73%
Total runs:
21
Run Growth:
-9
Growth Rate:
-42.86%
Total runs:
21
Run Growth:
-7
Growth Rate:
-33.33%
Total runs:
21
Run Growth:
-5
Growth Rate:
-23.81%
Total runs:
20
Run Growth:
-7
Growth Rate:
-35.00%
Total runs:
19
Run Growth:
-7
Growth Rate:
-36.84%
Total runs:
19
Run Growth:
4
Growth Rate:
21.05%
Total runs:
19
Run Growth:
-13
Growth Rate:
-68.42%
Total runs:
19
Run Growth:
-2
Growth Rate:
-10.53%
Total runs:
18
Run Growth:
-24
Growth Rate:
-133.33%
Total runs:
17
Run Growth:
3
Growth Rate:
17.65%
Total runs:
16
Run Growth:
2
Growth Rate:
12.50%
Total runs:
15
Run Growth:
-2
Growth Rate:
-13.33%
Total runs:
15
Run Growth:
8
Growth Rate:
53.33%
Total runs:
15
Run Growth:
2
Growth Rate:
13.33%
Total runs:
14
Run Growth:
-56
Growth Rate:
-400.00%
Total runs:
14
Run Growth:
1
Growth Rate:
7.14%
Total runs:
13
Run Growth:
-2
Growth Rate:
-15.38%
Total runs:
12
Run Growth:
-8
Growth Rate:
-66.67%
Total runs:
12
Run Growth:
-2
Growth Rate:
-16.67%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
11
Run Growth:
-17
Growth Rate:
-154.55%
Total runs:
11
Run Growth:
-5
Growth Rate:
-45.45%
Total runs:
9
Run Growth:
-17
Growth Rate:
-188.89%
Total runs:
9
Run Growth:
-1
Growth Rate:
-11.11%
Total runs:
8
Run Growth:
-17
Growth Rate:
-212.50%
Total runs:
7
Run Growth:
3
Growth Rate:
42.86%
Total runs:
7
Run Growth:
-5
Growth Rate:
-71.43%
Total runs:
6
Run Growth:
-17
Growth Rate:
-283.33%
Total runs:
6
Run Growth:
-35
Growth Rate:
-583.33%
Total runs:
5
Run Growth:
-5
Growth Rate:
-100.00%
Total runs:
5
Run Growth:
-21
Growth Rate:
-420.00%
Total runs:
4
Run Growth:
3
Growth Rate:
75.00%
Total runs:
4
Run Growth:
-1
Growth Rate:
-25.00%
Total runs:
4
Run Growth:
-9
Growth Rate:
-225.00%
Total runs:
3
Run Growth:
-16
Growth Rate:
-533.33%
Total runs:
3
Run Growth:
1
Growth Rate:
33.33%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%