Updating tutorial#2

Merged

kanaadp merged 573 commits into

updating_tutorial

Oct 13, 2017

This pull request is big! We're only showing the most recent 250 commits

Commits on May 23, 2017

increased max length of run in gen.py, added positive only reward to simpleEmission

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
changed dockerfile to pull nightly SUMO build

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
created docker file that downloads from svn instead of stable build

Eugene Vinitsky
authored and
Eugene Vinitsky
committed

Commits on May 28, 2017

fixed bug in IDM where a factor of 2 was replaced by headway

Eugene Vinitsky
authored and
Eugene Vinitsky
committed

Commits on May 29, 2017

changed visualizer_CISTAR to have a loop_length input argument that lets you choose how long the loop should be in replay

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
fixed minor bug in instantaneous failsafe where we were occasionally dividing by zero

Eugene Vinitsky
authored and
Eugene Vinitsky
committed

Commits on May 31, 2017

changed based_env to color cars differently for each car type, added dockerfile that works for svn

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
dockerfile for pulling stable sumo is in dockerfile, svn dockerfile is in docker-svn

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
Merge pull request #99 from cathywu/dockerSVN
eugenevinitsky
authored
added intersection fail-safe
AboudyKreidieh
committed
script to train vehicles to not crash at intersections
AboudyKreidieh
committed
added intersection crash, absolute position
AboudyKreidieh
committed
fixed unit tests to use an arbitrary port

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
added absolute position and fail variable to compute_reward
AboudyKreidieh
committed
modified intersection representation and edge names in figure8 scenario
AboudyKreidieh
committed
fixed typo in IDM model
AboudyKreidieh
committed
added function to compute distance to intersection
AboudyKreidieh
committed
unit tests fixed now?

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
modified reward function and states to be compatible with newest approaches
AboudyKreidieh
committed
Merge branch 'master' into idm_simulations
eugenevinitsky
authored

Commits on Jun 1, 2017

Merge pull request #102 from cathywu/idm_simulations
eugenevinitsky
authored
changed compute reward to take kwargs for additional arguments

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
Instructions corresponding with commit f40f033cb3986c657de39c34f253f0236bc337a7 in cathywu/rllab repo (incorporated several of leah's steps into the rllab setup script)
cathywu
committed

Commits on Jun 2, 2017

added some docker files to the svn folder
Eugene Vinitsky
committed
Update Docker_Tutorial.md
eugenevinitsky
authored
Update Docker_Tutorial.md
eugenevinitsky
authored

Commits on Jun 5, 2017

Commits on Jun 8, 2017

Commits on Jun 9, 2017

made base-env changes, changed lane-changing to use discrete version
Eugene Vinitsky
committed
added all car rl lc example
Eugene Vinitsky
committed

Commits on Jun 10, 2017

fixed lane changing to use mixed and discrete policy

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
cases to mixed-rl
AboudyKreidieh
committed
Merge branch 'master' of https://github.com/cathywu/learning-traffic into funWithPandas
AboudyKreidieh
committed
fixed sheparding aggressive drivers to work with automlp

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
method to penalize non-compliance with rl requests
AboudyKreidieh
committed
added method to implement sumo IDM controller
AboudyKreidieh
committed
changed base_env to handle the fact there isnt a safe_target_lane for non-rl cars

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
fixed merge conflicts
AboudyKreidieh
committed
created new file for visualizing policies created through tensorflow

Eugene Vinitsky
authored and
Eugene Vinitsky
committed

Commits on Jun 11, 2017

fixed bugs with lane changing cars running sumo commands
AboudyKreidieh
committed
get_headway by default looks in current headway
AboudyKreidieh
committed
added in aboudys changes so that a lane change command is applied every time to tell the vehicle to stay in lane if lane_change_duration has not passed

Eugene Vinitsky
authored and
Eugene Vinitsky
committed

Commits on Jun 13, 2017

Commits on Jun 14, 2017

removed extraneous lane changing applied at each step
Eugene Vinitsky
committed
merged in aboudys changes to speed up the experiments
Eugene Vinitsky
committed

Commits on Jun 15, 2017

Commits on Jun 16, 2017

added drunk drivers
Eugene Vinitsky
committed
resolved the bug that was causing excessive lane changes
Eugene Vinitsky
committed
fixed bug wherein time of lane change was updated whether the fail safe had let it happen or not. Now lane change time is only updated if the lane change has actually occurred
Eugene Vinitsky
committed
fixed simple accel to account for the fact that applying a reward of -20 can be crippling for code run without a failsafe
Eugene Vinitsky
committed
switched mixed_human to use a state space that depends on headway and not absolute position

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
fixed rlonly to use both in lane and adj lane headway

Eugene Vinitsky
authored and
Eugene Vinitsky
committed

Commits on Jun 23, 2017

changes made for paper, some temporary
AboudyKreidieh
committed

Commits on Jun 29, 2017

merged changes and placed each emergent behavior experiment is a separate python file
AboudyKreidieh
committed

Commits on Jul 5, 2017

Commits on Jul 7, 2017

added intersection scenario (still needs work)
AboudyKreidieh
committed

Commits on Jul 8, 2017

Makefile template instead of Makefile, to support custom paths for the rllab directory.
cathywu
committed

Commits on Jul 10, 2017

Commits on Jul 11, 2017

added functional rl tests
Eugene Vinitsky
committed
Merge in changes from remote
Eugene Vinitsky
committed
merged in master branch
Eugene Vinitsky
committed
merged in master
Eugene Vinitsky
committed
Merge branch 'master' into cleanup
eugenevinitsky
authored
Merge pull request #125 from cathywu/cleanup
eugenevinitsky
authored
added start position generator that pushes all cars to the far left and bottom of the intersection
Eugene Vinitsky
committed
fixed getting headway to use traci calls
Eugene Vinitsky
committed
fixed bug where I had labelled start edge as right instead of bottom
Eugene Vinitsky
committed
remove vehicle ids dynamically whenever a car exits to prevent the system from crashing
AboudyKreidieh
committed
changed start positions of two lane intersection
Eugene Vinitsky
committed
Merge branch 'intersectionControl' of https://github.com/cathywu/learning-traffic into intersectionControl
Eugene Vinitsky
committed
vehicles in the intersection scenario can now change positions and shuffle in between rollouts
AboudyKreidieh
committed

Commits on Jul 12, 2017

two way intersection is working. The max path length needs to be adjusted and a max speed be set such that the cars never exit the intersection in a single run

Eugene Vinitsky
authored and
Eugene Vinitsky
committed

Commits on Jul 15, 2017

Create commit-practices.md
eugenevinitsky
authored

Commits on Jul 18, 2017

registered things as gym environments

Eugene Vinitsky
authored and
Eugene Vinitsky
committed

Commits on Jul 19, 2017

changed all intersection classes to use Gym classes as superclass

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
added appropriate cistar_dev files back in

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
added missing __init__ file

Eugene Vinitsky
authored and
Eugene Vinitsky
committed

Commits on Jul 26, 2017

Commits on Jul 27, 2017

all emergent behaviors are currently working as gym environments. Parallel does NOT work yet, some of the tests are still broken

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
minor changes to lane-change only environment
AboudyKreidieh
committed
created network and environment for loops with merges
AboudyKreidieh
committed
network for loops with merges
AboudyKreidieh
committed

Commits on Jul 28, 2017

Commits on Jul 31, 2017

created lane changing only scenario

Eugene Vinitsky
authored and
Eugene Vinitsky
committed

Commits on Aug 1, 2017

fixed the visualizer to use gymenv

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
fixed bug in IDMController and DrunkDriver when there are no leading cars
AboudyKreidieh
committed
fixed bug in IDMController and DrunkDriver when there are no leading cars
AboudyKreidieh
committed
updated multi-agent environments to have the correct observation space. Additionally made changes in base-env allowing for mixed, multiagent traffic

Eugene Vinitsky
authored and
Eugene Vinitsky
committed

Commits on Aug 3, 2017

Commits on Aug 6, 2017

minor fixes to how experiments are run

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
merged with multi-agent updates

Eugene Vinitsky
authored and
Eugene Vinitsky
committed

Commits on Aug 11, 2017

Commits on Aug 15, 2017

merged changes
AboudyKreidieh
committed

Commits on Aug 17, 2017

Commits on Aug 20, 2017

replaced type_params with lists instead of dicts
AboudyKreidieh
committed

Commits on Aug 23, 2017

made generator class more abstract, and modified subclasses
AboudyKreidieh
committed

Commits on Aug 24, 2017

code cleanup
AboudyKreidieh
committed

Commits on Aug 25, 2017

Merge pull request #131 from cathywu/braessParadox
eugenevinitsky
authored
cleaned up emergent behaviors folder
Eugene Vinitsky
committed

Commits on Aug 27, 2017

changed the inputs to a few functions
AboudyKreidieh
committed

Commits on Aug 28, 2017

Commits on Aug 29, 2017

Merge pull request #135 from cathywu/multi_agent_vist
eugenevinitsky
authored
branch is working
Eugene Vinitsky
committed
Merge branch 'master' of https://github.com/cathywu/learning-traffic
Eugene Vinitsky
committed

Commits on Sep 1, 2017

Merge branch 'cistar_release' of https://github.com/cathywu/learning-traffic into cistar_release_aboudy
AboudyKreidieh
committed

Commits on Sep 13, 2017

Commits on Sep 18, 2017

modified documentation
AboudyKreidieh
committed

Commits on Sep 19, 2017

updated documentation
AboudyKreidieh
committed

Commits on Sep 20, 2017

Commits on Sep 21, 2017

Commits on Sep 22, 2017

removed missing environments from envs/__init__
Eugene Vinitsky
committed
removed missing environments
Eugene Vinitsky
committed
Revert "removed missing environments"
Eugene Vinitsky
committed
Merge branch 'cistar_release' of https://github.com/cathywu/learning-traffic into cistar_release
Eugene Vinitsky
committed

Commits on Sep 23, 2017

system now accelerates vehicles with max accel when they pass the intersection

Eugene Vinitsky
authored and
Eugene Vinitsky
committed
Revert "system now accelerates vehicles with max accel when they pass the intersection"

Eugene Vinitsky
authored and
Eugene Vinitsky
committed

Commits on Sep 25, 2017

updated documentation
AboudyKreidieh
committed
added working rl intersection example to cistar_release

Eugene Vinitsky
authored and
Eugene Vinitsky
committed

Commits on Sep 26, 2017

fixed visualizer to output plots correctly and work with new cistar version. Updated intersection environment to find distance to sort by intersection distance, normalize the states, and correctly …
Eugene Vinitsky
committed

Commits on Sep 28, 2017

fixed get_state bug
nskh
committed

Commits on Sep 29, 2017

modified documentation and added option of noise to acceleration controllers
AboudyKreidieh
committed

Commits on Sep 30, 2017

modified inputs to gen functions
AboudyKreidieh
committed

Commits on Oct 1, 2017

Commits on Oct 3, 2017

Commits on Oct 4, 2017

update base_env function for div by zero bug (#150)

albeaik
authored and
kanaadp
committed
rename cistar to flow
kanaadp
committed

Commits on Oct 5, 2017

Commits on Oct 11, 2017

Commits on Oct 12, 2017

Commits on Oct 13, 2017

Merge branch 'master' of github.com:cathywu/flow into updating_tutorial
nskh
committed