About me

Contact me

My research

Courses

Humour

Fencing

Quote for the Day

Home

You've come to Doug Aberdeen's old pages. In 5 seconds you will taken to my new pages http://sml.nicta.com.au/~daa/

POMDPs

The following POMDPs were used to gather results for my thesis and my ICML paper. The follows Tony Cassandra's POMDP spec . They are text-files, in some cases gzipped.
  • heaven-hell.POMDP: following the definition from Geffner & Bonet (1998).
  • loadunload.POMDP: The classic load/unload scenario with 5 locations. Follows definition from Peshkin et al (1999).
  • pentagon.POMDP: A modified version of Cassandra's (1998) Pentagon grid-world scenario. The modification makes it suitable for infinite-horizon settings with no control dependent rewards.
  • factory.POMDP.gz (3.3 Mb) : A 21,600 state multi-agent scenario. A small number of locations, but the large number of states is a result of having two independent agents.
  • pegasus-bad.POMDP: A very simple 6 state POMDP which I used to illustrate that the PEGASUS trick could lead to overfitting.
  • iirtest.POMDP, iirtest2.POMDP, iirtest3.POMDP: Three simple POMDPs used to test the eligibility trace filtering presented in my Thesis.
  • hil.POMDP: A small gridworld maze. Not published anywhere.

The views and opinions expressed on this web page are not necessarily those of NICTA or the Australian National University. Any HTML or image from this page may be copied and re-used freely but must not be sold.
Feedback:Doug.Aberdeen AT anu.edu.au