Main:

Mahmud, M.M.H. and Lloyd, J. W. : Learning Deterministic-Probabilistic Models for Partially Observable Reinforcement Learning Problems. Tech Report (submitted to JMLR), containing consistency results and other proofs for the ICML paper.

Mahmud, M.M.H.: Constructing States for Reinforcement Learning. In, Proceedings of the 27th International Conference on Machine Learning (2010).

Mahmud, M.M.H.: On Universal Transfer Learning. Theoretical Computer Science 410 (2009), pp. 1826-1846

Mahmud, M.M.H., Ray, S.: Transfer Learning using Kolmogorov complexity: Basic Theory and Empirical Evaluations. In, the Proceedings of the 20th Neural Information Processing Systems Conference, 2007.

Mahmud, M.M.H.: On universal transfer learning. In, the Proceedings of the 18th International Conference on Algorithmic Learning Theory, 2007. Lecture Notes in Artificial Intelligence, LNAI 4754, pp. 135-149,2007; Springer, Berlin

Workshop

Mahmud, M.M.H., Ray, S.: Functional Similarity in Markov Environments Workshop on Inductive Transfer, 18th Neural Information Processing Systems Conference, 2005.

Technical Reports:

Swarup, S, Mahmud, M.M.H., Lakkaraju, K,  and Ray, S: Cumulative Learning: Towards Designing Cognitive Architectures for Artificial Agents that Have a Lifetime Technical Report, University of Illinois at Urbana-Champaign, 2005.

Mahmud, M.M.H., Ray, S.: Using Functional Similarity to Transfer Information in Markov Environments. University of Illinois at Urbana-Champaign, 2005.

Mahmud, M.M.H., Ray, S.: A Novel Forward Model for Markov Environments. University of Illinois at Urbana-Champaign, 2005.

Dissertations

Mahmud., M. M. H. Universal Transfer Learning. Ph.D. Thesis, University of Illinois at Urbana-Champaign, 2008. In addition to the material in the NIPS paper and ALT paper, the dissertation contains full development of parallel transfer, competitive optimality of universal priors, Kolmogorov complexity of functions, and many, many more experiments.

Mahmud., M. M. Hassan.  Explanation Based Policy Adaptation. Master's Thesis, University of Illinois at Urbana-Champaign, 2002. We derived a method that adapts a policy learned in an ideal setting using prior knowledge, so that it works in the actual setting. So this way we require fewer actual examples to learn the policy. We applied our method in a simulated Air Hockey robot problem (simulated using equations derived for an actual robot), which is an example of a complex non-linear dynamic control problem.