search

infer-actively / pymdp

A Python implementation of active inference for Markov Decision Processes
MIT License
450 stars 89 forks source link

Sophisticated inference v.0 #120

Closed aswinpaul closed 9 months ago

aswinpaul commented 1 year ago

Changes to pymdp in 4 commits:

  1. agent_si.py in pymdp and change to init.py
  2. added a couple of functions in maths.py
  3. added sophisticated inference demo folder in examples
  4. added Aswin as a contributor in readme

Potential improvements to work on:

  1. standardising take_decision function in agent_si.py
  2. unit tests to compare with SPM_MDP_VB_XX.m
  3. separating hidden state factors for inference and learning
aswinpaul commented 1 year ago

Update:

  1. Improved SI module by separating hidden state factors for inference and learning.
  2. Deleted take decision function and replaced with native sample_action function.

Potential work left:

  1. unit tests to compare with SPM_MDP_VB_XX.m
aswinpaul commented 1 year ago

Code cleanup and main branch sync

aswinpaul commented 9 months ago

This PR is closed since Tim's sophisticated inference code is closer to Karl's original implementation and will be merged soon to pymdp.