snotskie / EpistemicNetworkAnalysis.jl

Native implementation of Epistemic Network Analysis written in the Julia programming language. Based on rENA 0.2.0.1.
https://snotskie.github.io/EpistemicNetworkAnalysis.jl/
GNU General Public License v3.0
6 stars 2 forks source link

Add cross_validate helper #24

Closed snotskie closed 11 months ago

snotskie commented 1 year ago

A generic cross_validate helper should be straightforward to write:

  1. Given an existing model and k, split unit ids into k groups
  2. Run i in 1:k trainedmodels, being careful to preserve model config except for an added unitFilter and'ing on the existing one, holding out group i
  3. Report stats summarizing the k models' stats in their embeddings

This should put a little heat under the problem that ENA models often don't cross-validate

snotskie commented 1 year ago

Maybe do this as an Example instead of a built-in helper?

snotskie commented 12 months ago

Use as a good example for https://github.com/snotskie/EpistemicNetworkAnalysis.jl/issues/13

snotskie commented 11 months ago

https://github.com/snotskie/EpistemicNetworkAnalysis.jl/commit/2d2af2f863e7602c0d45b5499b7de4140f60aa9d