douglasrizzo / catsim

Computerized Adaptive Testing Simulator
GNU Lesser General Public License v3.0
124 stars 35 forks source link

item difficulty estimation #5

Closed eloiup closed 5 years ago

eloiup commented 7 years ago

Hi,

I 've just started studing about IRT (using IRT by Frank Baker and SeockHo Kim), and the catsim library (thx it looks like great work)

While this might be in the documentation (havent found it yet), does catsim support estimation for the item difficult parameter theta?

My problem at hand is: I have a bunch of questions/candidates and interactions without any further knowledge (questions on same topic) and need to properly estimate the question difficulty as well as the candidates proficiency.

Any examples/documentation referrals wld be deeply appreciated. Thx again.

douglasrizzo commented 7 years ago

Hi @eloiup. Currently, catsim does not support item parameter estimation. It only estimates examinees proficiencies while simulating/applying a computerized adaptive test.

In order to estimate item parameters, I'd recommend the R language and its packages mirt and irtoys.

The closest I found to IRT parameter estimation in Python is Khan Academy's guacamole repository, but I've never used it.

If you'd like to know more about catsim, check out this paper.

dosa-chammandi commented 5 years ago

Can you please guide me how to apply a computerized adaptive test? I have item parameters , administered items, response vector and est_theta for each candidate.

While using "estimator.estimate" funciton, what should i pass for parameter "index", can i ignore this parameter as im finding new estimate after the candidate answer each question?

How,when should i use the simulator?