Missing Assessment items in ka-lite-bundle

[radinamatic]

Missing Assessment items in ka-lite-bundle

Branch: 0.14 alpha12 installed today from PPA on Ubuntu 15.04

With the code provided by @rtibbles

bin/kalite shell
...
from kalite.topic_tools import get_exercise_cache
cache = get_exercise_cache()
for key, value in cache.iteritems():
    if not value.get("available", False):
        print key

Shell listed these 4 exercises as missing:

increasing-decreasing-intervals-of-functions
dividing_decimals
dividing_fractions_word problems_2
matrix_determinant

Filing this so we can make sure the content is updated for 0.15 with these available.

[aronasorman]

Seems to be "solved" in the Windows installer? I'm assuming it's been solved for the deb installer as well.

[radinamatic]

Not solved, but circumventable.

[radinamatic]

Sorry, no, this one is not solved @aronasorman ! These are really missing!

[radinamatic]

The rest is just not visible because of the availability stamping issue.

[aronasorman]

I believe this issue has been fixed with the latest 0.14.

[radinamatic]

Prompted by today's testing @EdDixon is doing on a similar problem, I revisited this issue with ka-lite-bundle 0.15~b3-0ubuntu1, and unfortunately, the problem got worse.

The above script by @rtibbles now gives me 103 exercises missing!

cellular-division-questions
somatosensation-questions
construct-basic-exponential-functions-from-initial-value-and-common-ratio
lymphatic-system-questions
solubility-equilibria-questions
graphs-of-rational-functions
increasing-decreasing-intervals-of-functions
axons--physics-and-chemistry-at-work-in-the-body
fluids-at-rest-questions
divide-polynomials-by-monomials
rh-passage-4
rh-passage-2
flow-and-poiseuille-s-law-in-operation
rh-passage-1
equilibrium-questions
matrix_determinant
dividing_decimals
surface-areas
gamma-knife-radiosurgery
stoichiometry-questions
sound-questions
thin-lenses-questions
electrostatics-questions
dividing_fractions_word problems_2
newton-s-laws-and-equilibrium-questions
activation-of-t-lymphocytes
the-role-of-the-bicarbonate-buffer-system-in-regulating-blood-ph
redox-reactions-questions
hormonal-regulation-questions
a-young-patient-with-type-1-diabetes
analyze-vertical-asymptotes-of-rational-functions
initial-steps-in-the-metabolism-of-dietary-monosaccharides
isothermal-titration-calorimetry-in-drug-development
taste-and-smell-quiz
patient-with-a-missing-cerebellum
end-behavior-of-rational-functions
enzymes-questions
physics-of-walking-and-running
using-optical-traps-to-manipulate-single-dna-strands
typhoid-toxin
attention-questions
interpret-formulas-of-basic-exponential-functions
drug-dependence-questions
endocrine-system-questions-1
glucose-6-phosphate-dehydrogenase-and-the-most-important-function-of-the-pentose-phosphate-pathway
simplifying_rational_expressions_3
simplifying_rational_expressions_2
simplifying_rational_expressions_1
genetic-mutations-questions
pancreatitis-and-pancreatic-cells
dermoscopy
adding_and_subtracting_rational_expressions_3
rational-equations-3
stereochemistry-questions
proton-beam-therapy--particle-accelerators-in-medicine
proteins-questions
electromyography-and-passive-filters--circuitry-in-action
acid-base-questions
biosignaling-questions
normal-forces-questions
shortwave-diathermy-in-rehabilitative-medicine
could-complete-darkness-be-the-cure-for-amblyopia-
muscular-system-questions
quiz--js-libraries
graphs-of-basic-exponential-functions
rh-passage-3
cytoskeleton-questions
fluids-in-motion-questions
understanding-cardiac-pressure-volume-curves
multiplying_and_dividing_rational_expressions_2
multiplying_and_dividing_rational_expressions_3
multiplying_and_dividing_rational_expressions_1
clinical-applications-of-tuning-forks
macromolecules-skill-assessment
counting-systems-and-the-piraha-tribe-
a-physical-model-of-human-sitting
construct-basic-exponential-functions-from-table-or-graph
psychological-disorders-questions
free-energy--photosynthesis--and-cellular-respiration-
interpret-graphs-and-tables-of-basic-exponential-functions
endocrine-system-questions-2
adding_and_subtracting_rational_expressions_2
adding_and_subtracting_rational_expressions_5
driving-and-talking-on-a-cell-phone
human-physiological-development
periodic-table-questions
prokaryotes-questions
selection-of-radionuclides-for-radiopharmaceuticals
electrochemistry-questions
solving_rational_equations_2
perky-effect
remainder-theorem-of-polynomials
embodied-cognition--hockey--does-expertise-impact-text-understanding-
congestive-heart-failure-and-diuretics
dividing-polynomials-with-remainders
forces-on-inclined-planes-Zheng
the-physics-of-eyesight-correction
measuring-glomerular-filtration-rate-of-the-kidneys-with-inulin
thermodynamics-questions
adding_and_subtracting_rational_expressions
divide-polynomials-by-binomials
dot-structures-questions
congruent_triangles_1

I tried to open a few of them randomly, and they are indeed missing, but I can only see the 301 response:

cc/ @aronasorman @benjaoming

[radinamatic]

I can confirm this happening on Windows XP with the latest 0.15 installer, after adding exercises from the khan_assessment.zip. The exact and same 103 exercises are missing as in the above report on the Ubuntu installation with ka-lite-bundle.

[benjaoming]

0.14.2 is still okay :)

>>> from kalite.topic_tools import get_exercise_cache
>>> cache = get_exercise_cache()
>>> cnt=0
>>> for key, value in cache.iteritems():
...     if not value.get("available", False):
...         cnt+=1
...         
...     
... 
>>> cnt
4

[rtibbles]

@radinamatic As soon as new installers are built, this should, hopefully, be resolved. Please verify!

[radinamatic]

I already tried on XP with the latest khan_assessments.zip that Jamie posted, but I'm still getting 103 missing. Hopefully it will be resolved with the new installers!

[rtibbles]

Hrm - that should be the only difference, alack. It may be that we just have some bad exercises in there.

[radinamatic]

Can I somehow undo the previous kalite manage unpack_assessment_zip commands, or is the new installation the only way to know?

[rtibbles]

Unpacking the new zip over the old one should be sufficient.

[rtibbles]

Ah, seems like @jamalex and I had a miscommunication. Hopefully this should be resolved when the full assessment item rebuilding has occurred.

[jamalex]

Hopefully now fixed, once https://github.com/learningequality/ka-lite/pull/4592 is merged.

[rtibbles]

@radinamatic can you test with this new zip? http://pantry.learningequality.org/downloads/ka-lite/0.15/content/khan_assessment.zip

[radinamatic]

With this latest zip I only get 5 assessments reported as missing:

increasing-decreasing-intervals-of-functions
matrix_determinant
dividing_decimals
dividing_fractions_word problems_2
multiplying-and-dividing-whole-numbers-by-powers-of-10

These 5 do present as missing with the This content was not found! Please contact your coach or an admin to have it downloaded. warning:

The rest from the previous script output do not appear as missing or grayed out, neither in search, nor they trigger the warning. However, no content seem to load, and they do throw an Uncaught ReferenceError: $_ is not defined:

[rtibbles]

So... looks like the issue here is that someone (qua muggins, aka me) forgot to update Perseus.

[radinamatic]

Today's installer on XP: no errors, and content loads except the pic:

congruent_triangles_1

Happens in both English and Spanish version - only the pic is missing.

[radinamatic]

And with this latest fix, we are back to 4 missing according to @rtibbles script:

increasing-decreasing-intervals-of-functions
matrix_determinant
dividing_decimals
dividing_fractions_word problems_2

[rtibbles]

Are pictures missing from any other questions?

On Fri, 9 Oct 2015 15:38 Radina Matic notifications@github.com wrote:

And with this latest fix, we are back to 4 missing according to @rtibbles https://github.com/rtibbles script:

increasing-decreasing-intervals-of-functions matrix_determinant dividing_decimals dividing_fractions_word problems_2

— Reply to this email directly or view it on GitHub https://github.com/learningequality/ka-lite/issues/4182#issuecomment-147004295 .

[MCGallaspy]

IMO if the problem is contained to 4 items, then we should consider releasing with a list of "Known Issues", then proceed to tackle in the next cycle.

[rtibbles]

I agree. This will also be resolved by the changes @aronasorman and I have planned for building content data in 0.16.

On Fri, 9 Oct 2015 15:44 Michael Gallaspy notifications@github.com wrote:

IMO if the problem is contained to 4 items, then we should consider releasing with a list of "Known Issues", then proceed to tackle in the next cycle.

— Reply to this email directly or view it on GitHub https://github.com/learningequality/ka-lite/issues/4182#issuecomment-147005065 .

[radinamatic]

Are pictures missing from any other questions?

The missing one is a svg, I'm going through the rest of them (103), and I only found one png that displays well. I'll annotate any & all that are missing for future testing.

[radinamatic]

graphs-of-rational-functions

Also SVGs.

[radinamatic]

surface-areas

Sofar all SVGs.

[radinamatic]

Doesn't seem broken, but hay caca, as we say over here... ;)

graphs-of-basic-exponential-functions

[radinamatic]

a-physical-model-of-human-sitting

[radinamatic]

construct-basic-exponential-functions-from-table-or-graph

[radinamatic]

To recap:

4 missing completely with the alert This content was not found! Please contact your coach or an admin to have it downloaded.:

increasing-decreasing-intervals-of-functions
matrix_determinant
dividing_decimals
dividing_fractions_word problems_2

From the above 103 that were previously missing but not anymore, these 6 have missing svg images:

graphs-of-rational-functions surface-areas graphs-of-basic-exponential-functions a-physical-model-of-human-sitting construct-basic-exponential-functions-from-table-or-graph congruent_triangles_1

[radinamatic]

Rechecked all the above missing svg images and they are now present and accounted for in the latest deb installers by @benjaoming from here: http://ppa.launchpad.net/learningequality/ka-lite-proposed/ubuntu/pool/main/k/ka-lite-source/

However, the 4 assessment items that were missing since the beginning are still, missing.

Also, console reports 3 woff2 fonts missing, called by perseus and bundle_common:

NotFound: (404, "The path '/static/fonts/glyphicons-halflings-regular.woff2' was not found.")
NotFound: (404, "The path '/static/fonts/KaTeX_Main-Regular.woff2' was not found.")
NotFound: (404, "The path '/static/fonts/KaTeX_Math-Italic.woff2' was not found.")

[rtibbles]

@radinamatic Please make sure this is resolved during testing for 0.16.

[aronasorman]

Is this now fixed @benjaoming?

[radinamatic]

I'll re-check this with Alpha3 deb installer and report back, @aronasorman!

[radinamatic]

After searching manually the 4 above exercises, none report as missing, although I can't seem to find matrix_determinant anywhere... However, where did the get_exercise_cache go? Did somebody refactor it to oblivion? @rtibbles above script is not working anymore:

didi@didi-virtualbox:~/Desktop$ kalite shell
[WARNING] [2016-02-24 00:45:10,803] kalite: Channel khan does not exist.
Python 2.7.10 (default, Oct 14 2015, 16:09:02) 
[GCC 5.2.1 20151010] on linux2
Type "help", "copyright", "credits" or "license" for more information.
(InteractiveConsole)
>>> from kalite.topic_tools import get_exercise_cache
Traceback (most recent call last):
  File "<console>", line 1, in <module>
ImportError: cannot import name get_exercise_cache
>>>

[rtibbles]

It is an ex-method.

from kalite.topic_tools.content_models import get_content_items
nodes = get_content_items()
exercises = [node for node in nodes if node.get("kind")=="Exercise"]

[rtibbles]

No longer relevant now that we prefilter exercises and set availability to True before distribution.