mitodl / ocw-to-hugo

A command line utility for taking master.json output from ocw-data-parser and producing markdown for use with hugo-course-publisher
3 stars 0 forks source link

Data migration: missing videos in multiple courses #459

Closed pdpinch closed 2 years ago

pdpinch commented 2 years ago

checklist of videos:

Steps to Reproduce

res-tll-004

Compare legacy: https://ocw.mit.edu/resources/res-tll-004-stem-concept-videos-fall-2013/videos/conservation/ to nextgen: https://ocwnext.odl.mit.edu/courses/res-tll-004-stem-concept-videos-fall-2013/video_galleries/videos/conservation/

The 2nd video "Latent Heat is missing"

As far as I can tell the necessary data is in s3://open-learning-course-data-production/res-tll-004-stem-concept-videos-fall-2013/a29e75fbd826d2d192a930c18d6eb7d5_master.json but it does not appear in https://github.mit.edu/ocw-content-rc/res.tll-004-fall-2013/blob/main/content/video_galleries/videos/conservation.md

res-18-005

[parsed json](s3://open-learning-course-data-production/res-18-005-highlights-of-calculus-spring-2010 ./res-18-005-highlights-of-calculus-spring-2010/res-18-005-highlights-of-calculus-spring-2010_parsed.json) includes a video with uuid 37fc6a36f691f5053e109249f701dde6

markdown for video gallery includes uuid 37fc6a36-f691-f505-3e10-9249f701dde6 but there is no corresponding resource in the markdown

legacy (5 videos): https://ocw.mit.edu/resources/res-18-005-highlights-of-calculus-spring-2010/highlights_of_calculus/ nextgen (1 video): https://ocwnext.odl.mit.edu/courses/res-18-005-highlights-of-calculus-spring-2010/video_galleries/highlights_of_calculus/

16.01

markdown for page with embedded video includes uuid 79dd98cc-6cbd-890e-d9f9-27583bf7336e but there is no corresponding resource in the markdown

2.627

embedded video, but no resource: https://github.mit.edu/mitocwcontent/2.627-fall-2013/search?q=e09ed427&unscoped_q=e09ed427

7.01sc

embedded video, but no resource: https://github.mit.edu/mitocwcontent/7.01sc-fall-2011/blame/main/content/pages/molecular-biology/dna-structure-classic-experiments.md#L68

pdpinch commented 2 years ago

Do you think mitodl/ocw-to-hugo#477 will also fix https://ocwnext.odl.mit.edu/courses/20-010j-introduction-to-bioengineering-be-010j-spring-2006/video_galleries/videos/ ?

mbertrand commented 2 years ago

Yes, just tried it:

Screen Shot 2022-02-28 at 7 50 09 AM
pdpinch commented 2 years ago

I added checklist to make it clearer what needs to be done. I see the first one is working, but the 2nd one isn't. And then I ran out of time.

mbertrand commented 2 years ago

res-18-005 doesn't appear to have been included in the list of sites to process, I'll double-check the others.

mbertrand commented 2 years ago

There were a couple others not on the list that are now updated. @pdpinch Do you want to keep this open in case others show up?

dseaton commented 2 years ago

@mbertrand @pdpinch There are two video missing in 8.06 Spring 2018. L13.4 and L13.5, which are easiest to see on this page. Let me know if there is a better way to report this or if this is the wrong place.

pdpinch commented 2 years ago

Closing this in favor of mitodl/ocw-studio#1732