GSoC Report for Week 3 of Phase 3

[janakrajchadha]

GSoC Report for Week 3 of Phase 3

I’m excited to have made progress on the work for important change classification. I've mapped out the plan for text change classification and added issues. The related work is in progess and will be pushed soon.

I worked on the following issues:

• Add HTML diff for rendering
• Important Change Identification Road Map/Plan
• Important change classification - text features This issue includes two subtasks
  • Dataset creation by accessing saved source content
  • Machine learning model framework for text classification

I've also opened issues for analysis work done earlier as per suggestions from Kyala:

• Data analysis to look for patterns in insignificant changes
• Analysis of insignificant changes dictionary

Work in this PR is still in progress:

• Html diff render

Other issues and PRs I've looked at:

Issues

• Do some sort of canonicalization on Page URLs
• Add query param for Versions by Versionista ID

  PRs

• Query Versions by source_metadata fields
• WIP: Add raw Internet Archive importing via CDX API

I plan to open a PR for 'Important change classification - text features' over the weekend.

I intend to balance my time next week between the PR and the blog bost. I'll try to get the blog post ready way before next Friday to get early feedback.

[janakrajchadha]

@danielballan @suchthis @mhucka

[suchthis]

Thanks so much @janakrajchadha! Let me know when you're ready with a first draft of the blog post. Does a draft by Wednesday sound do-able?

[janakrajchadha]

@suchthis I'm almost done with it. In fact, I was going to share it with you by EOD today.