search

dhammacakka / pm12e

2 stars 0 forks source link

Need daily output as pretty jsonzip #53

Open bksubhuti opened 2 years ago

bksubhuti commented 2 years ago

Need daily output as pretty jsonzip. The user will be able to download latest PEU and latest DPD by downloading zip.

I will want to import into the dictionary table word definition book_id book_id will be hardcoded to number 8 image

The file should be cleaned up before making the zip. My cleanup script is below. order of operations is important to get all variations. (double check my order).

If there is no CL code then replace text: (there might be a legitimate usage of lottery or chemical in a CL-edited record)

      newdef = newdef.replace(/It\'s not that I don\'t love you, it\'s that I don\'t love you/g,"");
      newdef = newdef.replace(/It\'s not that I don\'t love you/g,"");
      newdef = newdef.replace(/it\'s that I don\'t love you/g,"");
      newdef = newdef.replace(/I\'m not sure if it\'s because I don\'t know what to do with it/g,"");
      newdef = newdef.replace(/I\'m not sure if I\'m going to be able to do that, but I\'m sure I\'m going to be able to do that/g,"");
      newdef = newdef.replace(/I\'m not sure what to do/g,"");
      newdef = newdef.replace(/I\'m not sure if I\'m going to be able to do that/g,"");
      newdef = newdef.replace(/I\'m not sure if this is a good idea,/g,"");
      newdef = newdef.replace(/but I\'m not sure if this is a good idea/g,"");
      newdef = newdef.replace(/I\'m not sure if it\'s because I don\'t know what I\'m talking about/g,"");
      newdef = newdef.replace(/not sure if I\'m going to be able to do that/g,"");
      newdef = newdef.replace(/I\'m not sure if this is the case/g,"");

      newdef = newdef.replace(/I\'m not sure what I\'m talking about, but I\'m not sure what I\'m talking about/g,"");
      newdef = newdef.replace(/I\'m not sure what I\'m talking about/g,"");

      // get rid of most lottery in this order
      newdef = newdef.replace(/in the lottery/g,"");
      newdef = newdef.replace(/in lottery/g,"");
      newdef = newdef.replace(/\(lottery\)/g,"");
      newdef = newdef.replace(/\(chemical\)/g,"");