fandangOrg / fandango

FAke News discovery and propagation from big Data ANalysis and artificial intelliGence Operations
1 stars 1 forks source link

author and publisher trustworthiness scores #119

Open pstalidis opened 3 years ago

pstalidis commented 3 years ago

There still exist some cases where the author and/or publisher trustworthiness score is >100. For example:

{
  "_index": "fdg-article",
  "_type": "doc",
  "_id": "d337f8b74698086f324cc502b69c177ef7e54c62a0a61778e1818769095956c65eb8aca9b124bde3ee0ee3800ad86c9df1ebca7478e64e68f4fcf426cb6a7d27",
  "_version": 2,
  "_score": null,
  "_source": {
    "headline": "Covid e Natale, i consigli dell’Iss: “Mascherine e distanza anche dentro casa”",
    "articleBody": "“I pranzi con decine di persone per Natale non sono eventi da programmare. Ricordiamoci che i contatti senza mascherina e distanziamento aumentano la probabilità che il virus continui a diffondersi. Serve grande cautela, muoversi poco, "
    "dateCreated": "2021-01-21T16:15:58Z",
    "dateModified": "2021-01-21T16:15:58Z",
    "datePublished": "2020-12-12T18:38:14Z",
    "authors": [
      "98ffab23fedd8b4c9e065ca9571240ea7a4d2a19cd5d3c0d27139655d89f08044f7a5849d89421823acf071eecbc97360b18aafc550bcefe08fcd4112b92add0",
      "92aa04ad3174f4205c9187e6f1983cf6301dfcfc9ebfd1829d43b642f7c3dd279c7cea9d7c0e079f17b448482257ca88eba6861df7338c21c04a893042234969",
      "fb6d73387035d86c7016960958aa33ca2068cc7be7d1c839936ab86aed726c1be4e4974b988aa615f216f08c0c2bbdeb0fb6fea9247e2fbeeb2183150da19014",
      "3d49ab1777c51c08457b66969452c5726a13aa15ddd27abc89d64d05feac88e7ba2cc2209ba1aaf809bef3267c60bedc0a79353f985c66386d4d8b8ce618a7e0",
      "b2c6c35fc711eab8cb95155ac9676d525f9de3b5f5d8c4b8171ab9bbe1b5d1fd3414d0e09e9e311714f84297dd1755003b6cc73dc2bfae74e4afde57f01302cd",
      "6dd89017dc5c2861a29b6619f730662057960a3a77cac0f876b2d85d3851d26c329c4820cf9f4db67ea20da55e1d99ca2b269252a84c8af09bf1a6295f173e3e"
    ],
    "publisher": [
      "a63303a8d05d8c6ac192f09fb650e1d463344ac3dbd56d2b7a3ace97e742646f9858bd193b82906dfafe6b8bd6a7f56dd4541a6a7d76bd17c9b9b575a5d94d81"
    ],
    "sourceDomain": "calabria7.it",
    "identifier": "d337f8b74698086f324cc502b69c177ef7e54c62a0a61778e1818769095956c65eb8aca9b124bde3ee0ee3800ad86c9df1ebca7478e64e68f4fcf426cb6a7d27",
    "inLanguage": "it",
    "url": "https://calabria7.it/covid-e-natale-i-consigli-delliss-mascherine-e-distanza-anche-dentro-casa/",
    "publishDateEstimated": "no",
    "processType": "online",
    "keywords": [
      "covid",
    ],
    "contains": [
      "3fbd0fe5ca0896f696cbfadc382139b05030c855d30c3144cf24860d23b7395e058ed24341"
    ],
    "calculatedRating": 2533.8,
    "videos": [],
    "images": [
      "73f43084f5a74597c6492b18c27edb99aeb51d1154dc3cdcf93b8e47da0138ef058ed24341",
      "3fbd0fe5ca0896f696cbfadc382139b05030c855d30c3144cf24860d23b7395e058ed24341"
    ],
    "mentions": [
      "Covid",
    ],
    "about": [],
    "topic": "Politica_3",
    "calculatedRatingDetails": {
      "authorRating": {
        "trustworthiness": 65.5,
        "relevance": 0.08
      },
      "textRating": {
        "trustworthiness": 0,
        "relevance": 0
      },
      "publisherRating": {
        "trustworthiness": 5028.3,
        "relevance": 0.101
      }
    }
  },
  "fields": {
    "datePublished": [
      "2020-12-12T18:38:14.000Z"
    ],
    "dateModified": [
      "2021-01-21T16:15:58.000Z"
    ],
    "dateCreated": [
      "2021-01-21T16:15:58.000Z"
    ]
  }
mmagaldi-eng commented 3 years ago

Please @tavitto16, check and fix this. If you've already fixed this and we need to clean data, please search all scores greater than 100 and fix it manually, at least the one that we need to run the pilot (you can agree on which one to fix with @vittorianovancini and @dcabo).

vittorianovancini commented 3 years ago

OK, I will check it

tavitto16 commented 3 years ago

I'm working on it. It is a simple arithmetic error. WIll be solved by today. BR

mmagaldi-eng commented 3 years ago

Thanks, Do you will also reprocess data in order to normalize all scores?

tavitto16 commented 3 years ago

Dear All, I have found the problem. Now it shall be solved. A new version of the deployment (12) has been created, please, let me know if it is already solved. BR

tavitto16 commented 3 years ago

Thanks, Do you will also reprocess data in order to normalize all scores?

WHenever these files are processed again, it should be solved.

macagari commented 3 years ago

I was testing the interface to upload a new image of the UI but I'm getting an empty response from "/api/graph_analysis/publisher/" @tavitto16 Can you please check? Thank you!

tavitto16 commented 3 years ago

I'm checking it. The authors are renamed in the code. I'll be updated in the ES gradually