co-inform / gateway-api

The API for the gateway
1 stars 0 forks source link

`/twitter/evaluate/label` should collect enough data to store in DB #11

Open rdenaux opened 4 years ago

rdenaux commented 4 years ago

To help with refining the definition of the /twitter/evaluate/label endpoint, this issue describes a test case where a user submits an accuracy rating for a credibility assessment. It also describes the desired outcome, namely a corresponding call to the content collector api.

Context

A co-inform plugin user has internal UUID cf40ced2-7cc8-98a3-1fb0-02c96d781626. The user has logged into the plugin and views this tweet. The plugin calls the /twitter/tweet, which is assigned a query id as follows:

{
      "status": "in_progress",
      "response": null,
      "query_id": "251b6a72cd3a3af314baf748abdfac93c076e54272dabcaef5b7b115eb65c848"
    }

The plugin, then retrieves the response via the api which returns the following credibility assessment:

{
       "status": "partly_done",
       "response": {
         "MisinfoMe": {
           "response": {
             "credibility": {
               "value": 0.0,
               "confidence": 0.0
             },
             "profile_as_source_credibility": {
               "credibility": {
                 "value": 0,
                 "confidence": 0
               }
             },
             "sources_credibility": {
               "credibility": {
                 "value": 0.0,
                 "confidence": 0.0
               },
               "assessments": []
             },
             "urls_credibility": {
               "credibility": {
                 "value": 0.0,
                 "confidence": 0.0
               },
               "assessments": []
             },
             "itemReviewed": 1181172459325800448
           }
         },
         "rule_engine": {
           "final_credibility": "not_credible",
           "module_labels": {
             "claim_similarity": "not_credible",
             "misinfome": "not_verifiable"
           }
         },
         "ClaimCredibility": {
           "response": {
             "tweet-claim-credibility": [
               {
                 "tweet_id": 1181172459325800448,
                 "sentences_in_tweet": [
                   {
                     "claim": "....including capturing thousands of ISIS fighters, mostly from Europe.",
                     "related_claims": {
                       "reviewed-claims": [
                         {
                           "claimReviewed": "Says \"thousands\" of captured ISIS fighters are \"mostly from Europe.\"",
                           "similarity": 0.8934022984770823,
                           "fact-checker": "https://www.politifact.com/",
                           "published_date": "2019-10-07T00:00:00Z",
                           "url": "https://www.politifact.com/truth-o-meter/article/2019/oct/08/fact-checking-donald-trumps-claims-about-syria-and/",
                           "altName": "Mostly from Syria, Iraq",
                           "claimReview": {
                             "@context": "http://schema.org",
                             "@type": "ClaimReview",
                             "author": {
                               "@type": "Organization",
                               "image": "https://d10r9aj6omusou.cloudfront.net/factstream-logo-image-61554e34-b525-4723-b7ae-d1860eaa2296.png",
                               "name": "PolitiFact",
                               "url": "https://www.politifact.com/"
                             },
                             "claimReviewed": "Says \"thousands\" of captured ISIS fighters are \"mostly from Europe.\"",
                             "datePublished": "2019-10-08T20:29:32Z",
                             "itemReviewed": {
                               "@type": "Claim",
                               "author": {
                                 "@type": "Person",
                                 "image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBdkNYIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--157d0f76861f60fb3f74a5c16b18fb84ab52a071/https-3A-2F-2Fstatic.politifact.com-2Fpolitifact-2Fmugs-2FNYT_TRUMP_CAMPAIGN_5.jpg?disposition=attachment",
                                 "jobTitle": "President of the United States",
                                 "name": "Donald Trump"
                               },
                               "datePublished": "2019-10-07",
                               "firstAppearance": {
                                 "@type": "CreativeWork",
                                 "url": "https://twitter.com/realDonaldTrump/status/1181172459325800448"
                               },
                               "name": "in a tweet"
                             },
                             "reviewRating": {
                               "@type": "Rating",
                               "alternateName": "Mostly from Syria, Iraq"
                             },
                             "sdPublisher": {
                               "@type": "Organization",
                               "name": "Google Fact Check Tools API",
                               "url": "https://g.co/factchecktools"
                             },
                             "url": "https://www.politifact.com/truth-o-meter/article/2019/oct/08/fact-checking-donald-trumps-claims-about-syria-and/"
                           },
                           "domain": "www.politifact.com",
                           "domain_credibility": {
                             "credibility": {
                               "confidence": 0.8233333333333334,
                               "value": 0.9695546558704454,
                               "source": "domain",
                               "domainReviewed": "www.politifact.com"
                             },
                             "itemReviewed": "www.politifact.com"
                           },
                           "claimReview_credibility_rating": {
                             "value": 0.0,
                             "confidence": 0.0,
                             "explanation": "Unknown accuracy for textual claim-review rating 'mostly from syria, iraq'",
                             "source": "claimReview"
                           },
                           "similarity_credibility": {
                             "value": 0.9695546558704454,
                             "confidence": 0.7355678924127977,
                             "explanation": "Claim is similar to:\n\n * missing sentence\nthat was published in a site (www.politifact.com) that is reliable. ",
                             "source": "credibility of related claims (4)"
                           }
                         },
                         {
                           "claimReviewed": "The thousands of ISIS fighters captured in Syria were \"mostly from Europe.\"",
                           "similarity": 0.8622189367985051,
                           "fact-checker": "https://www.factcheck.org/",
                           "published_date": "2019-10-07T00:00:00Z",
                           "url": "https://www.factcheck.org/2019/10/trumps-false-tweets-on-syria/",
                           "altName": "False",
                           "claimReview": {
                             "@context": "http://schema.org",
                             "@type": "ClaimReview",
                             "author": {
                               "@type": "Organization",
                               "image": "https://d10r9aj6omusou.cloudfront.net/factstream-logo-image-d669a00c-15d4-409e-811c-e82135db8000.png",
                               "name": "FactCheck.org",
                               "url": "https://www.factcheck.org/"
                             },
                             "claimReviewed": "The thousands of ISIS fighters captured in Syria were \"mostly from Europe.\"",
                             "datePublished": "2019-10-10T17:39:35Z",
                             "itemReviewed": {
                               "@type": "Claim",
                               "author": {
                                 "@type": "Person",
                                 "image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBZ3FZIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--42f34cf15128333aede0c2125cd86eaf44483ca9/https-3A-2F-2Fcdn.factcheck.org-2FUploadedFiles-2FTrump-new-widget.png?disposition=attachment",
                                 "jobTitle": "President",
                                 "name": "Donald Trump"
                               },
                               "datePublished": "2019-10-07",
                               "firstAppearance": {
                                 "@type": "CreativeWork",
                                 "url": "https://twitter.com/realDonaldTrump/status/1181172459325800448"
                               },
                               "name": "Twitter"
                             },
                             "reviewRating": {
                               "@type": "Rating",
                               "alternateName": "False",
                               "bestRating": "10",
                               "image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBZ3VZIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--22236f3b070b51dfd9f9b38bec866fc76a6d1de4/https-3A-2F-2Fdhpikd1t89arn.cloudfront.net-2Frating_images-2Ffactcheck.org-2Ffalse.png?disposition=attachment",
                               "ratingValue": "6",
                               "worstRating": "0"
                             },
                             "sdPublisher": {
                               "@type": "Organization",
                               "name": "Google Fact Check Tools API",
                               "url": "https://g.co/factchecktools"
                             },
                             "url": "https://www.factcheck.org/2019/10/trumps-false-tweets-on-syria/"
                           },
                           "domain": "www.factcheck.org",
                           "domain_credibility": {
                             "credibility": {
                               "confidence": 0.8233333333333334,
                               "value": 0.9695546558704454,
                               "source": "domain",
                               "domainReviewed": "www.factcheck.org"
                             },
                             "itemReviewed": "www.factcheck.org"
                           },
                           "claimReview_credibility_rating": {
                             "value": 0.19999999999999996,
                             "confidence": 0.85,
                             "explanation": "Based on normalised numeric ratingValue 6.0 in range [0.0-10.0]",
                             "source": "claimReview"
                           },
                           "similarity_credibility": {
                             "value": 0.19999999999999996,
                             "confidence": 0.7328860962787294,
                             "explanation": "Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be accurate with considerations. Based on normalised numeric ratingValue 6.0 in range [0.0-10.0]"
                           }
                         }
                       ],
                       "fact-checker-sentences": [],
                       "credible-pub-sentences": [
                         {
                           "sentence": "Now that the whole of Österostan and all eastern neighborhoods are injected, you have to keep defense in these parts, and at the same time send combatants to take Söderore, Vasastan, Old Town and all other neighborhoods.",
                           "domain": "www.expressen.se",
                           "similarity": 0.8304484387664941,
                           "doc_url": "https://www.expressen.se/nyheter/sag-sin-mamma-och-morbror-do-i-terrordad/",
                           "coinform_collection": "pilot-se",
                           "lang_orig": "en",
                           "published_date": "2019-03-29T14:34:24.571Z",
                           "claimspot_score": 0.2392160058769919,
                           "domain_credibility": {
                             "credibility": {
                               "confidence": 0.4,
                               "value": 0.6800000000000002,
                               "source": "domain",
                               "domainReviewed": "www.expressen.se"
                             },
                             "itemReviewed": "www.expressen.se"
                           },
                           "similarity_credibility": {
                             "value": 0.6800000000000002,
                             "confidence": 0.33217937550659765,
                             "explanation": "Claim is similar to:\n\n * Now that the whole of Österostan and all eastern neighborhoods are injected, you have to keep defense in these parts, and at the same time send combatants to take Söderore, Vasastan, Old Town and all other neighborhoods.\nthat was published in a site (www.expressen.se) that is reliable. "
                           }
                         },
                         {
                           "sentence": "His east language skills and his excellent contacts with the Balkan milieu eventually blend him into Kosovo, where he is killing former war criminals for the International Court of Justice.",
                           "domain": "www.zdf.de",
                           "similarity": 0.8156464727497865,
                           "doc_url": "https://www.zdf.de/serien/soko-wien",
                           "coinform_collection": "pilot-at",
                           "lang_orig": "en",
                           "published_date": "2019-03-18T16:15:36.952Z",
                           "claimspot_score": 0.3099886461117775,
                           "domain_credibility": {
                             "credibility": {
                               "confidence": 0.8666666666666667,
                               "value": 0.9723076923076923,
                               "source": "domain",
                               "domainReviewed": "www.zdf.de"
                             },
                             "itemReviewed": "www.zdf.de"
                           },
                           "similarity_credibility": {
                             "value": 0.9723076923076923,
                             "confidence": 0.7068936097164816,
                             "explanation": "Claim is similar to:\n\n * His east language skills and his excellent contacts with the Balkan milieu eventually blend him into Kosovo, where he is killing former war criminals for the International Court of Justice.\nthat was published in a site (www.zdf.de) that is reliable. "
                           }
                         }
                       ],
                       "non-credible-pub-sentences": []
                     },
                     "credibility": {
                       "value": 0.9695546558704454,
                       "confidence": 0.7355678924127977,
                       "explanation": "Claim is similar to:\n\n * missing sentence\nthat was published in a site (www.politifact.com) that is reliable. ",
                       "source": "credibility of related claims (4)"
                     }
                   },
                   {
                     "claim": "But Europe did not want them back, they said you keep them USA!",
                     "related_claims": {
                       "reviewed-claims": [
                         {
                           "claimReviewed": "\"But Europe did not want them back, they said you keep them USA! I said ‘NO, we did you a great favor and now you want us to hold them in U.S. prisons at tremendous cost. They are yours for trials.’\"",
                           "similarity": 0.8581984794037281,
                           "fact-checker": "https://www.politifact.com/",
                           "published_date": "2019-10-07T00:00:00Z",
                           "url": "https://www.politifact.com/truth-o-meter/article/2019/oct/08/fact-checking-donald-trumps-claims-about-syria-and/",
                           "altName": "Largely accurate",
                           "claimReview": {
                             "@context": "http://schema.org",
                             "@type": "ClaimReview",
                             "author": {
                               "@type": "Organization",
                               "image": "https://d10r9aj6omusou.cloudfront.net/factstream-logo-image-61554e34-b525-4723-b7ae-d1860eaa2296.png",
                               "name": "PolitiFact",
                               "url": "https://www.politifact.com/"
                             },
                             "claimReviewed": "\"But Europe did not want them back, they said you keep them USA! I said ‘NO, we did you a great favor and now you want us to hold them in U.S. prisons at tremendous cost. They are yours for trials.’\"",
                             "datePublished": "2019-10-08T20:29:32Z",
                             "itemReviewed": {
                               "@type": "Claim",
                               "author": {
                                 "@type": "Person",
                                 "image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBdkdYIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--8512f32ee68a42e006c92182e0befe4d029f0442/https-3A-2F-2Fstatic.politifact.com-2Fpolitifact-2Fmugs-2FNYT_TRUMP_CAMPAIGN_5.jpg?disposition=attachment",
                                 "jobTitle": "President of the United States",
                                 "name": "Donald Trump"
                               },
                               "datePublished": "2019-10-07",
                               "firstAppearance": {
                                 "@type": "CreativeWork",
                                 "url": "https://twitter.com/realDonaldTrump/status/1181172459325800448"
                               },
                               "name": "in a tweet"
                             },
                             "reviewRating": {
                               "@type": "Rating",
                               "alternateName": "Largely accurate"
                             },
                             "sdPublisher": {
                               "@type": "Organization",
                               "name": "Google Fact Check Tools API",
                               "url": "https://g.co/factchecktools"
                             },
                             "url": "https://www.politifact.com/truth-o-meter/article/2019/oct/08/fact-checking-donald-trumps-claims-about-syria-and/"
                           },
                           "domain": "www.politifact.com",
                           "domain_credibility": {
                             "credibility": {
                               "confidence": 0.8233333333333334,
                               "value": 0.9695546558704454,
                               "source": "domain",
                               "domainReviewed": "www.politifact.com"
                             },
                             "itemReviewed": "www.politifact.com"
                           },
                           "claimReview_credibility_rating": {
                             "value": 0.5,
                             "confidence": 1.0,
                             "explanation": "Based on textual claim-review rating 'largely accurate'",
                             "source": "claimReview"
                           },
                           "similarity_credibility": {
                             "value": 0.5,
                             "confidence": 0.8581984794037281,
                             "explanation": "Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be accurate. Based on textual claim-review rating 'largely accurate'",
                             "source": "credibility of related claims (3)"
                           }
                         }
                       ],
                       "fact-checker-sentences": [],
                       "credible-pub-sentences": [
                         {
                           "sentence": "Yes, we have the idea that we can go down to Brussels and say no to everything and never stand up when it is a crisis, as when Spain and Italy wanted help with refugees at the beginning of the 21 st century.",
                           "domain": "www.expressen.se",
                           "similarity": 0.8474718943900147,
                           "doc_url": "https://www.expressen.se/ledare/ledarsnack/eu-experten-i-bryssel-garvar-man-at-sverige/",
                           "coinform_collection": "pilot-se",
                           "lang_orig": "en",
                           "published_date": "2019-03-29T14:06:59.324Z",
                           "claimspot_score": 0.4606369204174919,
                           "domain_credibility": {
                             "credibility": {
                               "confidence": 0.4,
                               "value": 0.6800000000000002,
                               "source": "domain",
                               "domainReviewed": "www.expressen.se"
                             },
                             "itemReviewed": "www.expressen.se"
                           },
                           "similarity_credibility": {
                             "value": 0.6800000000000002,
                             "confidence": 0.3389887577560059,
                             "explanation": "Claim is similar to:\n\n * Yes, we have the idea that we can go down to Brussels and say no to everything and never stand up when it is a crisis, as when Spain and Italy wanted help with refugees at the beginning of the 21 st century.\nthat was published in a site (www.expressen.se) that is reliable. "
                           }
                         },
                         {
                           "sentence": "Even the US and large international corporations like Google and Amazon wanted a clear line from the EU, and were not happy with fragmented national solutions.",
                           "domain": "www.krone.at",
                           "similarity": 0.8347743144530129,
                           "doc_url": "https://www.krone.at/1881348",
                           "coinform_collection": "pilot-at",
                           "lang_orig": "en",
                           "published_date": "2019-03-18T16:12:43.830Z",
                           "claimspot_score": 0.2774044495982269,
                           "domain_credibility": {
                             "credibility": {
                               "confidence": 0.7799999999999999,
                               "value": 0.2553846153846154,
                               "source": "domain",
                               "domainReviewed": "www.krone.at"
                             },
                             "itemReviewed": "www.krone.at"
                           },
                           "similarity_credibility": {
                             "value": 0.2553846153846154,
                             "confidence": 0.6511239652733499,
                             "explanation": "Claim is similar to:\n\n * Even the US and large international corporations like Google and Amazon wanted a clear line from the EU, and were not happy with fragmented national solutions.\nthat was published in a site (www.krone.at) that is mostly reliable. "
                           }
                         }
                       ],
                       "non-credible-pub-sentences": []
                     },
                     "credibility": {
                       "value": 0.5,
                       "confidence": 0.8581984794037281,
                       "explanation": "Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be accurate. Based on textual claim-review rating 'largely accurate'",
                       "source": "credibility of related claims (3)"
                     }
                   },
                   {
                     "claim": "I said \"NO, we did you a great favor and now you want us to hold them in U.S. prisons at tremendous cost.",
                     "related_claims": {
                       "reviewed-claims": [
                         {
                           "claimReviewed": "\"But Europe did not want them back, they said you keep them USA! I said ‘NO, we did you a great favor and now you want us to hold them in U.S. prisons at tremendous cost. They are yours for trials.’\"",
                           "similarity": 0.8922634947180543,
                           "fact-checker": "https://www.politifact.com/",
                           "published_date": "2019-10-07T00:00:00Z",
                           "url": "https://www.politifact.com/truth-o-meter/article/2019/oct/08/fact-checking-donald-trumps-claims-about-syria-and/",
                           "altName": "Largely accurate",
                           "claimReview": {
                             "@context": "http://schema.org",
                             "@type": "ClaimReview",
                             "author": {
                               "@type": "Organization",
                               "image": "https://d10r9aj6omusou.cloudfront.net/factstream-logo-image-61554e34-b525-4723-b7ae-d1860eaa2296.png",
                               "name": "PolitiFact",
                               "url": "https://www.politifact.com/"
                             },
                             "claimReviewed": "\"But Europe did not want them back, they said you keep them USA! I said ‘NO, we did you a great favor and now you want us to hold them in U.S. prisons at tremendous cost. They are yours for trials.’\"",
                             "datePublished": "2019-10-08T20:29:32Z",
                             "itemReviewed": {
                               "@type": "Claim",
                               "author": {
                                 "@type": "Person",
                                 "image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBdkdYIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--8512f32ee68a42e006c92182e0befe4d029f0442/https-3A-2F-2Fstatic.politifact.com-2Fpolitifact-2Fmugs-2FNYT_TRUMP_CAMPAIGN_5.jpg?disposition=attachment",
                                 "jobTitle": "President of the United States",
                                 "name": "Donald Trump"
                               },
                               "datePublished": "2019-10-07",
                               "firstAppearance": {
                                 "@type": "CreativeWork",
                                 "url": "https://twitter.com/realDonaldTrump/status/1181172459325800448"
                               },
                               "name": "in a tweet"
                             },
                             "reviewRating": {
                               "@type": "Rating",
                               "alternateName": "Largely accurate"
                             },
                             "sdPublisher": {
                               "@type": "Organization",
                               "name": "Google Fact Check Tools API",
                               "url": "https://g.co/factchecktools"
                             },
                             "url": "https://www.politifact.com/truth-o-meter/article/2019/oct/08/fact-checking-donald-trumps-claims-about-syria-and/"
                           },
                           "domain": "www.politifact.com",
                           "domain_credibility": {
                             "credibility": {
                               "confidence": 0.8233333333333334,
                               "value": 0.9695546558704454,
                               "source": "domain",
                               "domainReviewed": "www.politifact.com"
                             },
                             "itemReviewed": "www.politifact.com"
                           },
                           "claimReview_credibility_rating": {
                             "value": 0.5,
                             "confidence": 1.0,
                             "explanation": "Based on textual claim-review rating 'largely accurate'",
                             "source": "claimReview"
                           },
                           "similarity_credibility": {
                             "value": 0.5,
                             "confidence": 0.8922634947180543,
                             "explanation": "Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be accurate. Based on textual claim-review rating 'largely accurate'",
                             "source": "credibility of related claims (3)"
                           }
                         }
                       ],
                       "fact-checker-sentences": [],
                       "credible-pub-sentences": [
                         {
                           "sentence": "Another option that the government should consider is the renting of prison places in other countries.",
                           "domain": "www.expressen.se",
                           "similarity": 0.8225785161293017,
                           "doc_url": "https://www.expressen.se/ledare/anna-dahlberg/hyra-fangelseplatser-krisen-kraver-nytankande-/#site-menu",
                           "coinform_collection": "pilot-se",
                           "lang_orig": "en",
                           "published_date": "2019-03-29T14:57:14.833Z",
                           "claimspot_score": 0.3003093583580326,
                           "domain_credibility": {
                             "credibility": {
                               "confidence": 0.4,
                               "value": 0.6800000000000002,
                               "source": "domain",
                               "domainReviewed": "www.expressen.se"
                             },
                             "itemReviewed": "www.expressen.se"
                           },
                           "similarity_credibility": {
                             "value": 0.6800000000000002,
                             "confidence": 0.3290314064517207,
                             "explanation": "Claim is similar to:\n\n * Another option that the government should consider is the renting of prison places in other countries.\nthat was published in a site (www.expressen.se) that is reliable. "
                           }
                         },
                         {
                           "sentence": "For a long time, I have proposed a series of measures that could allow for such a point marking of gang criminals - including on-call courts, abolition of criminal discounts, reduced detentions, reduced criminal penalties and more.",
                           "domain": "www.expressen.se",
                           "similarity": 0.8202213900262623,
                           "doc_url": "https://www.expressen.se/ledare/anna-dahlberg/for-latt-att-vara-kriminell-i-sverige/",
                           "coinform_collection": "pilot-se",
                           "lang_orig": "en",
                           "published_date": "2019-03-29T14:29:03.937Z",
                           "claimspot_score": 0.6782031149945023,
                           "domain_credibility": {
                             "credibility": {
                               "confidence": 0.4,
                               "value": 0.6800000000000002,
                               "source": "domain",
                               "domainReviewed": "www.expressen.se"
                             },
                             "itemReviewed": "www.expressen.se"
                           },
                           "similarity_credibility": {
                             "value": 0.6800000000000002,
                             "confidence": 0.3280885560105049,
                             "explanation": "Claim is similar to:\n\n * For a long time, I have proposed a series of measures that could allow for such a point marking of gang criminals - including on-call courts, abolition of criminal discounts, reduced detentions, reduced criminal penalties and more.\nthat was published in a site (www.expressen.se) that is reliable. "
                           }
                         }
                       ],
                       "non-credible-pub-sentences": []
                     },
                     "credibility": {
                       "value": 0.5,
                       "confidence": 0.8922634947180543,
                       "explanation": "Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be accurate. Based on textual claim-review rating 'largely accurate'",
                       "source": "credibility of related claims (3)"
                     }
                   },
                   {
                     "claim": "They are yours for trials.\"",
                     "related_claims": {
                       "reviewed-claims": [
                         {
                           "claimReviewed": "\"A lot of people are being saved\" under the Right to Try Act, which was enacted last year to provide faster access to unapproved medications still in development. ",
                           "similarity": 0.7836633632928991,
                           "fact-checker": "https://www.factcheck.org/",
                           "published_date": "2019-09-11T00:00:00Z",
                           "url": "https://www.factcheck.org/2019/09/is-right-to-try-saving-a-lot-of-people/",
                           "altName": "Unsupported",
                           "claimReview": {
                             "@context": "http://schema.org",
                             "@type": "ClaimReview",
                             "author": {
                               "@type": "Organization",
                               "image": "https://d10r9aj6omusou.cloudfront.net/factstream-logo-image-d669a00c-15d4-409e-811c-e82135db8000.png",
                               "name": "FactCheck.org",
                               "url": "https://www.factcheck.org/"
                             },
                             "claimReviewed": "\"A lot of people are being saved\" under the Right to Try Act, which was enacted last year to provide faster access to unapproved medications still in development. ",
                             "itemReviewed": {
                               "@type": "Claim",
                               "author": {
                                 "@type": "Person",
                                 "image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBdVNXIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--d2502bafc91405a2badbf1b7d895e7abcb0b32bd/https-3A-2F-2Fcdn.factcheck.org-2FUploadedFiles-2FTrump-new-widget.png?disposition=attachment",
                                 "jobTitle": "President of the United States",
                                 "name": "Donald Trump"
                               },
                               "datePublished": "2019-09-11",
                               "firstAppearance": {
                                 "@type": "CreativeWork",
                                 "url": "https://www.whitehouse.gov/briefings-statements/remarks-president-trump-meeting-e-cigarettes/"
                               },
                               "name": "White House"
                             },
                             "reviewRating": {
                               "@type": "Rating",
                               "alternateName": "Unsupported",
                               "bestRating": "10",
                               "image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBdVdXIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--3783103d3173fc34b9500238e1060e2d60898238/https-3A-2F-2Fdhpikd1t89arn.cloudfront.net-2Frating_images-2Ffactcheck.org-2Funsupported.png?disposition=attachment",
                               "ratingValue": "0",
                               "worstRating": "0"
                             },
                             "sdPublisher": {
                               "@type": "Organization",
                               "name": "Google Fact Check Tools API",
                               "url": "https://g.co/factchecktools"
                             },
                             "url": "https://www.factcheck.org/2019/09/is-right-to-try-saving-a-lot-of-people/"
                           },
                           "domain": "www.factcheck.org",
                           "domain_credibility": {
                             "credibility": {
                               "confidence": 0.8233333333333334,
                               "value": 0.9695546558704454,
                               "source": "domain",
                               "domainReviewed": "www.factcheck.org"
                             },
                             "itemReviewed": "www.factcheck.org"
                           },
                           "claimReview_credibility_rating": {
                             "value": -1.0,
                             "confidence": 0.85,
                             "explanation": "Based on normalised numeric ratingValue 0.0 in range [0.0-10.0]",
                             "source": "claimReview"
                           },
                           "similarity_credibility": {
                             "value": -1.0,
                             "confidence": 0.6661138587989642,
                             "explanation": "Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be inaccurate. Based on normalised numeric ratingValue 0.0 in range [0.0-10.0]",
                             "source": "credibility of related claims (4)"
                           }
                         },
                         {
                           "claimReviewed": "Says under the Democratic impeachment inquiry, Republicans get \"more rights than we ever received in any of the other impeachment proceedings.\" ",
                           "similarity": 0.7672799649350067,
                           "fact-checker": "https://www.politifact.com/",
                           "published_date": "2019-10-31T00:00:00Z",
                           "url": "https://www.politifact.com/truth-o-meter/statements/2019/nov/04/nancy-pelosi/nancy-pelosi-overstates-republican-gains-impeachme/",
                           "altName": "Mostly False",
                           "claimReview": {
                             "@context": "http://schema.org",
                             "@type": "ClaimReview",
                             "author": {
                               "@type": "Organization",
                               "image": "https://d10r9aj6omusou.cloudfront.net/factstream-logo-image-61554e34-b525-4723-b7ae-d1860eaa2296.png",
                               "name": "PolitiFact",
                               "url": "https://www.politifact.com/"
                             },
                             "claimReviewed": "Says under the Democratic impeachment inquiry, Republicans get \"more rights than we ever received in any of the other impeachment proceedings.\" ",
                             "itemReviewed": {
                               "@type": "Claim",
                               "author": {
                                 "@type": "Person",
                                 "image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBbEdaIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--f2648674feea555b5395679d7f9392f5ddab946e/https-3A-2F-2Fstatic.politifact.com-2Fmugs-2Fmug-nancypelosi.jpg?disposition=attachment",
                                 "jobTitle": "Speaker of the U.S. House of Representatives",
                                 "name": "Nancy Pelosi"
                               },
                               "datePublished": "2019-10-31",
                               "firstAppearance": {
                                 "@type": "CreativeWork",
                                 "url": "https://www.yahoo.com/entertainment/nancy-pelosi-on-republican-opposition-to-impeachment-i-cannot-be-held-up-by-that-074847242.html"
                               },
                               "name": "In an interview with \"Late Show\" host Stephen Colbert."
                             },
                             "reviewRating": {
                               "@type": "Rating",
                               "alternateName": "Mostly False",
                               "bestRating": "9",
                               "image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBbEtaIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--587124a440ad936e1f9ca1d7fc2bd34e41cca773/https-3A-2F-2Fdhpikd1t89arn.cloudfront.net-2Frating_images-2Fpolitifact-2Ftom-mostlyfalse.jpg?disposition=attachment",
                               "ratingValue": "3",
                               "worstRating": "0"
                             },
                             "sdPublisher": {
                               "@type": "Organization",
                               "name": "Google Fact Check Tools API",
                               "url": "https://g.co/factchecktools"
                             },
                             "url": "https://www.politifact.com/truth-o-meter/statements/2019/nov/04/nancy-pelosi/nancy-pelosi-overstates-republican-gains-impeachme/"
                           },
                           "domain": "www.politifact.com",
                           "domain_credibility": {
                             "credibility": {
                               "confidence": 0.8233333333333334,
                               "value": 0.9695546558704454,
                               "source": "domain",
                               "domainReviewed": "www.politifact.com"
                             },
                             "itemReviewed": "www.politifact.com"
                           },
                           "claimReview_credibility_rating": {
                             "value": -0.33333333333333337,
                             "confidence": 0.85,
                             "explanation": "Based on normalised numeric ratingValue 3.0 in range [0.0-9.0]",
                             "source": "claimReview"
                           },
                           "similarity_credibility": {
                             "value": -0.33333333333333337,
                             "confidence": 0.6521879701947557,
                             "explanation": "Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be inaccurate with considerations. Based on normalised numeric ratingValue 3.0 in range [0.0-9.0]"
                           }
                         }
                       ],
                       "fact-checker-sentences": [],
                       "credible-pub-sentences": [
                         {
                           "sentence": "At the same time, however, registration can be seen as a quality mark when, as breeders within SKK, you must comply with both the basic rules, the statutes and the various health programs, Mr. Rosenberg.",
                           "domain": "www.expressen.se",
                           "similarity": 0.7665341436072484,
                           "doc_url": "https://www.expressen.se/leva-och-bo/husdjur/sugen-pa-att-starta-en-kennel-sa-gor-du/",
                           "coinform_collection": "pilot-se",
                           "lang_orig": "en",
                           "published_date": "2019-03-29T15:17:22.557Z",
                           "claimspot_score": 0.3012149572132797,
                           "domain_credibility": {
                             "credibility": {
                               "confidence": 0.4,
                               "value": 0.6800000000000002,
                               "source": "domain",
                               "domainReviewed": "www.expressen.se"
                             },
                             "itemReviewed": "www.expressen.se"
                           },
                           "similarity_credibility": {
                             "value": 0.6800000000000002,
                             "confidence": 0.30661365744289937,
                             "explanation": "Claim is similar to:\n\n * At the same time, however, registration can be seen as a quality mark when, as breeders within SKK, you must comply with both the basic rules, the statutes and the various health programs, Mr. Rosenberg.\nthat was published in a site (www.expressen.se) that is reliable. "
                           }
                         }
                       ],
                       "non-credible-pub-sentences": [
                         {
                           "sentence": "«stranded assets» from the market, enabling them to be",
                           "domain": "paris2050.elioth.com",
                           "similarity": 0.7681563868691467,
                           "doc_url": "http://paris2050.elioth.com/pdf/170615%20-%20Paris%20Carbone%20Neutral%20-%20report_LD.pdf",
                           "coinform_collection": "fc-dev",
                           "lang_orig": "en",
                           "published_date": "2017-12-13T17:49:39Z",
                           "claimspot_score": 0.3021416302924611,
                           "domain_credibility": {
                             "credibility": {
                               "confidence": 0.03,
                               "value": 0.22000000000000003,
                               "source": "domain",
                               "domainReviewed": "paris2050.elioth.com"
                             },
                             "itemReviewed": "paris2050.elioth.com"
                           },
                           "similarity_credibility": {
                             "value": 0.22000000000000003,
                             "confidence": 0.023044691606074398,
                             "explanation": "Claim is similar to:\n\n * «stranded assets» from the market, enabling them to be\nthat was published in a site (paris2050.elioth.com) that is mostly reliable. "
                           }
                         }
                       ]
                     },
                     "credibility": {
                       "value": -1.0,
                       "confidence": 0.6661138587989642,
                       "explanation": "Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be inaccurate. Based on normalised numeric ratingValue 0.0 in range [0.0-10.0]",
                       "source": "credibility of related claims (4)"
                     }
                   },
                   {
                     "claim": "They.....",
                     "related_claims": {
                       "reviewed-claims": [],
                       "fact-checker-sentences": [],
                       "credible-pub-sentences": [
                         {
                           "sentence": "The deception was made so that the sample writers were helped by the sample through minimal audiences.",
                           "domain": "www.expressen.se",
                           "similarity": 0.8368234193835938,
                           "doc_url": "https://www.expressen.se/kvallsposten/elever-fuskade-sig-in-pa-universitet-stangs-av-/",
                           "coinform_collection": "pilot-se",
                           "lang_orig": "en",
                           "published_date": "2019-03-29T15:09:48.142Z",
                           "claimspot_score": 0.2902550488637586,
                           "domain_credibility": {
                             "credibility": {
                               "confidence": 0.4,
                               "value": 0.6800000000000002,
                               "source": "domain",
                               "domainReviewed": "www.expressen.se"
                             },
                             "itemReviewed": "www.expressen.se"
                           },
                           "similarity_credibility": {
                             "value": 0.6800000000000002,
                             "confidence": 0.33472936775343753,
                             "explanation": "Claim is similar to:\n\n * The deception was made so that the sample writers were helped by the sample through minimal audiences.\nthat was published in a site (www.expressen.se) that is reliable. "
                           }
                         },
                         {
                           "sentence": "Five-year-olds, however, already dominate, dominate the ability of deception, and trickle out.",
                           "domain": "www.zdf.de",
                           "similarity": 0.8356164848366407,
                           "doc_url": "https://www.zdf.de/wissen/leschs-kosmos/ungelogen-die-wahrheit-hinter-der-luege-100.html",
                           "coinform_collection": "pilot-at",
                           "lang_orig": "en",
                           "published_date": "2019-03-18T16:15:26.443Z",
                           "claimspot_score": 0.2794755403660334,
                           "domain_credibility": {
                             "credibility": {
                               "confidence": 0.8666666666666667,
                               "value": 0.9723076923076923,
                               "source": "domain",
                               "domainReviewed": "www.zdf.de"
                             },
                             "itemReviewed": "www.zdf.de"
                           },
                           "similarity_credibility": {
                             "value": 0.9723076923076923,
                             "confidence": 0.7242009535250886,
                             "explanation": "Claim is similar to:\n\n * Five-year-olds, however, already dominate, dominate the ability of deception, and trickle out.\nthat was published in a site (www.zdf.de) that is reliable. ",
                             "source": "credibility of related claims (2)"
                           }
                         }
                       ],
                       "non-credible-pub-sentences": []
                     },
                     "credibility": {
                       "value": 0.9723076923076923,
                       "confidence": 0.7242009535250886,
                       "explanation": "Claim is similar to:\n\n * Five-year-olds, however, already dominate, dominate the ability of deception, and trickle out.\nthat was published in a site (www.zdf.de) that is reliable. ",
                       "source": "credibility of related claims (2)"
                     }
                   }
                 ],
                 "sentences_linked": [],
                 "credibility": 0.5,
                 "confidence": 0.8581984794037281,
                 "credibility_label": "credible",
                 "explanation": "Sentence in tweet: Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be accurate. Based on textual claim-review rating 'largely accurate'"
               }
             ]
           }
         }
       },
       "query_id": "251b6a72cd3a3af314baf748abdfac93c076e54272dabcaef5b7b115eb65c848",
       "module_response_code": {
         "misinfome": 200,
         "contentanalysis": 200,
         "claimcredibility": 200
       },
       "flattened_module_responses": {
         "misinfome_credibility_value": 0.0,
         "misinfome_credibility_confidence": 0.0,
         "misinfome_profile_as_source_credibility_credibility_value": 0,
         "misinfome_profile_as_source_credibility_credibility_confidence": 0,
         "misinfome_sources_credibility_credibility_value": 0.0,
         "misinfome_sources_credibility_credibility_confidence": 0.0,
         "misinfome_urls_credibility_credibility_value": 0.0,
         "misinfome_urls_credibility_credibility_confidence": 0.0,
         "misinfome_itemreviewed": 1181172459325800448,
         "claimcredibility_tweet_claim_credibility_0_tweet_id": 1181172459325800448,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_claim": "....including capturing thousands of ISIS fighters, mostly from Europe.",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreviewed": "Says \"thousands\" of captured ISIS fighters are \"mostly from Europe.\"",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_similarity": 0.8934022984770823,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_fact_checker": "https://www.politifact.com/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_published_date": "2019-10-07T00:00:00Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_url": "https://www.politifact.com/truth-o-meter/article/2019/oct/08/fact-checking-donald-trumps-claims-about-syria-and/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_altname": "Mostly from Syria, Iraq",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_@context": "http://schema.org",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_@type": "ClaimReview",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_author_@type": "Organization",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_author_image": "https://d10r9aj6omusou.cloudfront.net/factstream-logo-image-61554e34-b525-4723-b7ae-d1860eaa2296.png",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_author_name": "PolitiFact",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_author_url": "https://www.politifact.com/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_claimreviewed": "Says \"thousands\" of captured ISIS fighters are \"mostly from Europe.\"",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_datepublished": "2019-10-08T20:29:32Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_itemreviewed_@type": "Claim",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_itemreviewed_author_@type": "Person",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_itemreviewed_author_image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBdkNYIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--157d0f76861f60fb3f74a5c16b18fb84ab52a071/https-3A-2F-2Fstatic.politifact.com-2Fpolitifact-2Fmugs-2FNYT_TRUMP_CAMPAIGN_5.jpg?disposition=attachment",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_itemreviewed_author_jobtitle": "President of the United States",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_itemreviewed_author_name": "Donald Trump",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_itemreviewed_datepublished": "2019-10-07",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_itemreviewed_firstappearance_@type": "CreativeWork",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_itemreviewed_firstappearance_url": "https://twitter.com/realDonaldTrump/status/1181172459325800448",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_itemreviewed_name": "in a tweet",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_reviewrating_@type": "Rating",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_reviewrating_alternatename": "Mostly from Syria, Iraq",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_sdpublisher_@type": "Organization",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_sdpublisher_name": "Google Fact Check Tools API",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_sdpublisher_url": "https://g.co/factchecktools",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_url": "https://www.politifact.com/truth-o-meter/article/2019/oct/08/fact-checking-donald-trumps-claims-about-syria-and/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_domain": "www.politifact.com",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_domain_credibility_credibility_confidence": 0.8233333333333334,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_domain_credibility_credibility_value": 0.9695546558704454,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_domain_credibility_credibility_source": "domain",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_domain_credibility_credibility_domainreviewed": "www.politifact.com",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_domain_credibility_itemreviewed": "www.politifact.com",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_credibility_rating_value": 0.0,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_credibility_rating_confidence": 0.0,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_credibility_rating_explanation": "Unknown accuracy for textual claim-review rating 'mostly from syria, iraq'",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_claimreview_credibility_rating_source": "claimReview",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_similarity_credibility_value": 0.9695546558704454,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_similarity_credibility_confidence": 0.7355678924127977,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_similarity_credibility_explanation": "Claim is similar to:\n\n * missing sentence\nthat was published in a site (www.politifact.com) that is reliable. ",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_0_similarity_credibility_source": "credibility of related claims (4)",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreviewed": "The thousands of ISIS fighters captured in Syria were \"mostly from Europe.\"",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_similarity": 0.8622189367985051,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_fact_checker": "https://www.factcheck.org/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_published_date": "2019-10-07T00:00:00Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_url": "https://www.factcheck.org/2019/10/trumps-false-tweets-on-syria/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_altname": "False",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_@context": "http://schema.org",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_@type": "ClaimReview",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_author_@type": "Organization",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_author_image": "https://d10r9aj6omusou.cloudfront.net/factstream-logo-image-d669a00c-15d4-409e-811c-e82135db8000.png",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_author_name": "FactCheck.org",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_author_url": "https://www.factcheck.org/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_claimreviewed": "The thousands of ISIS fighters captured in Syria were \"mostly from Europe.\"",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_datepublished": "2019-10-10T17:39:35Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_itemreviewed_@type": "Claim",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_itemreviewed_author_@type": "Person",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_itemreviewed_author_image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBZ3FZIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--42f34cf15128333aede0c2125cd86eaf44483ca9/https-3A-2F-2Fcdn.factcheck.org-2FUploadedFiles-2FTrump-new-widget.png?disposition=attachment",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_itemreviewed_author_jobtitle": "President",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_itemreviewed_author_name": "Donald Trump",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_itemreviewed_datepublished": "2019-10-07",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_itemreviewed_firstappearance_@type": "CreativeWork",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_itemreviewed_firstappearance_url": "https://twitter.com/realDonaldTrump/status/1181172459325800448",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_itemreviewed_name": "Twitter",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_reviewrating_@type": "Rating",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_reviewrating_alternatename": "False",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_reviewrating_bestrating": "10",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_reviewrating_image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBZ3VZIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--22236f3b070b51dfd9f9b38bec866fc76a6d1de4/https-3A-2F-2Fdhpikd1t89arn.cloudfront.net-2Frating_images-2Ffactcheck.org-2Ffalse.png?disposition=attachment",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_reviewrating_ratingvalue": "6",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_reviewrating_worstrating": "0",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_sdpublisher_@type": "Organization",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_sdpublisher_name": "Google Fact Check Tools API",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_sdpublisher_url": "https://g.co/factchecktools",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_url": "https://www.factcheck.org/2019/10/trumps-false-tweets-on-syria/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_domain": "www.factcheck.org",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_domain_credibility_credibility_confidence": 0.8233333333333334,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_domain_credibility_credibility_value": 0.9695546558704454,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_domain_credibility_credibility_source": "domain",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_domain_credibility_credibility_domainreviewed": "www.factcheck.org",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_domain_credibility_itemreviewed": "www.factcheck.org",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_credibility_rating_value": 0.19999999999999996,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_credibility_rating_confidence": 0.85,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_credibility_rating_explanation": "Based on normalised numeric ratingValue 6.0 in range [0.0-10.0]",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_claimreview_credibility_rating_source": "claimReview",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_similarity_credibility_value": 0.19999999999999996,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_similarity_credibility_confidence": 0.7328860962787294,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_reviewed_claims_1_similarity_credibility_explanation": "Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be accurate with considerations. Based on normalised numeric ratingValue 6.0 in range [0.0-10.0]",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_0_sentence": "Now that the whole of Österostan and all eastern neighborhoods are injected, you have to keep defense in these parts, and at the same time send combatants to take Söderore, Vasastan, Old Town and all other neighborhoods.",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_0_domain": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_0_similarity": 0.8304484387664941,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_0_doc_url": "https://www.expressen.se/nyheter/sag-sin-mamma-och-morbror-do-i-terrordad/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_0_coinform_collection": "pilot-se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_0_lang_orig": "en",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_0_published_date": "2019-03-29T14:34:24.571Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_0_claimspot_score": 0.2392160058769919,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_0_domain_credibility_credibility_confidence": 0.4,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_0_domain_credibility_credibility_value": 0.6800000000000002,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_0_domain_credibility_credibility_source": "domain",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_0_domain_credibility_credibility_domainreviewed": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_0_domain_credibility_itemreviewed": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_0_similarity_credibility_value": 0.6800000000000002,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_0_similarity_credibility_confidence": 0.33217937550659765,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_0_similarity_credibility_explanation": "Claim is similar to:\n\n * Now that the whole of Österostan and all eastern neighborhoods are injected, you have to keep defense in these parts, and at the same time send combatants to take Söderore, Vasastan, Old Town and all other neighborhoods.\nthat was published in a site (www.expressen.se) that is reliable. ",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_1_sentence": "His east language skills and his excellent contacts with the Balkan milieu eventually blend him into Kosovo, where he is killing former war criminals for the International Court of Justice.",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_1_domain": "www.zdf.de",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_1_similarity": 0.8156464727497865,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_1_doc_url": "https://www.zdf.de/serien/soko-wien",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_1_coinform_collection": "pilot-at",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_1_lang_orig": "en",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_1_published_date": "2019-03-18T16:15:36.952Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_1_claimspot_score": 0.3099886461117775,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_1_domain_credibility_credibility_confidence": 0.8666666666666667,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_1_domain_credibility_credibility_value": 0.9723076923076923,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_1_domain_credibility_credibility_source": "domain",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_1_domain_credibility_credibility_domainreviewed": "www.zdf.de",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_1_domain_credibility_itemreviewed": "www.zdf.de",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_1_similarity_credibility_value": 0.9723076923076923,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_1_similarity_credibility_confidence": 0.7068936097164816,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_related_claims_credible_pub_sentences_1_similarity_credibility_explanation": "Claim is similar to:\n\n * His east language skills and his excellent contacts with the Balkan milieu eventually blend him into Kosovo, where he is killing former war criminals for the International Court of Justice.\nthat was published in a site (www.zdf.de) that is reliable. ",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_credibility_value": 0.9695546558704454,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_credibility_confidence": 0.7355678924127977,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_credibility_explanation": "Claim is similar to:\n\n * missing sentence\nthat was published in a site (www.politifact.com) that is reliable. ",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_0_credibility_source": "credibility of related claims (4)",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_claim": "But Europe did not want them back, they said you keep them USA!",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreviewed": "\"But Europe did not want them back, they said you keep them USA! I said ‘NO, we did you a great favor and now you want us to hold them in U.S. prisons at tremendous cost. They are yours for trials.’\"",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_similarity": 0.8581984794037281,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_fact_checker": "https://www.politifact.com/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_published_date": "2019-10-07T00:00:00Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_url": "https://www.politifact.com/truth-o-meter/article/2019/oct/08/fact-checking-donald-trumps-claims-about-syria-and/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_altname": "Largely accurate",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_@context": "http://schema.org",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_@type": "ClaimReview",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_author_@type": "Organization",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_author_image": "https://d10r9aj6omusou.cloudfront.net/factstream-logo-image-61554e34-b525-4723-b7ae-d1860eaa2296.png",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_author_name": "PolitiFact",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_author_url": "https://www.politifact.com/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_claimreviewed": "\"But Europe did not want them back, they said you keep them USA! I said ‘NO, we did you a great favor and now you want us to hold them in U.S. prisons at tremendous cost. They are yours for trials.’\"",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_datepublished": "2019-10-08T20:29:32Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_itemreviewed_@type": "Claim",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_itemreviewed_author_@type": "Person",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_itemreviewed_author_image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBdkdYIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--8512f32ee68a42e006c92182e0befe4d029f0442/https-3A-2F-2Fstatic.politifact.com-2Fpolitifact-2Fmugs-2FNYT_TRUMP_CAMPAIGN_5.jpg?disposition=attachment",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_itemreviewed_author_jobtitle": "President of the United States",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_itemreviewed_author_name": "Donald Trump",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_itemreviewed_datepublished": "2019-10-07",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_itemreviewed_firstappearance_@type": "CreativeWork",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_itemreviewed_firstappearance_url": "https://twitter.com/realDonaldTrump/status/1181172459325800448",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_itemreviewed_name": "in a tweet",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_reviewrating_@type": "Rating",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_reviewrating_alternatename": "Largely accurate",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_sdpublisher_@type": "Organization",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_sdpublisher_name": "Google Fact Check Tools API",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_sdpublisher_url": "https://g.co/factchecktools",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_url": "https://www.politifact.com/truth-o-meter/article/2019/oct/08/fact-checking-donald-trumps-claims-about-syria-and/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_domain": "www.politifact.com",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_domain_credibility_credibility_confidence": 0.8233333333333334,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_domain_credibility_credibility_value": 0.9695546558704454,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_domain_credibility_credibility_source": "domain",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_domain_credibility_credibility_domainreviewed": "www.politifact.com",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_domain_credibility_itemreviewed": "www.politifact.com",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_credibility_rating_value": 0.5,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_credibility_rating_confidence": 1.0,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_credibility_rating_explanation": "Based on textual claim-review rating 'largely accurate'",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_claimreview_credibility_rating_source": "claimReview",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_similarity_credibility_value": 0.5,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_similarity_credibility_confidence": 0.8581984794037281,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_similarity_credibility_explanation": "Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be accurate. Based on textual claim-review rating 'largely accurate'",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_reviewed_claims_0_similarity_credibility_source": "credibility of related claims (3)",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_0_sentence": "Yes, we have the idea that we can go down to Brussels and say no to everything and never stand up when it is a crisis, as when Spain and Italy wanted help with refugees at the beginning of the 21 st century.",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_0_domain": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_0_similarity": 0.8474718943900147,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_0_doc_url": "https://www.expressen.se/ledare/ledarsnack/eu-experten-i-bryssel-garvar-man-at-sverige/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_0_coinform_collection": "pilot-se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_0_lang_orig": "en",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_0_published_date": "2019-03-29T14:06:59.324Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_0_claimspot_score": 0.4606369204174919,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_0_domain_credibility_credibility_confidence": 0.4,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_0_domain_credibility_credibility_value": 0.6800000000000002,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_0_domain_credibility_credibility_source": "domain",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_0_domain_credibility_credibility_domainreviewed": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_0_domain_credibility_itemreviewed": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_0_similarity_credibility_value": 0.6800000000000002,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_0_similarity_credibility_confidence": 0.3389887577560059,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_0_similarity_credibility_explanation": "Claim is similar to:\n\n * Yes, we have the idea that we can go down to Brussels and say no to everything and never stand up when it is a crisis, as when Spain and Italy wanted help with refugees at the beginning of the 21 st century.\nthat was published in a site (www.expressen.se) that is reliable. ",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_1_sentence": "Even the US and large international corporations like Google and Amazon wanted a clear line from the EU, and were not happy with fragmented national solutions.",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_1_domain": "www.krone.at",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_1_similarity": 0.8347743144530129,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_1_doc_url": "https://www.krone.at/1881348",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_1_coinform_collection": "pilot-at",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_1_lang_orig": "en",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_1_published_date": "2019-03-18T16:12:43.830Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_1_claimspot_score": 0.2774044495982269,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_1_domain_credibility_credibility_confidence": 0.7799999999999999,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_1_domain_credibility_credibility_value": 0.2553846153846154,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_1_domain_credibility_credibility_source": "domain",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_1_domain_credibility_credibility_domainreviewed": "www.krone.at",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_1_domain_credibility_itemreviewed": "www.krone.at",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_1_similarity_credibility_value": 0.2553846153846154,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_1_similarity_credibility_confidence": 0.6511239652733499,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_related_claims_credible_pub_sentences_1_similarity_credibility_explanation": "Claim is similar to:\n\n * Even the US and large international corporations like Google and Amazon wanted a clear line from the EU, and were not happy with fragmented national solutions.\nthat was published in a site (www.krone.at) that is mostly reliable. ",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_credibility_value": 0.5,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_credibility_confidence": 0.8581984794037281,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_credibility_explanation": "Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be accurate. Based on textual claim-review rating 'largely accurate'",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_1_credibility_source": "credibility of related claims (3)",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_claim": "I said \"NO, we did you a great favor and now you want us to hold them in U.S. prisons at tremendous cost.",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreviewed": "\"But Europe did not want them back, they said you keep them USA! I said ‘NO, we did you a great favor and now you want us to hold them in U.S. prisons at tremendous cost. They are yours for trials.’\"",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_similarity": 0.8922634947180543,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_fact_checker": "https://www.politifact.com/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_published_date": "2019-10-07T00:00:00Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_url": "https://www.politifact.com/truth-o-meter/article/2019/oct/08/fact-checking-donald-trumps-claims-about-syria-and/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_altname": "Largely accurate",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_@context": "http://schema.org",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_@type": "ClaimReview",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_author_@type": "Organization",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_author_image": "https://d10r9aj6omusou.cloudfront.net/factstream-logo-image-61554e34-b525-4723-b7ae-d1860eaa2296.png",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_author_name": "PolitiFact",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_author_url": "https://www.politifact.com/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_claimreviewed": "\"But Europe did not want them back, they said you keep them USA! I said ‘NO, we did you a great favor and now you want us to hold them in U.S. prisons at tremendous cost. They are yours for trials.’\"",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_datepublished": "2019-10-08T20:29:32Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_itemreviewed_@type": "Claim",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_itemreviewed_author_@type": "Person",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_itemreviewed_author_image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBdkdYIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--8512f32ee68a42e006c92182e0befe4d029f0442/https-3A-2F-2Fstatic.politifact.com-2Fpolitifact-2Fmugs-2FNYT_TRUMP_CAMPAIGN_5.jpg?disposition=attachment",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_itemreviewed_author_jobtitle": "President of the United States",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_itemreviewed_author_name": "Donald Trump",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_itemreviewed_datepublished": "2019-10-07",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_itemreviewed_firstappearance_@type": "CreativeWork",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_itemreviewed_firstappearance_url": "https://twitter.com/realDonaldTrump/status/1181172459325800448",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_itemreviewed_name": "in a tweet",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_reviewrating_@type": "Rating",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_reviewrating_alternatename": "Largely accurate",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_sdpublisher_@type": "Organization",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_sdpublisher_name": "Google Fact Check Tools API",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_sdpublisher_url": "https://g.co/factchecktools",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_url": "https://www.politifact.com/truth-o-meter/article/2019/oct/08/fact-checking-donald-trumps-claims-about-syria-and/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_domain": "www.politifact.com",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_domain_credibility_credibility_confidence": 0.8233333333333334,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_domain_credibility_credibility_value": 0.9695546558704454,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_domain_credibility_credibility_source": "domain",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_domain_credibility_credibility_domainreviewed": "www.politifact.com",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_domain_credibility_itemreviewed": "www.politifact.com",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_credibility_rating_value": 0.5,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_credibility_rating_confidence": 1.0,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_credibility_rating_explanation": "Based on textual claim-review rating 'largely accurate'",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_claimreview_credibility_rating_source": "claimReview",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_similarity_credibility_value": 0.5,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_similarity_credibility_confidence": 0.8922634947180543,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_similarity_credibility_explanation": "Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be accurate. Based on textual claim-review rating 'largely accurate'",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_reviewed_claims_0_similarity_credibility_source": "credibility of related claims (3)",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_0_sentence": "Another option that the government should consider is the renting of prison places in other countries.",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_0_domain": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_0_similarity": 0.8225785161293017,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_0_doc_url": "https://www.expressen.se/ledare/anna-dahlberg/hyra-fangelseplatser-krisen-kraver-nytankande-/#site-menu",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_0_coinform_collection": "pilot-se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_0_lang_orig": "en",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_0_published_date": "2019-03-29T14:57:14.833Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_0_claimspot_score": 0.3003093583580326,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_0_domain_credibility_credibility_confidence": 0.4,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_0_domain_credibility_credibility_value": 0.6800000000000002,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_0_domain_credibility_credibility_source": "domain",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_0_domain_credibility_credibility_domainreviewed": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_0_domain_credibility_itemreviewed": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_0_similarity_credibility_value": 0.6800000000000002,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_0_similarity_credibility_confidence": 0.3290314064517207,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_0_similarity_credibility_explanation": "Claim is similar to:\n\n * Another option that the government should consider is the renting of prison places in other countries.\nthat was published in a site (www.expressen.se) that is reliable. ",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_1_sentence": "For a long time, I have proposed a series of measures that could allow for such a point marking of gang criminals - including on-call courts, abolition of criminal discounts, reduced detentions, reduced criminal penalties and more.",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_1_domain": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_1_similarity": 0.8202213900262623,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_1_doc_url": "https://www.expressen.se/ledare/anna-dahlberg/for-latt-att-vara-kriminell-i-sverige/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_1_coinform_collection": "pilot-se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_1_lang_orig": "en",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_1_published_date": "2019-03-29T14:29:03.937Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_1_claimspot_score": 0.6782031149945023,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_1_domain_credibility_credibility_confidence": 0.4,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_1_domain_credibility_credibility_value": 0.6800000000000002,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_1_domain_credibility_credibility_source": "domain",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_1_domain_credibility_credibility_domainreviewed": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_1_domain_credibility_itemreviewed": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_1_similarity_credibility_value": 0.6800000000000002,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_1_similarity_credibility_confidence": 0.3280885560105049,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_related_claims_credible_pub_sentences_1_similarity_credibility_explanation": "Claim is similar to:\n\n * For a long time, I have proposed a series of measures that could allow for such a point marking of gang criminals - including on-call courts, abolition of criminal discounts, reduced detentions, reduced criminal penalties and more.\nthat was published in a site (www.expressen.se) that is reliable. ",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_credibility_value": 0.5,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_credibility_confidence": 0.8922634947180543,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_credibility_explanation": "Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be accurate. Based on textual claim-review rating 'largely accurate'",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_2_credibility_source": "credibility of related claims (3)",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_claim": "They are yours for trials.\"",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreviewed": "\"A lot of people are being saved\" under the Right to Try Act, which was enacted last year to provide faster access to unapproved medications still in development. ",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_similarity": 0.7836633632928991,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_fact_checker": "https://www.factcheck.org/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_published_date": "2019-09-11T00:00:00Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_url": "https://www.factcheck.org/2019/09/is-right-to-try-saving-a-lot-of-people/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_altname": "Unsupported",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_@context": "http://schema.org",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_@type": "ClaimReview",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_author_@type": "Organization",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_author_image": "https://d10r9aj6omusou.cloudfront.net/factstream-logo-image-d669a00c-15d4-409e-811c-e82135db8000.png",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_author_name": "FactCheck.org",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_author_url": "https://www.factcheck.org/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_claimreviewed": "\"A lot of people are being saved\" under the Right to Try Act, which was enacted last year to provide faster access to unapproved medications still in development. ",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_itemreviewed_@type": "Claim",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_itemreviewed_author_@type": "Person",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_itemreviewed_author_image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBdVNXIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--d2502bafc91405a2badbf1b7d895e7abcb0b32bd/https-3A-2F-2Fcdn.factcheck.org-2FUploadedFiles-2FTrump-new-widget.png?disposition=attachment",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_itemreviewed_author_jobtitle": "President of the United States",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_itemreviewed_author_name": "Donald Trump",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_itemreviewed_datepublished": "2019-09-11",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_itemreviewed_firstappearance_@type": "CreativeWork",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_itemreviewed_firstappearance_url": "https://www.whitehouse.gov/briefings-statements/remarks-president-trump-meeting-e-cigarettes/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_itemreviewed_name": "White House",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_reviewrating_@type": "Rating",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_reviewrating_alternatename": "Unsupported",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_reviewrating_bestrating": "10",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_reviewrating_image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBdVdXIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--3783103d3173fc34b9500238e1060e2d60898238/https-3A-2F-2Fdhpikd1t89arn.cloudfront.net-2Frating_images-2Ffactcheck.org-2Funsupported.png?disposition=attachment",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_reviewrating_ratingvalue": "0",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_reviewrating_worstrating": "0",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_sdpublisher_@type": "Organization",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_sdpublisher_name": "Google Fact Check Tools API",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_sdpublisher_url": "https://g.co/factchecktools",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_url": "https://www.factcheck.org/2019/09/is-right-to-try-saving-a-lot-of-people/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_domain": "www.factcheck.org",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_domain_credibility_credibility_confidence": 0.8233333333333334,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_domain_credibility_credibility_value": 0.9695546558704454,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_domain_credibility_credibility_source": "domain",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_domain_credibility_credibility_domainreviewed": "www.factcheck.org",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_domain_credibility_itemreviewed": "www.factcheck.org",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_credibility_rating_value": -1.0,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_credibility_rating_confidence": 0.85,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_credibility_rating_explanation": "Based on normalised numeric ratingValue 0.0 in range [0.0-10.0]",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_claimreview_credibility_rating_source": "claimReview",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_similarity_credibility_value": -1.0,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_similarity_credibility_confidence": 0.6661138587989642,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_similarity_credibility_explanation": "Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be inaccurate. Based on normalised numeric ratingValue 0.0 in range [0.0-10.0]",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_0_similarity_credibility_source": "credibility of related claims (4)",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreviewed": "Says under the Democratic impeachment inquiry, Republicans get \"more rights than we ever received in any of the other impeachment proceedings.\" ",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_similarity": 0.7672799649350067,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_fact_checker": "https://www.politifact.com/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_published_date": "2019-10-31T00:00:00Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_url": "https://www.politifact.com/truth-o-meter/statements/2019/nov/04/nancy-pelosi/nancy-pelosi-overstates-republican-gains-impeachme/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_altname": "Mostly False",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_@context": "http://schema.org",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_@type": "ClaimReview",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_author_@type": "Organization",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_author_image": "https://d10r9aj6omusou.cloudfront.net/factstream-logo-image-61554e34-b525-4723-b7ae-d1860eaa2296.png",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_author_name": "PolitiFact",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_author_url": "https://www.politifact.com/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_claimreviewed": "Says under the Democratic impeachment inquiry, Republicans get \"more rights than we ever received in any of the other impeachment proceedings.\" ",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_itemreviewed_@type": "Claim",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_itemreviewed_author_@type": "Person",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_itemreviewed_author_image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBbEdaIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--f2648674feea555b5395679d7f9392f5ddab946e/https-3A-2F-2Fstatic.politifact.com-2Fmugs-2Fmug-nancypelosi.jpg?disposition=attachment",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_itemreviewed_author_jobtitle": "Speaker of the U.S. House of Representatives",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_itemreviewed_author_name": "Nancy Pelosi",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_itemreviewed_datepublished": "2019-10-31",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_itemreviewed_firstappearance_@type": "CreativeWork",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_itemreviewed_firstappearance_url": "https://www.yahoo.com/entertainment/nancy-pelosi-on-republican-opposition-to-impeachment-i-cannot-be-held-up-by-that-074847242.html",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_itemreviewed_name": "In an interview with \"Late Show\" host Stephen Colbert.",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_reviewrating_@type": "Rating",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_reviewrating_alternatename": "Mostly False",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_reviewrating_bestrating": "9",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_reviewrating_image": "https://www.factstream.co/rails/active_storage/blobs/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBbEtaIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--587124a440ad936e1f9ca1d7fc2bd34e41cca773/https-3A-2F-2Fdhpikd1t89arn.cloudfront.net-2Frating_images-2Fpolitifact-2Ftom-mostlyfalse.jpg?disposition=attachment",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_reviewrating_ratingvalue": "3",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_reviewrating_worstrating": "0",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_sdpublisher_@type": "Organization",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_sdpublisher_name": "Google Fact Check Tools API",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_sdpublisher_url": "https://g.co/factchecktools",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_url": "https://www.politifact.com/truth-o-meter/statements/2019/nov/04/nancy-pelosi/nancy-pelosi-overstates-republican-gains-impeachme/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_domain": "www.politifact.com",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_domain_credibility_credibility_confidence": 0.8233333333333334,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_domain_credibility_credibility_value": 0.9695546558704454,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_domain_credibility_credibility_source": "domain",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_domain_credibility_credibility_domainreviewed": "www.politifact.com",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_domain_credibility_itemreviewed": "www.politifact.com",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_credibility_rating_value": -0.33333333333333337,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_credibility_rating_confidence": 0.85,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_credibility_rating_explanation": "Based on normalised numeric ratingValue 3.0 in range [0.0-9.0]",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_claimreview_credibility_rating_source": "claimReview",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_similarity_credibility_value": -0.33333333333333337,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_similarity_credibility_confidence": 0.6521879701947557,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_reviewed_claims_1_similarity_credibility_explanation": "Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be inaccurate with considerations. Based on normalised numeric ratingValue 3.0 in range [0.0-9.0]",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_credible_pub_sentences_0_sentence": "At the same time, however, registration can be seen as a quality mark when, as breeders within SKK, you must comply with both the basic rules, the statutes and the various health programs, Mr. Rosenberg.",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_credible_pub_sentences_0_domain": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_credible_pub_sentences_0_similarity": 0.7665341436072484,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_credible_pub_sentences_0_doc_url": "https://www.expressen.se/leva-och-bo/husdjur/sugen-pa-att-starta-en-kennel-sa-gor-du/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_credible_pub_sentences_0_coinform_collection": "pilot-se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_credible_pub_sentences_0_lang_orig": "en",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_credible_pub_sentences_0_published_date": "2019-03-29T15:17:22.557Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_credible_pub_sentences_0_claimspot_score": 0.3012149572132797,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_credible_pub_sentences_0_domain_credibility_credibility_confidence": 0.4,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_credible_pub_sentences_0_domain_credibility_credibility_value": 0.6800000000000002,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_credible_pub_sentences_0_domain_credibility_credibility_source": "domain",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_credible_pub_sentences_0_domain_credibility_credibility_domainreviewed": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_credible_pub_sentences_0_domain_credibility_itemreviewed": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_credible_pub_sentences_0_similarity_credibility_value": 0.6800000000000002,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_credible_pub_sentences_0_similarity_credibility_confidence": 0.30661365744289937,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_credible_pub_sentences_0_similarity_credibility_explanation": "Claim is similar to:\n\n * At the same time, however, registration can be seen as a quality mark when, as breeders within SKK, you must comply with both the basic rules, the statutes and the various health programs, Mr. Rosenberg.\nthat was published in a site (www.expressen.se) that is reliable. ",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_non_credible_pub_sentences_0_sentence": "«stranded assets» from the market, enabling them to be",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_non_credible_pub_sentences_0_domain": "paris2050.elioth.com",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_non_credible_pub_sentences_0_similarity": 0.7681563868691467,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_non_credible_pub_sentences_0_doc_url": "http://paris2050.elioth.com/pdf/170615%20-%20Paris%20Carbone%20Neutral%20-%20report_LD.pdf",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_non_credible_pub_sentences_0_coinform_collection": "fc-dev",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_non_credible_pub_sentences_0_lang_orig": "en",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_non_credible_pub_sentences_0_published_date": "2017-12-13T17:49:39Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_non_credible_pub_sentences_0_claimspot_score": 0.3021416302924611,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_non_credible_pub_sentences_0_domain_credibility_credibility_confidence": 0.03,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_non_credible_pub_sentences_0_domain_credibility_credibility_value": 0.22000000000000003,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_non_credible_pub_sentences_0_domain_credibility_credibility_source": "domain",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_non_credible_pub_sentences_0_domain_credibility_credibility_domainreviewed": "paris2050.elioth.com",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_non_credible_pub_sentences_0_domain_credibility_itemreviewed": "paris2050.elioth.com",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_non_credible_pub_sentences_0_similarity_credibility_value": 0.22000000000000003,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_non_credible_pub_sentences_0_similarity_credibility_confidence": 0.023044691606074398,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_related_claims_non_credible_pub_sentences_0_similarity_credibility_explanation": "Claim is similar to:\n\n * «stranded assets» from the market, enabling them to be\nthat was published in a site (paris2050.elioth.com) that is mostly reliable. ",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_credibility_value": -1.0,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_credibility_confidence": 0.6661138587989642,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_credibility_explanation": "Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be inaccurate. Based on normalised numeric ratingValue 0.0 in range [0.0-10.0]",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_3_credibility_source": "credibility of related claims (4)",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_claim": "They.....",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_0_sentence": "The deception was made so that the sample writers were helped by the sample through minimal audiences.",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_0_domain": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_0_similarity": 0.8368234193835938,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_0_doc_url": "https://www.expressen.se/kvallsposten/elever-fuskade-sig-in-pa-universitet-stangs-av-/",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_0_coinform_collection": "pilot-se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_0_lang_orig": "en",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_0_published_date": "2019-03-29T15:09:48.142Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_0_claimspot_score": 0.2902550488637586,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_0_domain_credibility_credibility_confidence": 0.4,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_0_domain_credibility_credibility_value": 0.6800000000000002,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_0_domain_credibility_credibility_source": "domain",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_0_domain_credibility_credibility_domainreviewed": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_0_domain_credibility_itemreviewed": "www.expressen.se",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_0_similarity_credibility_value": 0.6800000000000002,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_0_similarity_credibility_confidence": 0.33472936775343753,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_0_similarity_credibility_explanation": "Claim is similar to:\n\n * The deception was made so that the sample writers were helped by the sample through minimal audiences.\nthat was published in a site (www.expressen.se) that is reliable. ",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_1_sentence": "Five-year-olds, however, already dominate, dominate the ability of deception, and trickle out.",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_1_domain": "www.zdf.de",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_1_similarity": 0.8356164848366407,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_1_doc_url": "https://www.zdf.de/wissen/leschs-kosmos/ungelogen-die-wahrheit-hinter-der-luege-100.html",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_1_coinform_collection": "pilot-at",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_1_lang_orig": "en",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_1_published_date": "2019-03-18T16:15:26.443Z",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_1_claimspot_score": 0.2794755403660334,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_1_domain_credibility_credibility_confidence": 0.8666666666666667,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_1_domain_credibility_credibility_value": 0.9723076923076923,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_1_domain_credibility_credibility_source": "domain",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_1_domain_credibility_credibility_domainreviewed": "www.zdf.de",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_1_domain_credibility_itemreviewed": "www.zdf.de",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_1_similarity_credibility_value": 0.9723076923076923,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_1_similarity_credibility_confidence": 0.7242009535250886,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_1_similarity_credibility_explanation": "Claim is similar to:\n\n * Five-year-olds, however, already dominate, dominate the ability of deception, and trickle out.\nthat was published in a site (www.zdf.de) that is reliable. ",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_related_claims_credible_pub_sentences_1_similarity_credibility_source": "credibility of related claims (2)",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_credibility_value": 0.9723076923076923,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_credibility_confidence": 0.7242009535250886,
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_credibility_explanation": "Claim is similar to:\n\n * Five-year-olds, however, already dominate, dominate the ability of deception, and trickle out.\nthat was published in a site (www.zdf.de) that is reliable. ",
         "claimcredibility_tweet_claim_credibility_0_sentences_in_tweet_4_credibility_source": "credibility of related claims (2)",
         "claimcredibility_tweet_claim_credibility_0_credibility": 0.5,
         "claimcredibility_tweet_claim_credibility_0_confidence": 0.8581984794037281,
         "claimcredibility_tweet_claim_credibility_0_credibility_label": "credible",
         "claimcredibility_tweet_claim_credibility_0_explanation": "Sentence in tweet: Claim is similar to:\n\n * missing sentence\nthat was fact-checked and found to be accurate. Based on textual claim-review rating 'largely accurate'"
       }
     }

The FE uses this to show a label not credible' for the tweet. The user clicks on a button to **agree** with this credibility assessment, which triggers the FE to call the proposed [twitter/evaluate/label`](https://co-inform.github.io/gateway-api/#/to%20be%20developed/post_twitter_evaluate_label) endpoint.

Desired outcome

The GW should issue the following call to content collector api, corresponding to the data the user entered.

The GW calls the /user/accuracy-review with a POST and the following content object

{
  "context": "http://schema.org",
  "type": "CoinformUserReview",
  "author": {
    "context": "http://coinform.eu",
    "type": "CoinformUser",
    "url": "http://coinform.eu/users/cf40ced2-7cc8-98a3-1fb0-02c96d781626",
    "identifier": "cf40ced2-7cc8-98a3-1fb0-02c96d781626"
  },
  "name": "accurate",
  "reviewAspect": "accuracy",
  "reviewRating": {
    "context": "http://coinform.eu",
    "type": "CoinformAccuracyRating",
    "ratingValue": "accurate",
    "reviewAspect": "accuracy"
  },
  "itemReviewed": {
    "context": "http://coinform.eu",
    "type": "CredibilityReview",
    "url": "https://api.coinform.eu/response/251b6a72cd3a3af314baf748abdfac93c076e54272dabcaef5b7b115eb65c848/x",
     "name": "not credible",
     "itemReviewed": {
         "context": "http://coinform.eu",
         "type": "Tweet",
         "url": "https://twitter.com/realDonaldTrump/status/1181172459325800448",
         "identifier": "1181172459325800448"
     },
    "identifier": "251b6a72cd3a3af314baf748abdfac93c076e54272dabcaef5b7b115eb65c848"
  }
}

Variant

Note that if the user disagrees the only changes from the case described above is that:

Note

The content collector (CC) will specify an enum for credibility values. It'd be nice to align this with the GW and FE, otherwise the GW will have to map between FE and CC enums.

Issue

When the user clicks on the submit button, the FE calls the /twitter/evaluate/label via POST. Please verify that the data submitted by the FE is sufficient to allow the GW implementation to convert it to the format required by the content collector.

Important Consideration

In order for the rating to be useful, we need to know what the label is that we showed to the user, as well as the tweet for which we generated the label.

Via the itemReviewed.url, the content collector may try to reconstruct the data that was sent to the FE. However, this is dangerous, since the response may have changed as new results become available. Therefore, it may be better to, besides sending the itemReviewed.url and itemReviewed.identifier, also forward the full ModuleResponse that was sent to the FE. I'd introduce property itemReviewed.moduleResponse for this. This requres the FE to keep it and send it along with the rating. The main advantage of having this data is that we should be able to see whether some partial responses perform better than others.

aleixac commented 4 years ago

I have my thoughts against trying to store so much metadata in the users FE, that will heavily impact the performance of the plugin (both in terms of memory and communications times). Take in mind that the actual performance is already not the ideal, although better that in the beginning. Would it not be enough to post the actual final credibility label that is shown to the user. At least for the first versions I would minimize both the received and posted data from the FE plugin side.

aleixac commented 4 years ago

The content collector (CC) will specify an enum for credibility values. It'd be nice to align this with the GW and FE, otherwise the GW will have to map between FE and CC enums.

The user accuracy labels (NOT credibility labels) Enum used in FE is: [ accurate, accurate_with_considerations, unsubstantiated, inaccurate_with_considerations, inaccurate ]

But I do not understand why this is important in this endpoint, as for the first version I understood that the FE should just post the agree/disagree user accuracy values.

Also, as I understand, the value of reviewRating.ratingValue would map:

rdenaux commented 4 years ago

I have my thoughts against trying to store so much metadata in the users FE, that will heavily impact the performance of the plugin (both in terms of memory and communications times).

I agree, which means it may be a good idea for the GW to send you an (uu)id for each label returned. The FE can then send the user rating along with the id. The GW can either:

aleixac commented 4 years ago

If you think that sending the full ModuleResponse, within the user accuracy rating, is necessary to analyze the situation, we can study that options you exposed, but I want to insist that maybe, for a first approach at least, it would be enough to send the final_credibility label that is shown to the user. Then something like this would be ¿enough?:

{
  "tweet_id": "string",
  "actual_credibility": "not_credible"
  "reaction": "agree"
}

That would simplify the situation and at the same time would let us achieve this consideration you made:

In order for the rating to be useful, we need to know what the label is that we showed to the user, as well as the tweet for which we generated the label.

Generate temporary id's will add more complexity that for the moment maybe is not that necessary.

rdenaux commented 4 years ago

OK with this as a useful (this should cover 80% of our needs for this type of user rating) temporary solution.

However, since we already need to adapt the API (and since the GW already is generating some form of ids: query_ids) I'd suggest including this in the current set of changes so we can add support for the full traceability later on without having to change the FE. So the new request body would look something like:

{
  "tweet_id": "string",
  "rated_credibility": "not_credible",
  "rated_moduleResponse": "943082ac-7ff8-5668-babe-4f23fe482b5c",
  "reaction": "agree"
}
aleixac commented 4 years ago

Ok. I understand that this rated_moduleResponse value would be the query_id response parameter from the endpoint /twitter/tweet. I am not storing it right now but that seems quite easy to maintain.

rdenaux commented 4 years ago

query_id is an option, but I think it would be better if we had unique identifier for ModuleResponses sent to users. This is because a single query_id can map to several ModuleResponse versions as modules complete their analysis, so the final credibility label may change.

Also, hopefully we (will) have some cache in place, so that several users requesting analysis of the same tweet receive the same response object instead of sending each tweet for analysis several times. Don't know enough about the GW implementation to know whether the query_id is appropriate or a new id is needed.

andreasjberg commented 4 years ago

Firstly we're a bit unsure how rated_moduleResponse is supposed to be used. The module responses are only cached for 24h in the database cache, and the response is updated after each module sends its response (if a module would send multiple responses for a single query only the first received is handled). The gateway has no way of determining whether the browser used the latest version of moduleResponse. This makes the rated_moduleResponse hard to use for any purpose by itself.

If we do need a saved instance of a specific moduleResponse there is currently nothing in place to handle such a feature. Is the GW really the right place to set up such a database? Since I don't think this information is ever used by the FE or GW, would it not be better to store it in the same database as the reviews?

From an evaluation body like:

{
  "tweet_id": "string",
  "rated_credibility": "not_credible",
  "rated_moduleResponse": "943082ac-7ff8-5668-babe-4f23fe482b5c",
  "reaction": "agree"
}

the gateway would be able to attach the contents of the cache for the response to the reports with two edge cases where the cache contents are different from the FE version.

  1. More modules have responded since the FE version.
  2. 24h have passed since the original query (probably made by a different user) to the GW and the query has been deleted during the time between the FE query and evaluation.

For case 1: if the FE attaches the module_labels field from the query you see what module responses were processed in the assessment, and other modules responses can be disregarded. Case 2. This seems like a quite unlikely scenario and the only mitigations for it I can think of are quite costly, in performance or development time. For the moment it might be acceptable to ignore.

Secondly in the author field, I'm wondering about the url field. Do we really want to publish any information about our users publicly? Do we really need an url at all, is it not enough with an identifier?

rdenaux commented 4 years ago

Hi, I think both edge cases for sending the moduleResponse are reasonable. The backend can ignore it if not available or if it doesn't match the rated_credibility.

Sure, the user's url is optional/private. If we ever want to show a user profile, we could add it with the appropriate authorization rules.

daffyDukk commented 4 years ago

@rdenaux if I understand this correctly now. Below is sent to the GW by the BP when a logged in user has reviewed a CoInform System rating

{
  "tweet_id": "string",
  "rated_credibility": "not_credible",
  "rated_moduleResponse": "943082ac-7ff8-5668-babe-4f23fe482b5c",
  "reaction": "agree"
}

tweet_id == id of the tweet rated_credibility == final_credibility? (what our systems sends to the BP) rated_moduleResponse == query_id? (if not, what is it?) reaction == the BP users reaction to the CoInform system rated_credibility

Upon receiving this the GW builds a request as below:

{
  "context": "http://schema.org",
  "type": "CoinformUserReview",
  "author": {
    "context": "http://coinform.eu",
    "type": "CoinformUser",
    "url": "http://coinform.eu/users/cf40ced2-7cc8-98a3-1fb0-02c96d781626",
    "identifier": "cf40ced2-7cc8-98a3-1fb0-02c96d781626"
  },
  "name": "accurate",
  "reviewAspect": "accuracy",
  "reviewRating": {
    "context": "http://coinform.eu",
    "type": "CoinformAccuracyRating",
    "ratingValue": "accurate",
    "reviewAspect": "accuracy"
  },
  "itemReviewed": {
    "context": "http://coinform.eu",
    "type": "CredibilityReview",
    "url": "https://api.coinform.eu/response/251b6a72cd3a3af314baf748abdfac93c076e54272dabcaef5b7b115eb65c848/x",
     "name": "not credible",
     "itemReviewed": {
         "context": "http://coinform.eu",
         "type": "Tweet",
         "url": "https://twitter.com/realDonaldTrump/status/1181172459325800448",
         "identifier": "1181172459325800448"
     },
    "identifier": "251b6a72cd3a3af314baf748abdfac93c076e54272dabcaef5b7b115eb65c848"
  }
}

and passes it on to the relevant backend (in this case the content-collector-api) as you mentioned above.

rdenaux commented 4 years ago

That's right.

rated_moduleResponse == query_id? (if not, what is it?)

This is mainly for the GW to retrieve/reconstruct the CredibilityReview that was sent to the user, if possible. So, if the query_id is sufficient you can use that. I think, if you use that as the CredibilityReview.identifier the CC can request the response from the GW and store more information in the DB (again, if still available) as this may be useful for figuring out which of the submodules needs to be improved.

daffyDukk commented 4 years ago

OK. I'm pretty much done with the basic impl of this. Will do a bit of testing etc on this tomorrow and then try to deploy after lunch. Only thing I have not implemented of the JSON schema above is url for user and url for itemReviewed since the GW do not get this sent to it at the moment. If this is imperative have we can include it in a future deploy. @rdenaux

rdenaux commented 4 years ago

url for user is no big issue since we haven't agreed on a route for this anyway. The same is true for URLs for the CredibilityReview. However, it would be good to have a URL for the tweet, if possible.

daffyDukk commented 4 years ago

then my suggestion is the BP passes the url along with initial request to the GW @aleixac

aleixac commented 4 years ago

Right now the BP does not parse/store the tweet URL, but it should not be a problem to find it for every tweet and pass it to the GW for some endpoints. Just as a note here, the tweet URL format is: "https://twitter.com/{USER_SCREEN_NAME}/status/{TWEET_ID}"

daffyDukk commented 4 years ago

yepp. at the moment it is only the /twitter/evaluate/label endpoint that requires it as I understand