search

lewisdonovan / google-news-scraper

Lightweight scraper for Google News
Other
242 stars 62 forks source link

Faster - PrettyURL #42

Closed anthonyfranc closed 9 months ago

anthonyfranc commented 9 months ago

I've worked up an enhancement to increase the speed of the final URL. The final URL is already hard coded into the news.google.com link. It appears its some sort of base64 decoding. 

function decodeBase64FromUrl(url) {
  const base64Pattern = /articles\/([A-Za-z0-9+_\-\/=]+)/;
  const match = url.match(base64Pattern);

  if (match && match[1]) {
    const base64EncodedUrl = match[1].replace(/-/g, "+").replace(/_/g, "/");
    try {
      let decodedUrl = Buffer.from(base64EncodedUrl, "base64").toString(
        "ascii",
      );
      const parts = decodedUrl.split(/[^\x20-\x7E]+/).filter(Boolean);
      const urlPattern = /(https?:\/\/[^\s]+)/;

      for (let part of parts) {
        const urlMatch = part.match(urlPattern);
        if (urlMatch && urlMatch[1]) {
          // Return the object containing both urlID and finalURL
          return {
            urlID: match[1],
            finalURL: urlMatch[1].replace(/R$/, ""),
          };
        }
      }

      console.error("No valid URL found in the decoded string:", decodedUrl);
    } catch (error) {
      console.error(
        "Error decoding Base64 string:",
        base64EncodedUrl,
        "Original URL:",
        url,
        "Error:",
        error.message,
      );
    }
  } else {
    console.error("No Base64 segment found in the URL. Original URL:", url);
  }

  // Return null or an empty object if no data could be extracted
  return null; // or return {};
}

The part of the URL that has the final URL encoded is here:

/rss/articles/CBMihgFodHRwczovL3d3dy50cmFkaW5ndmlldy5jb20vbmV3cy9iaXRjb2luX2NvbTo0YTZiYjZlM2YwOTRiOjAtdGV4YXMtZWxlY3RyaWMtdXRpbGl0eS1jb3VydHMtdW5uYW1lZC1jcnlwdG8tbWluZXJzLXdpdGgtZml2ZS15ZWFyLWRlYWxzL9IBAA?oc=5,

however this has some non-ASCII characters that dont follow normal base64 encoded measures, so I made some modifications to only allow http/https in the front, remove the trailing "R" that always appears and any non-ASCII characters at the end. and to only keep the first occurrence I noticed sometimes it would repeat due to possible non-ASCII characters, etc. 

{
  "originalUrl": "https://news.google.com/rss/articles/CBMidmh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS90ZWNoLzIwMjQvMDIvMTMvbGVkZ2VyLWNvaW5iYXNlLXBheS1pbnRlZ3JhdGUtdG8tZ2l2ZS11c2Vycy1kaXJlY3QtYWNjZXNzLXRvLWJ1eS1zZWxsLWNyeXB0by_SAXpodHRwczovL3d3dy5jb2luZGVzay5jb20vdGVjaC8yMDI0LzAyLzEzL2xlZGdlci1jb2luYmFzZS1wYXktaW50ZWdyYXRlLXRvLWdpdmUtdXNlcnMtZGlyZWN0LWFjY2Vzcy10by1idXktc2VsbC1jcnlwdG8vYW1wLw?oc=5",
  "cleanedUrl": "https://www.coindesk.com/tech/2024/02/13/ledger-coinbase-pay-integrate-to-give-users-direct-access-to-buy-sell-crypto/zhttps://www.coindesk.com/tech/2024/02/13/ledger-coinbase-pay-integrate-to-give-users-direct-access-to-buy-sell-crypto/amp/"
}

Base64 Decode Sample: "�https://www.tradingview.com/news/bitcoin_com:4a6bb6e3f094b:0-texas-electric-utility-courts-unnamed-crypto-miners-with-five-year-deals/�

Example

{
  "originalUrl": "https://news.google.com/rss/articles/CBMihgFodHRwczovL3d3dy50cmFkaW5ndmlldy5jb20vbmV3cy9iaXRjb2luX2NvbTo0YTZiYjZlM2YwOTRiOjAtdGV4YXMtZWxlY3RyaWMtdXRpbGl0eS1jb3VydHMtdW5uYW1lZC1jcnlwdG8tbWluZXJzLXdpdGgtZml2ZS15ZWFyLWRlYWxzL9IBAA?oc=5",
  "cleanedUrl": "https://www.tradingview.com/news/bitcoin_com:4a6bb6e3f094b:0-texas-electric-utility-courts-unnamed-crypto-miners-with-five-year-deals/"
}

This will drastically speed up the prettyURL and it won't require the use of puppeteer to do so.

This full output completed in 2.4 seconds.

{
  "originalUrl": "https://news.google.com/rss/articles/CBMiWGh0dHBzOi8vY29pbnRlbGVncmFwaC5jb20vbmV3cy9jdXJiLXlvdXItZW50aHVzaWFzbS1jcnlwdG8tcHJpY2VzLW1vdmUtcXVpY2tseS15b3UtdGhpbmvSAQA?oc=5",
  "cleanedUrl": "https://cointelegraph.com/news/curb-your-enthusiasm-crypto-prices-move-quickly-you-think"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiRWh0dHBzOi8vZm9yZWlnbnBvbGljeS5jb20vMjAyNC8wMi8xOC9jcnlwdG8tZnR4LWJpdGNvaW4tYnViYmxlLWZyYXVkL9IBAA?oc=5",
  "cleanedUrl": "https://foreignpolicy.com/2024/02/18/crypto-ftx-bitcoin-bubble-fraud/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiRmh0dHBzOi8vZmluYW5jZS55YWhvby5jb20vbmV3cy9hbmdyaWVzdC1pdmUtZXZlci0yNC1vbGQtMTIxMzAwNTU2Lmh0bWzSAQA?oc=5",
  "cleanedUrl": "https://finance.yahoo.com/news/angriest-ive-ever-24-old-121300556.html"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMifmh0dHBzOi8vd3d3LmJsb29tYmVyZy5jb20vbmV3cy9hcnRpY2xlcy8yMDI0LTAyLTE1L2FzLWJpdGNvaW4tcmFsbGllcy1iYW5rcy1wdXNoLXNlYy10by1jaGFuZ2UtYW4tYWNjb3VudGluZy1ndWlkZWxpbmUtc2FiLTEyMdIBAA?oc=5",
  "cleanedUrl": "https://www.bloomberg.com/news/articles/2024-02-15/as-bitcoin-rallies-banks-push-sec-to-change-an-accounting-guideline-sab-121"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMijAFodHRwczovL3d3dy5jb2luZGVzay5jb20vYnVzaW5lc3MvMjAyNC8wMi8xNi9jcnlwdG8tdHJhZGVycy1zZWUtMjAtY2hhbmNlLW9mLWJpdGNvaW4tdG9wcGluZy03MGstYnktYXByaWwtZW5kLWRlZmktb3B0aW9ucy1tYXJrZXRwbGFjZS1seXJhL9IBkAFodHRwczovL3d3dy5jb2luZGVzay5jb20vYnVzaW5lc3MvMjAyNC8wMi8xNi9jcnlwdG8tdHJhZGVycy1zZWUtMjAtY2hhbmNlLW9mLWJpdGNvaW4tdG9wcGluZy03MGstYnktYXByaWwtZW5kLWRlZmktb3B0aW9ucy1tYXJrZXRwbGFjZS1seXJhL2FtcC8?oc=5",
  "cleanedUrl": "https://www.coindesk.com/business/2024/02/16/crypto-traders-see-20-chance-of-bitcoin-topping-70k-by-april-end-defi-options-marketplace-lyra/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMigAFodHRwczovL3d3dy5jbmJjLmNvbS92aWRlby8yMDI0LzAyLzE2L2NvaW5iYXNlLXNoYXJlcy1wb3AtYWZ0ZXItcG9zdGluZy1maXJzdC1xdWFydGVybHktcHJvZml0LXNpbmNlLTIwMjEtY25iYy1jcnlwdG8td29ybGQuaHRtbNIBAA?oc=5",
  "cleanedUrl": "https://www.cnbc.com/video/2024/02/16/coinbase-shares-pop-after-posting-first-quarterly-profit-since-2021-cnbc-crypto-world.html"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiOWh0dHBzOi8vZGVjcnlwdC5jby8yMTc5MjAvY2hpbmEtY3J5cHRvLXllYXItb2YtdGhlLWRyYWdvbtIBP2h0dHBzOi8vZGVjcnlwdC5jby8yMTc5MjAvY2hpbmEtY3J5cHRvLXllYXItb2YtdGhlLWRyYWdvbj9hbXA9MQ?oc=5",
  "cleanedUrl": "https://decrypt.co/217920/china-crypto-year-of-the-dragon"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiQWh0dHBzOi8vY3J5cHRvc2xhdGUuY29tL2hvdy10aGUtdXMtdGhyZWF0ZW5zLWNyeXB0b3MtY29yZS12YWx1ZXMv0gEA?oc=5",
  "cleanedUrl": "https://cryptoslate.com/how-the-us-threatens-cryptos-core-values/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiYWh0dHBzOi8vd3d3LmZveGJ1c2luZXNzLmNvbS9wb2xpdGljcy90cmVhc3VyeS1kZWFscy1ibG93LXRvLWVsaXphYmV0aC13YXJyZW5zLWFudGktY3J5cHRvLWNydXNhZGXSAWVodHRwczovL3d3dy5mb3hidXNpbmVzcy5jb20vcG9saXRpY3MvdHJlYXN1cnktZGVhbHMtYmxvdy10by1lbGl6YWJldGgtd2FycmVucy1hbnRpLWNyeXB0by1jcnVzYWRlLmFtcA?oc=5",
  "cleanedUrl": "https://www.foxbusiness.com/politics/treasury-deals-blow-to-elizabeth-warrens-anti-crypto-crusade"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMikQFodHRwczovL2RhaWx5aG9kbC5jb20vMjAyNC8wMi8xOC9jcnlwdG8tYW5hbHlzdC13YXJucy1iaXRjb2luLXJlbWFpbnMtdnVsbmVyYWJsZS1hYm92ZS01MDAwMC1zYXlzLXplcm8tcmVhc29ucy10by1iZS1idWxsaXNoLW9uLW9uZS1kZWZpLWFsdGNvaW4v0gEA?oc=5",
  "cleanedUrl": "https://dailyhodl.com/2024/02/18/crypto-analyst-warns-bitcoin-remains-vulnerable-above-50000-says-zero-reasons-to-be-bullish-on-one-defi-altcoin/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiV2h0dHBzOi8vd3d3LmZvcmJlcy5jb20vYWR2aXNvci9pbi9pbnZlc3RpbmcvY3J5cHRvY3VycmVuY3kvYmVzdC1jcnlwdG8tZm9yLWRheS10cmFkaW5nL9IBAA?oc=5",
  "cleanedUrl": "https://www.forbes.com/advisor/in/investing/cryptocurrency/best-crypto-for-day-trading/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMidWh0dHBzOi8vd3d3LmJsb29tYmVyZy5jb20vbmV3cy9hcnRpY2xlcy8yMDI0LTAyLTE4L21vbS1hbmQtcG9wLWludmVzdG9ycy1hcmUtc3RhcnRpbmctdG8tdGlwLXRvZS1iYWNrLWludG8tY3J5cHRvLWJ0Y9IBAA?oc=5",
  "cleanedUrl": "https://www.bloomberg.com/news/articles/2024-02-18/mom-and-pop-investors-are-starting-to-tip-toe-back-into-crypto-btc"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiXGh0dHBzOi8vY3J5cHRvLm5ld3MvYnVsbHMtcHJvZml0LWFzLWJpdGNvaW4taGl0cy01MGstd2hpbGUtY2FyZGFuby13aGFsZXMtZXllLW5ldy1tZW1lLWNvaW4v0gEA?oc=5",
  "cleanedUrl": "https://crypto.news/bulls-profit-as-bitcoin-hits-50k-while-cardano-whales-eye-new-meme-coin/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiV2h0dHBzOi8vY29pbnRlbGVncmFwaC5jb20vbmV3cy92Yy1ibG9ja2NoYWluLWFuZC1jcnlwdG8tZnVuZGluZy1yaXNlcy1pbi1xNC0yMDIzLXJlcG9ydNIBAA?oc=5",
  "cleanedUrl": "https://cointelegraph.com/news/vc-blockchain-and-crypto-funding-rises-in-q4-2023-report"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiamh0dHBzOi8vd3d3LnJldXRlcnMuY29tL3RlY2hub2xvZ3kvZ2VuZXNpcy1nZXRzLWNvdXJ0LWFwcHJvdmFsLXNlbGwtMTYtYmxuLWNyeXB0by10cnVzdC1zaGFyZXMtMjAyNC0wMi0xNC_SAQA?oc=5",
  "cleanedUrl": "https://www.reuters.com/technology/genesis-gets-court-approval-sell-16-bln-crypto-trust-shares-2024-02-14/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiRmh0dHBzOi8vd3d3LmF4aW9zLmNvbS8yMDI0LzAyLzE0L2JpdGNvaW5zLW1hcmtldC1jYXAtY3J5cHRvLTEtdHJpbGxpb27SAQA?oc=5",
  "cleanedUrl": "https://www.axios.com/2024/02/14/bitcoins-market-cap-crypto-1-trillion"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiTGh0dHBzOi8vZGFpbHljb2luLmNvbS9hZGFzLTE0LXN1cmdlLWxlYWRzLXRoZS13YXktYXMtY3J5cHRvLW1hcmtldC1jbGltYnMtNy_SAQA?oc=5",
  "cleanedUrl": "https://dailycoin.com/adas-14-surge-leads-the-way-as-crypto-market-climbs-7/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMia2h0dHBzOi8vd3d3LmNuYmMuY29tLzIwMjQvMDIvMTUvY3J5cHRvLXZjLWZ1bmRpbmctY2xpbWJzLWZvci1maXJzdC10aW1lLWluLTIteWVhcnMtYWZ0ZXItYml0Y29pbi1yYWxseS5odG1s0gFvaHR0cHM6Ly93d3cuY25iYy5jb20vYW1wLzIwMjQvMDIvMTUvY3J5cHRvLXZjLWZ1bmRpbmctY2xpbWJzLWZvci1maXJzdC10aW1lLWluLTIteWVhcnMtYWZ0ZXItYml0Y29pbi1yYWxseS5odG1s?oc=5",
  "cleanedUrl": "https://www.cnbc.com/2024/02/15/crypto-vc-funding-climbs-for-first-time-in-2-years-after-bitcoin-rally.html"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiYGh0dHBzOi8vY29pbnRlbGVncmFwaC5jb20vbmV3cy9nZW5lc2lzLWJhbmtydXB0Y3ktZ2J0Yy1vdXRmbG93cy1iaXRjb2luLWNvaW5iYXNlLWNyeXB0by1leGNoYW5nZdIBAA?oc=5",
  "cleanedUrl": "https://cointelegraph.com/news/genesis-bankruptcy-gbtc-outflows-bitcoin-coinbase-crypto-exchange"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiSWh0dHBzOi8vY3J5cHRvLm5ld3MvZ25vc2lzLXVudmVpbHMtc2VsZi1jdXN0b2R5LWNhcmQtZm9yLWNyeXB0by1zaG9wcGluZy_SAQA?oc=5",
  "cleanedUrl": "https://crypto.news/gnosis-unveils-self-custody-card-for-crypto-shopping/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMibWh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS9idXNpbmVzcy8yMDI0LzAyLzE2L3Jldm9sdXQtdG8taW50cm9kdWNlLWNyeXB0by1leGNoYW5nZS10YXJnZXRpbmctYWR2YW5jZWQtdHJhZGVycy_SAXFodHRwczovL3d3dy5jb2luZGVzay5jb20vYnVzaW5lc3MvMjAyNC8wMi8xNi9yZXZvbHV0LXRvLWludHJvZHVjZS1jcnlwdG8tZXhjaGFuZ2UtdGFyZ2V0aW5nLWFkdmFuY2VkLXRyYWRlcnMvYW1wLw?oc=5",
  "cleanedUrl": "https://www.coindesk.com/business/2024/02/16/revolut-to-introduce-crypto-exchange-targeting-advanced-traders/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMimwFodHRwczovL3d3dy5mb3JiZXMuY29tL3NpdGVzL2RpZ2l0YWwtYXNzZXRzLzIwMjQvMDIvMTcvanBtb3JnYW4tanVzdC1tYWRlLWEtc2hvY2tpbmctY3J5cHRvLWZsaXAtYWZ0ZXItbWFzc2l2ZS1iaXRjb2luLWV0aGVyZXVtLXhycC1hbmQtY3J5cHRvLXByaWNlLXJhbGx5L9IBnwFodHRwczovL3d3dy5mb3JiZXMuY29tL3NpdGVzL2RpZ2l0YWwtYXNzZXRzLzIwMjQvMDIvMTcvanBtb3JnYW4tanVzdC1tYWRlLWEtc2hvY2tpbmctY3J5cHRvLWZsaXAtYWZ0ZXItbWFzc2l2ZS1iaXRjb2luLWV0aGVyZXVtLXhycC1hbmQtY3J5cHRvLXByaWNlLXJhbGx5L2FtcC8?oc=5",
  "cleanedUrl": "https://www.forbes.com/sites/digital-assets/2024/02/17/jpmorgan-just-made-a-shocking-crypto-flip-after-massive-bitcoin-ethereum-xrp-and-crypto-price-rally/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiXmh0dHBzOi8vd3d3LnJldXRlcnMuY29tL3RlY2hub2xvZ3kvY29pbmJhc2Utc3dpbmdzLXByb2ZpdC1pbnRlcmVzdC1pbmNvbWUtc3RyZW5ndGgtMjAyNC0wMi0xNS_SAQA?oc=5",
  "cleanedUrl": "https://www.reuters.com/technology/coinbase-swings-profit-interest-income-strength-2024-02-15/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiVWh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS90ZWNoLzIwMjQvMDIvMTcvcHJvdG9jb2wtbGF0ZXN0LXRlY2gtbmV3cy1jcnlwdG8tYmxvY2tjaGFpbi_SAVlodHRwczovL3d3dy5jb2luZGVzay5jb20vdGVjaC8yMDI0LzAyLzE3L3Byb3RvY29sLWxhdGVzdC10ZWNoLW5ld3MtY3J5cHRvLWJsb2NrY2hhaW4vYW1wLw?oc=5",
  "cleanedUrl": "https://www.coindesk.com/tech/2024/02/17/protocol-latest-tech-news-crypto-blockchain/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiPmh0dHBzOi8vd3d3LmNoYWluYWx5c2lzLmNvbS9ibG9nLzIwMjQtY3J5cHRvLW1vbmV5LWxhdW5kZXJpbmcv0gEA?oc=5",
  "cleanedUrl": "https://www.chainalysis.com/blog/2024-crypto-money-laundering/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMibWh0dHBzOi8vd3d3LnRoZWJsb2NrLmNvL3Bvc3QvMjc3OTEyL2NlbHNpdXMtZGlzdHJpYnV0ZWQtMi1iaWxsaW9uLW9mLWNyeXB0by10by1jcmVkaXRvcnMtY291cnQtZG9jdW1lbnQtc2hvd3PSAXFodHRwczovL3d3dy50aGVibG9jay5jby9hbXAvcG9zdC8yNzc5MTIvY2Vsc2l1cy1kaXN0cmlidXRlZC0yLWJpbGxpb24tb2YtY3J5cHRvLXRvLWNyZWRpdG9ycy1jb3VydC1kb2N1bWVudC1zaG93cw?oc=5",
  "cleanedUrl": "https://www.theblock.co/post/277912/celsius-distributed-2-billion-of-crypto-to-creditors-court-document-shows"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiYWh0dHBzOi8vd3d3LnJldXRlcnMuY29tL3RlY2hub2xvZ3kvaG9uZHVyYXMtd2F0Y2hkb2ctYmFucy1pbnN0aXR1dGlvbnMtdHJhZGluZy1jcnlwdG8tMjAyNC0wMi0xNi_SAQA?oc=5",
  "cleanedUrl": "https://www.reuters.com/technology/honduras-watchdog-bans-institutions-trading-crypto-2024-02-16/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiUmh0dHBzOi8vY3J5cHRvLm5ld3Mvc3BvdC1iaXRjb2luLWV0ZnMtYXJlLWhlcmUtd2hhdHMtbmV4dC1yZWd1bGF0aW5nLWRlZmktb3Bpbmlvbi_SAQA?oc=5",
  "cleanedUrl": "https://crypto.news/spot-bitcoin-etfs-are-here-whats-next-regulating-defi-opinion/R"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiY2h0dHBzOi8vY3J5cHRvLm5ld3MvZXRoZXJldW0tYW5kLWJpbmFuY2UtY29pbi1nYWlucy1mbG93LWludG8tZGVlc3RyZWFtLWFzLWxlYXAteWVhci1ib29zdHMtY3J5cHRvL9IBAA?oc=5",
  "cleanedUrl": "https://crypto.news/ethereum-and-binance-coin-gains-flow-into-deestream-as-leap-year-boosts-crypto/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiVmh0dHBzOi8vZmluYW5jZS55YWhvby5jb20vbmV3cy93YXJyZW4tYnVmZmV0dC13YXJtaW5nLWJpdGNvaW4tYmVya3NoaXJlLTIxMzAxMDg3NC5odG1s0gEA?oc=5",
  "cleanedUrl": "https://finance.yahoo.com/news/warren-buffett-warming-bitcoin-berkshire-213010874.html"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiWmh0dHBzOi8vd3d3LnVzYXRvZGF5LmNvbS9tb25leS9ibHVlcHJpbnQvaW52ZXN0aW5nL2NyeXB0b2N1cnJlbmN5L3RvcC0xMC1jcnlwdG9jdXJyZW5jaWVzL9IBAA?oc=5",
  "cleanedUrl": "https://www.usatoday.com/money/blueprint/investing/cryptocurrency/top-10-cryptocurrencies/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMinQFodHRwczovL3d3dy5mb3JiZXMuY29tL3NpdGVzL2RpZ2l0YWwtYXNzZXRzLzIwMjQvMDIvMTgvZmFjZS1yaXBwaW5nLXJhbGx5LWluY29taW5nLXdoeS10aGUtYml0Y29pbi1ldGhlcmV1bS1hbmQteHJwLXByaWNlLWJvb20tY291bGQtYmUtanVzdC1nZXR0aW5nLXN0YXJ0ZWQv0gGhAWh0dHBzOi8vd3d3LmZvcmJlcy5jb20vc2l0ZXMvZGlnaXRhbC1hc3NldHMvMjAyNC8wMi8xOC9mYWNlLXJpcHBpbmctcmFsbHktaW5jb21pbmctd2h5LXRoZS1iaXRjb2luLWV0aGVyZXVtLWFuZC14cnAtcHJpY2UtYm9vbS1jb3VsZC1iZS1qdXN0LWdldHRpbmctc3RhcnRlZC9hbXAv?oc=5",
  "cleanedUrl": "https://www.forbes.com/sites/digital-assets/2024/02/18/face-ripping-rally-incoming-why-the-bitcoin-ethereum-and-xrp-price-boom-could-be-just-getting-started/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiSGh0dHBzOi8vY3J5cHRvLm5ld3Mvcm9iZXJ0LWtpeW9zYWtpLXByZWRpY3RzLW1vcmUtZ2FpbnMtZm9yLWJpdGNvaW4tYnRjL9IBAA?oc=5",
  "cleanedUrl": "https://crypto.news/robert-kiyosaki-predicts-more-gains-for-bitcoin-btc/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiSGh0dHBzOi8vZmluYW5jZS55YWhvby5jb20vbmV3cy81LWNyeXB0by1zdG9ja3MtcmlkaW5nLWhvdC0xNDQ0MDA0OTEuaHRtbNIBAA?oc=5",
  "cleanedUrl": "https://finance.yahoo.com/news/5-crypto-stocks-riding-hot-144400491.html"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMigAFodHRwczovL3d3dy5jb2luZGVzay5jb20vYnVzaW5lc3MvMjAyNC8wMi8xNC9jcnlwdG8tc3RvY2tzLWFkdmFuY2UtcHJlLW1hcmtldC1hcy1iaXRjb2luLXRvcHMtNTFrLW1hcmtldC1jYXAtaGl0cy0yNi1tb250aC1oaWdoL9IBhAFodHRwczovL3d3dy5jb2luZGVzay5jb20vYnVzaW5lc3MvMjAyNC8wMi8xNC9jcnlwdG8tc3RvY2tzLWFkdmFuY2UtcHJlLW1hcmtldC1hcy1iaXRjb2luLXRvcHMtNTFrLW1hcmtldC1jYXAtaGl0cy0yNi1tb250aC1oaWdoL2FtcC8?oc=5",
  "cleanedUrl": "https://www.coindesk.com/business/2024/02/14/crypto-stocks-advance-pre-market-as-bitcoin-tops-51k-market-cap-hits-26-month-high/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiR2h0dHBzOi8vY29pbmdhcGUuY29tL2NyeXB0by1zY2FtLWNvaW4tbWl4ZXItZml4ZmxvYXQtZmFjZXMtMjZtLWV4cGxvaXQv0gFLaHR0cHM6Ly9jb2luZ2FwZS5jb20vY3J5cHRvLXNjYW0tY29pbi1taXhlci1maXhmbG9hdC1mYWNlcy0yNm0tZXhwbG9pdC9hbXAv?oc=5",
  "cleanedUrl": "https://coingape.com/crypto-scam-coin-mixer-fixfloat-faces-26m-exploit/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiSGh0dHBzOi8vY3J5cHRvLm5ld3MvYmluYW5jZS11bmRlci1maXJlLXByb3NlY3V0b3JzLWV5ZS01LXllYXItb3ZlcnNpZ2h0L9IBAA?oc=5",
  "cleanedUrl": "https://crypto.news/binance-under-fire-prosecutors-eye-5-year-oversight/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiemh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS9wb2xpY3kvMjAyNC8wMi8xNC91cy10cmVhc3VyeS1iYWNrcy1kb3duLW5hcnJhdGl2ZS10aGF0LWhhbWFzLXJlbGllZC1vbi1jcnlwdG8tdG8tZnVuZC10ZXJyb3Jpc20v0gF-aHR0cHM6Ly93d3cuY29pbmRlc2suY29tL3BvbGljeS8yMDI0LzAyLzE0L3VzLXRyZWFzdXJ5LWJhY2tzLWRvd24tbmFycmF0aXZlLXRoYXQtaGFtYXMtcmVsaWVkLW9uLWNyeXB0by10by1mdW5kLXRlcnJvcmlzbS9hbXAv?oc=5",
  "cleanedUrl": "https://www.coindesk.com/policy/2024/02/14/us-treasury-backs-down-narrative-that-hamas-relied-on-crypto-to-fund-terrorism/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiUmh0dHBzOi8vZmluYW5jZS55YWhvby5jb20vbmV3cy9jb2luYmFzZXMtanVtcC1oaWdobGlnaHRzLWNyeXB0by1ldGYtMjI0NTAwODE5Lmh0bWzSAQA?oc=5",
  "cleanedUrl": "https://finance.yahoo.com/news/coinbases-jump-highlights-crypto-etf-224500819.htmlR"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiOWh0dHBzOi8vYmVpbmNyeXB0by5jb20vbWlsbGlvbnMtbGlxdWlkYXRlZC1jcnlwdG8tbWFya2V0L9IBAA?oc=5",
  "cleanedUrl": "https://beincrypto.com/millions-liquidated-crypto-market/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMilwFodHRwczovL2RhdmlkZ2VyYXJkLmNvLnVrL2Jsb2NrY2hhaW4vMjAyNC8wMi8xOC9mb3JlaWduLXBvbGljeS10aGUtY3J5cHRvLWNvbi15ZWFycy1hcmVudC1vdmVyLXlldC1yZXZpZXdzLW9mLW1pY2hhZWwtbGV3aXMtemVrZS1mYXV4LWFuZC1wZXRlci1ob3dzb24v0gEA?oc=5",
  "cleanedUrl": "https://davidgerard.co.uk/blockchain/2024/02/18/foreign-policy-the-crypto-con-years-arent-over-yet-reviews-of-michael-lewis-zeke-faux-and-peter-howson/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiW2h0dHBzOi8vd3d3LnBvbGl0aWNvLmNvbS9uZXdzLzIwMjQvMDIvMTQvY3J5cHRvLWF0dG9ybmV5LXdlaWdocy1jaGFsbGVuZ2luZy13YXJyZW4tMDAxNDE1ODXSAQA?oc=5",
  "cleanedUrl": "https://www.politico.com/news/2024/02/14/crypto-attorney-weighs-challenging-warren-00141585"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMid2h0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS9idXNpbmVzcy8yMDI0LzAyLzE2L2V0aGVyLWJhc2VkLWNyeXB0by1kb2xsYXItaXNzdWVyLWV0aGVuYS1yYWlzZXMtMTRtLW9wZW5zLWFjY2Vzcy10by1wdWJsaWMv0gF7aHR0cHM6Ly93d3cuY29pbmRlc2suY29tL2J1c2luZXNzLzIwMjQvMDIvMTYvZXRoZXItYmFzZWQtY3J5cHRvLWRvbGxhci1pc3N1ZXItZXRoZW5hLXJhaXNlcy0xNG0tb3BlbnMtYWNjZXNzLXRvLXB1YmxpYy9hbXAv?oc=5",
  "cleanedUrl": "https://www.coindesk.com/business/2024/02/16/ether-based-crypto-dollar-issuer-ethena-raises-14m-opens-access-to-public/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiZ2h0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS90ZWNoLzIwMjQvMDIvMTUvY3J5cHRvLW1vbmV5LWxhdW5kZXJpbmctZHJvcHBlZC0zMC1sYXN0LXllYXItY2hhaW5hbHlzaXMtc2F5cy_SAWtodHRwczovL3d3dy5jb2luZGVzay5jb20vdGVjaC8yMDI0LzAyLzE1L2NyeXB0by1tb25leS1sYXVuZGVyaW5nLWRyb3BwZWQtMzAtbGFzdC15ZWFyLWNoYWluYWx5c2lzLXNheXMvYW1wLw?oc=5",
  "cleanedUrl": "https://www.coindesk.com/tech/2024/02/15/crypto-money-laundering-dropped-30-last-year-chainalysis-says/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMicWh0dHBzOi8vY3J5cHRvcG90YXRvLmNvbS9zb3V0aC1rb3JlYW4tY3J5cHRvLWV4Y2hhbmdlcy1yZXBvcnQtbmVhcmx5LTUwLXN1cmdlLWluLXN1c3BpY2lvdXMtdHJhbnNhY3Rpb25zLWluLTIwMjMv0gF1aHR0cHM6Ly9jcnlwdG9wb3RhdG8uY29tL3NvdXRoLWtvcmVhbi1jcnlwdG8tZXhjaGFuZ2VzLXJlcG9ydC1uZWFybHktNTAtc3VyZ2UtaW4tc3VzcGljaW91cy10cmFuc2FjdGlvbnMtaW4tMjAyMy8_YW1w?oc=5",
  "cleanedUrl": "https://cryptopotato.com/south-korean-crypto-exchanges-report-nearly-50-surge-in-suspicious-transactions-in-2023/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiRmh0dHBzOi8vY3J5cHRvLm5ld3MvZG9nZS1zaGliLWFuZC1wZXBlLWhvbGRlcnMtZmxvY2stdG8tcHVzaGQtcHJlc2FsZS_SAQA?oc=5",
  "cleanedUrl": "https://crypto.news/doge-shib-and-pepe-holders-flock-to-pushd-presale/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiWmh0dHBzOi8vZm9ydHVuZS5jb20vY3J5cHRvLzIwMjQvMDIvMTYvY29pbmJhc2UtcTQtcmVwb3J0cy1wcm9maXQtYW5kLXRyYW5zYWN0aW9ucy11cHN3aW5nL9IBXmh0dHBzOi8vZm9ydHVuZS5jb20vY3J5cHRvLzIwMjQvMDIvMTYvY29pbmJhc2UtcTQtcmVwb3J0cy1wcm9maXQtYW5kLXRyYW5zYWN0aW9ucy11cHN3aW5nL2FtcC8?oc=5",
  "cleanedUrl": "https://fortune.com/crypto/2024/02/16/coinbase-q4-reports-profit-and-transactions-upswing/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMidWh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS9idXNpbmVzcy8yMDI0LzAyLzE2L2Fzc2V0LW1hbmFnZXItanVwaXRlcnMtY3J5cHRvLWludmVzdG1lbnQtc2NyYXBwZWQtYnktY29tcGxpYW5jZS10ZWFtLWZ0L9IBeWh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS9idXNpbmVzcy8yMDI0LzAyLzE2L2Fzc2V0LW1hbmFnZXItanVwaXRlcnMtY3J5cHRvLWludmVzdG1lbnQtc2NyYXBwZWQtYnktY29tcGxpYW5jZS10ZWFtLWZ0L2FtcC8?oc=5",
  "cleanedUrl": "https://www.coindesk.com/business/2024/02/16/asset-manager-jupiters-crypto-investment-scrapped-by-compliance-team-ft/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiM2h0dHBzOi8vYmVpbmNyeXB0by5jb20vaG9uZHVyYXMtY3J5cHRvLXRyYWRpbmctYmFuL9IBAA?oc=5",
  "cleanedUrl": "https://beincrypto.com/honduras-crypto-trading-ban/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiTmh0dHBzOi8vYmxvZy5rcmFrZW4uY29tL25ld3MvaW5kdXN0cnktbmV3cy91LXMtY3J5cHRvLXRheGVzLWluLTIwMjQtZmFzdC1mYWN0c9IBAA?oc=5",
  "cleanedUrl": "https://blog.kraken.com/news/industry-news/u-s-crypto-taxes-in-2024-fast-facts"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiSWh0dHBzOi8vZmluYW5jZS55YWhvby5jb20vbmV3cy81LWNyeXB0by1jZW50cmljLXN0b2Nrcy1idXktMTMyMTAwNjM1Lmh0bWzSAQA?oc=5",
  "cleanedUrl": "https://finance.yahoo.com/news/5-crypto-centric-stocks-buy-132100635.html"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiggFodHRwczovL3d3dy5jb2luZGVzay5jb20vYnVzaW5lc3MvMjAyNC8wMi8xNC9jcnlwdG8tY3VzdG9kaWFuLXRhdXJ1cy1lbmxpc3RzLWxpZG8tdG8tYnJpbmctbGlxdWlkLWV0aGVyZXVtLXN0YWtpbmctdG8tc3dpc3MtYmFua3Mv0gGGAWh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS9idXNpbmVzcy8yMDI0LzAyLzE0L2NyeXB0by1jdXN0b2RpYW4tdGF1cnVzLWVubGlzdHMtbGlkby10by1icmluZy1saXF1aWQtZXRoZXJldW0tc3Rha2luZy10by1zd2lzcy1iYW5rcy9hbXAv?oc=5",
  "cleanedUrl": "https://www.coindesk.com/business/2024/02/14/crypto-custodian-taurus-enlists-lido-to-bring-liquid-ethereum-staking-to-swiss-banks/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMicmh0dHBzOi8vY3J5cHRvcG90YXRvLmNvbS9hbmdlbC1kcmFpbmVyLXN0cmlrZXMtYWdhaW4tNDAwMDAwLXN0b2xlbi1mcm9tLTEyOC1jcnlwdG8td2FsbGV0cy13aXRoLW5ldy1hdHRhY2stdmVjdG9yL9IBdmh0dHBzOi8vY3J5cHRvcG90YXRvLmNvbS9hbmdlbC1kcmFpbmVyLXN0cmlrZXMtYWdhaW4tNDAwMDAwLXN0b2xlbi1mcm9tLTEyOC1jcnlwdG8td2FsbGV0cy13aXRoLW5ldy1hdHRhY2stdmVjdG9yLz9hbXA?oc=5",
  "cleanedUrl": "https://cryptopotato.com/angel-drainer-strikes-again-400000-stolen-from-128-crypto-wallets-with-new-attack-vector/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiTmh0dHBzOi8vY3J5cHRvLm5ld3MvYW5hbHlzdHMtcHJlZGljdC10aGlzLW5ldy1hbHRjb2luLWNvdWxkLWdyb3ctc2FtZS1hcy1ib25rL9IBAA?oc=5",
  "cleanedUrl": "https://crypto.news/analysts-predict-this-new-altcoin-could-grow-same-as-bonk/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiH2h0dHBzOi8vYW1iY3J5cHRvLmNvbS8_cD0zNzA4MzXSAVhodHRwczovL2FtYmNyeXB0by5jb20vY3J5cHRvLW1hcmtldHMtd2Vla2x5LXdpbm5lcnMtYW5kLWxvc2Vycy13bGQtYmdiLWJvbmstYW5kLXRpYS9hbXAv?oc=5",
  "cleanedUrl": "https://ambcrypto.com/?p=370835"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiXmh0dHBzOi8vZm9ydHVuZS5jb20vY3J5cHRvLzIwMjQvMDIvMTUvcnczLXZlbnR1cmVzLW11YmFkYWxhLXJhcHRvci12Yy1jcnlwdG8tYmxvY2tjaGFpbi1iaXRnby_SAWJodHRwczovL2ZvcnR1bmUuY29tL2NyeXB0by8yMDI0LzAyLzE1L3J3My12ZW50dXJlcy1tdWJhZGFsYS1yYXB0b3ItdmMtY3J5cHRvLWJsb2NrY2hhaW4tYml0Z28vYW1wLw?oc=5",
  "cleanedUrl": "https://fortune.com/crypto/2024/02/15/rw3-ventures-mubadala-raptor-vc-crypto-blockchain-bitgo/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiZmh0dHBzOi8vd3d3LmZvcmJlcy5jb20vc2l0ZXMvamF2aWVycGF6LzIwMjQvMDIvMTMvdGhlLWZ1dHVyZS1vZi1jcnlwdG8tYW5kLWJsb2NrY2hhaW4tZmludGVjaC01MC0yMDI0L9IBAA?oc=5",
  "cleanedUrl": "https://www.forbes.com/sites/javierpaz/2024/02/13/the-future-of-crypto-and-blockchain-fintech-50-2024/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiaWh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS9wb2xpY3kvMjAyNC8wMi8xNC9pbmRvbmVzaWEtcGlja3MtY3J5cHRvLWZyaWVuZGx5LXRlYW0taW4tcHJlc2lkZW50aWFsLWVsZWN0aW9uL9IBbWh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS9wb2xpY3kvMjAyNC8wMi8xNC9pbmRvbmVzaWEtcGlja3MtY3J5cHRvLWZyaWVuZGx5LXRlYW0taW4tcHJlc2lkZW50aWFsLWVsZWN0aW9uL2FtcC8?oc=5",
  "cleanedUrl": "https://www.coindesk.com/policy/2024/02/14/indonesia-picks-crypto-friendly-team-in-presidential-election/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMidmh0dHBzOi8vd3d3LmNuYmMuY29tL3ZpZGVvLzIwMjQvMDIvMTQvYml0Y29pbi1icmllZmx5LWNyb3NzZXMtNTIwMDAtcmVjYXB0dXJlcy0xLXRyaWxsaW9uLW1hcmtldC1jYXAtY3J5cHRvLXdvcmxkLmh0bWzSAQA?oc=5",
  "cleanedUrl": "https://www.cnbc.com/video/2024/02/14/bitcoin-briefly-crosses-52000-recaptures-1-trillion-market-cap-crypto-world.html"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMicmh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS90ZWNoLzIwMjQvMDIvMTUvYXBwbGUtdmlzaW9uLXByb3MtYXJlLXByYWN0aWNhbGx5LWRyZXNzLWNvZGUtYXQtdGhpcy1jcnlwdG8taGFja2VyLWhvdXNlL9IBdmh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS90ZWNoLzIwMjQvMDIvMTUvYXBwbGUtdmlzaW9uLXByb3MtYXJlLXByYWN0aWNhbGx5LWRyZXNzLWNvZGUtYXQtdGhpcy1jcnlwdG8taGFja2VyLWhvdXNlL2FtcC8?oc=5",
  "cleanedUrl": "https://www.coindesk.com/tech/2024/02/15/apple-vision-pros-are-practically-dress-code-at-this-crypto-hacker-house/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiQmh0dHBzOi8vYmxvY2t3b3Jrcy5jby9uZXdzL2ZpbmNlbi1oZWFyaW5nLWNyeXB0by1pbGxlZ2FsLWZpbmFuY2luZ9IBAA?oc=5",
  "cleanedUrl": "https://blockworks.co/news/fincen-hearing-crypto-illegal-financing"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiYGh0dHBzOi8vd3d3LnB5bW50cy5jb20vZWFybmluZ3MvMjAyNC9zdGFibGVjb2lucy11bnN0YWJsZS1jcnlwdG8tbWFya2V0LXByb3BlbC1jb2luYmFzZS1wcm9maXRzL9IBAA?oc=5",
  "cleanedUrl": "https://www.pymnts.com/earnings/2024/stablecoins-unstable-crypto-market-propel-coinbase-profits/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiZGh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS9jb25zZW5zdXMtbWFnYXppbmUvMjAyNC8wMi8xMy9jcnlwdG8taGFzLWFuLXVucmVhbGl6ZWQtb3Bwb3J0dW5pdHktaW4tYXNpYS_SAWhodHRwczovL3d3dy5jb2luZGVzay5jb20vY29uc2Vuc3VzLW1hZ2F6aW5lLzIwMjQvMDIvMTMvY3J5cHRvLWhhcy1hbi11bnJlYWxpemVkLW9wcG9ydHVuaXR5LWluLWFzaWEvYW1wLw?oc=5",
  "cleanedUrl": "https://www.coindesk.com/consensus-magazine/2024/02/13/crypto-has-an-unrealized-opportunity-in-asia/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiggFodHRwczovL3d3dy5jb2luZGVzay5jb20vY29uc2Vuc3VzLW1hZ2F6aW5lLzIwMjQvMDIvMTQvY3J5cHRvLWZlYXItZ3JlZWQtaW5kZXgtaGl0cy1oaWdoZXN0LWxldmVsLXNpbmNlLWJpdGNvaW5zLTIwMjEtcmVjb3JkLWhpZ2gv0gGGAWh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS9jb25zZW5zdXMtbWFnYXppbmUvMjAyNC8wMi8xNC9jcnlwdG8tZmVhci1ncmVlZC1pbmRleC1oaXRzLWhpZ2hlc3QtbGV2ZWwtc2luY2UtYml0Y29pbnMtMjAyMS1yZWNvcmQtaGlnaC9hbXAv?oc=5",
  "cleanedUrl": "https://www.coindesk.com/consensus-magazine/2024/02/14/crypto-fear-greed-index-hits-highest-level-since-bitcoins-2021-record-high/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMihAFodHRwczovL3d3dy5jb2luZGVzay5jb20vbWFya2V0cy8yMDI0LzAyLzE2L2NvaW5iYXNlLWFuYWx5c3RzLXR1cm4tbW9yZS1idWxsaXNoLW9uLWNyeXB0by1leGNoYW5nZS1hZnRlci1lYXJuaW5ncy1iZWF0LXNoYXJlcy1jbGltYi_SAYgBaHR0cHM6Ly93d3cuY29pbmRlc2suY29tL21hcmtldHMvMjAyNC8wMi8xNi9jb2luYmFzZS1hbmFseXN0cy10dXJuLW1vcmUtYnVsbGlzaC1vbi1jcnlwdG8tZXhjaGFuZ2UtYWZ0ZXItZWFybmluZ3MtYmVhdC1zaGFyZXMtY2xpbWIvYW1wLw?oc=5",
  "cleanedUrl": "https://www.coindesk.com/markets/2024/02/16/coinbase-analysts-turn-more-bullish-on-crypto-exchange-after-earnings-beat-shares-climb/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMicmh0dHBzOi8vd3d3LmJsb29tYmVyZy5jb20vbmV3cy9hcnRpY2xlcy8yMDI0LTAyLTE1L2ZlZC1zLXdhbGxlci1zYXlzLWRvbGxhci10by13aXRoc3RhbmQtdGhyZWF0cy1mcm9tLWNoaW5hLWNyeXB0b9IBAA?oc=5",
  "cleanedUrl": "https://www.bloomberg.com/news/articles/2024-02-15/fed-s-waller-says-dollar-to-withstand-threats-from-china-crypto"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMifGh0dHBzOi8vd3d3LnJldXRlcnMuY29tL3RlY2hub2xvZ3kvcGV0ZXItdGhpZWxzLWZvdW5kZXJzLWZ1bmQtbWFkZS0yMDAtbWlsbGlvbi1jcnlwdG8taW52ZXN0bWVudC1iZWZvcmUtYnVsbC1ydW4tMjAyNC0wMi0xMy_SAQA?oc=5",
  "cleanedUrl": "https://www.reuters.com/technology/peter-thiels-founders-fund-made-200-million-crypto-investment-before-bull-run-2024-02-13/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiY2h0dHBzOi8vY3J5cHRvLm5ld3MvbXVzaWMtaW5kdXN0cnktZXllcy1kZWVzdHJlYW0tcHJlc2FsZS1hZnRlci1ldGhlcmV1bS1hbmQtYXZhbGFuY2hlLXdoYWxlcy1qb2luL9IBAA?oc=5",
  "cleanedUrl": "https://crypto.news/music-industry-eyes-deestream-presale-after-ethereum-and-avalanche-whales-join/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMicGh0dHBzOi8vd3d3LmJsb29tYmVyZy5jb20vbmV3cy9hcnRpY2xlcy8yMDI0LTAyLTE1L2NvaW5iYXNlLXJldHVybnMtdG8tcHJvZml0YWJpbGl0eS1hZnRlci1jcnlwdG8tbWFya2V0LXJlYm91bmTSAQA?oc=5",
  "cleanedUrl": "https://www.bloomberg.com/news/articles/2024-02-15/coinbase-returns-to-profitability-after-crypto-market-rebound"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMifWh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS9wb2xpY3kvMjAyNC8wMi8xNC91cGNvbWluZy1oaWdoLWxldmVsLWV1LWZpbmFuY2lhbC1wb2xpY3ktdGFsa3MtY291bGQtc3RlZXItY3J5cHRvLW92ZXJzaWdodC1zb3VyY2Uv0gGBAWh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS9wb2xpY3kvMjAyNC8wMi8xNC91cGNvbWluZy1oaWdoLWxldmVsLWV1LWZpbmFuY2lhbC1wb2xpY3ktdGFsa3MtY291bGQtc3RlZXItY3J5cHRvLW92ZXJzaWdodC1zb3VyY2UvYW1wLw?oc=5",
  "cleanedUrl": "https://www.coindesk.com/policy/2024/02/14/upcoming-high-level-eu-financial-policy-talks-could-steer-crypto-oversight-source/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiaGh0dHBzOi8vd3d3LmJsb29tYmVyZy5jb20vbmV3cy9hcnRpY2xlcy8yMDI0LTAyLTE2L3Nwb3QtYml0Y29pbi1ldGYtd2h5LWFwcHJvdmFsLWJ5LXRoZS1zZWMtdG9vay1zby1sb25n0gEA?oc=5",
  "cleanedUrl": "https://www.bloomberg.com/news/articles/2024-02-16/spot-bitcoin-etf-why-approval-by-the-sec-took-so-long"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMidmh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS9idXNpbmVzcy8yMDI0LzAyLzEzL3JvYmluaG9vZHMtaGlnaGVyLWNyeXB0by1yZXZlbnVlLWNvdWxkLWJlLXBvc2l0aXZlLWZvci1jb2luYmFzZS1lYXJuaW5ncy_SAXpodHRwczovL3d3dy5jb2luZGVzay5jb20vYnVzaW5lc3MvMjAyNC8wMi8xMy9yb2Jpbmhvb2RzLWhpZ2hlci1jcnlwdG8tcmV2ZW51ZS1jb3VsZC1iZS1wb3NpdGl2ZS1mb3ItY29pbmJhc2UtZWFybmluZ3MvYW1wLw?oc=5",
  "cleanedUrl": "https://www.coindesk.com/business/2024/02/13/robinhoods-higher-crypto-revenue-could-be-positive-for-coinbase-earnings/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiOmh0dHBzOi8vYmxvY2t3b3Jrcy5jby9uZXdzL2NyeXB0by1maXJtcy1zZWVraW5nLWRldmVsb3BlcnPSAQA?oc=5",
  "cleanedUrl": "https://blockworks.co/news/crypto-firms-seeking-developers"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMia2h0dHBzOi8vd3d3LmZveGJ1c2luZXNzLmNvbS9tYXJrZXRzL2NyeXB0by13b3JsZC13YWxsLXN0cmVldC1hd2FpdC1wb3RlbnRpYWwtc3ByaW5nLWFwcHJvdmFsLXNwb3QtZXRoZXItZXRm0gFvaHR0cHM6Ly93d3cuZm94YnVzaW5lc3MuY29tL21hcmtldHMvY3J5cHRvLXdvcmxkLXdhbGwtc3RyZWV0LWF3YWl0LXBvdGVudGlhbC1zcHJpbmctYXBwcm92YWwtc3BvdC1ldGhlci1ldGYuYW1w?oc=5",
  "cleanedUrl": "https://www.foxbusiness.com/markets/crypto-world-wall-street-await-potential-spring-approval-spot-ether-etf"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiUWh0dHBzOi8vd3d3LnRoZWJsb2NrLmNvL3Bvc3QvMjc3NDI2L2phcGFuLWZzYS11bmxhd2Z1bC1tb25leS10cmFuc2ZlcnMtY3J5cHRvLXAycNIBVWh0dHBzOi8vd3d3LnRoZWJsb2NrLmNvL2FtcC9wb3N0LzI3NzQyNi9qYXBhbi1mc2EtdW5sYXdmdWwtbW9uZXktdHJhbnNmZXJzLWNyeXB0by1wMnA?oc=5",
  "cleanedUrl": "https://www.theblock.co/post/277426/japan-fsa-unlawful-money-transfers-crypto-p2p"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMijgFodHRwczovL2RhaWx5aG9kbC5jb20vMjAyNC8wMi8xOC9hbmFseXN0LXNheXMtbmV4dC1sZWctdXAtaW5jb21pbmctZm9yLXR3by1sb3ctY2FwLWFsdGNvaW5zLXVwZGF0ZXMtb3V0bG9vay1vbi1yZWNlbnRseS1sYXVuY2hlZC1jcnlwdG8tYXNzZXQv0gEA?oc=5",
  "cleanedUrl": "https://dailyhodl.com/2024/02/18/analyst-says-next-leg-up-incoming-for-two-low-cap-altcoins-updates-outlook-on-recently-launched-crypto-asset/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiOGh0dHBzOi8vcGl0Y2hib29rLmNvbS9uZXdzL3JlcG9ydHMvcTQtMjAyMy1jcnlwdG8tcmVwb3J00gEA?oc=5",
  "cleanedUrl": "https://pitchbook.com/news/reports/q4-2023-crypto-report"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiYGh0dHBzOi8vY3J5cHRvLm5ld3MvbWljcm9zdHJhdGVneXMtYml0Y29pbi1zdWNjZXNzLXNwYXJrcy1zcGVjdWxhdGlvbi1vbi1wb3RlbnRpYWwtc3AtNTAwLWVudHJ5L9IBAA?oc=5",
  "cleanedUrl": "https://crypto.news/microstrategys-bitcoin-success-sparks-speculation-on-potential-sp-500-entry/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiTWh0dHBzOi8vZmluYW5jZS55YWhvby5jb20vbmV3cy9jcnlwdG8tbWFya2V0LXZhbHVlLWNsaW1icy1iYWNrLTAyMTQyMzcxNC5odG1s0gEA?oc=5",
  "cleanedUrl": "https://finance.yahoo.com/news/crypto-market-value-climbs-back-021423714.html"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiQGh0dHBzOi8vYmxvY2t3b3Jrcy5jby9uZXdzL2NyeXB0by1idXJnZXItcmVzdGF1cmFudC1mYWQtYWRvcHRpb27SAQA?oc=5",
  "cleanedUrl": "https://blockworks.co/news/crypto-burger-restaurant-fad-adoption"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiW2h0dHBzOi8vY3J5cHRvLm5ld3Mvc3BvdC1iaXRjb2luLWV0Zi10YWtlcy1jZW50ZXItc3RhZ2UtYnV0LXdoYXQtcmVhbGx5LWxpZXMtYWhlYWQtb3Bpbmlvbi_SAQA?oc=5",
  "cleanedUrl": "https://crypto.news/spot-bitcoin-etf-takes-center-stage-but-what-really-lies-ahead-opinion/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiW2h0dHBzOi8vY3J5cHRvYnJpZWZpbmcuY29tL3NvbGFuYS10YXBzLWZpbGVjb2luLWVuaGFuY2VkLWRlY2VudHJhbGl6ZWQtZGF0YS1zdG9yYWdlLWFjY2Vzcy_SAQA?oc=5",
  "cleanedUrl": "https://cryptobriefing.com/solana-taps-filecoin-enhanced-decentralized-data-storage-access/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMibGh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS9wb2xpY3kvMjAyNC8wMi8xMy9yaXBwbGUtdG8tYnV5LW5ldy15b3JrLWNyeXB0by10cnVzdC1jb21wYW55LXRvLWV4cGFuZC11cy1vcHRpb25zL9IBcGh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS9wb2xpY3kvMjAyNC8wMi8xMy9yaXBwbGUtdG8tYnV5LW5ldy15b3JrLWNyeXB0by10cnVzdC1jb21wYW55LXRvLWV4cGFuZC11cy1vcHRpb25zL2FtcC8?oc=5",
  "cleanedUrl": "https://www.coindesk.com/policy/2024/02/13/ripple-to-buy-new-york-crypto-trust-company-to-expand-us-options/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiRmh0dHBzOi8vYmxvY2t3b3Jrcy5jby9uZXdzL2NyeXB0by1mcmllbmRseS1jaGFsbGVuZ2VyLWVsaXphYmV0aC13YXJyZW7SAQA?oc=5",
  "cleanedUrl": "https://blockworks.co/news/crypto-friendly-challenger-elizabeth-warren"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiPGh0dHBzOi8vY29pbnRlbGVncmFwaC5jb20vbmV3cy93aGF0LWhhcHBlbmVkLWluLWNyeXB0by10b2RhedIBAA?oc=5",
  "cleanedUrl": "https://cointelegraph.com/news/what-happened-in-crypto-today"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMimgFodHRwczovL3d3dy53c2ouY29tL2xpdmVjb3ZlcmFnZS9zdG9jay1tYXJrZXQtdG9kYXktZG93LWpvbmVzLTAyLTE2LTIwMjQvY2FyZC9jb2luYmFzZS1zdG9jay1qdW1wcy1hZnRlci1jcnlwdG8tZXhjaGFuZ2UtcG9zdHMtcHJvZml0LVMzSzFRT08xYkRLdVZBNFR3cU1K0gEA?oc=5",
  "cleanedUrl": "https://www.wsj.com/livecoverage/stock-market-today-dow-jones-02-16-2024/card/coinbase-stock-jumps-after-crypto-exchange-posts-profit-S3K1QOO1bDKuVA4TwqMJ"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiS2h0dHBzOi8vY3J5cHRvLm5ld3MvYXVzdHJhbGlhLWZlZGVyYWwtcG9saWNlLW9mZmljZXItYWNjdXNlZC1iaXRjb2luLXRoZWZ0L9IBAA?oc=5",
  "cleanedUrl": "https://crypto.news/australia-federal-police-officer-accused-bitcoin-theft/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiSmh0dHBzOi8vY3J5cHRvLm5ld3MvYXB0b3MtbGF1bmNoZXMtOTktY3J5cHRvLXNtYXJ0cGhvbmUtZHViYmVkLWphbWJvcGhvbmUv0gEA?oc=5",
  "cleanedUrl": "https://crypto.news/aptos-launches-99-crypto-smartphone-dubbed-jambophone/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiT2h0dHBzOi8vY3J5cHRvLm5ld3MvcHJvbWlzaW5nLXByaXZhY3ktY29pbnMtb2YtMjAyNC16ZXBoeXItbW9uZXJvLWFuZC1hbGdvdGVjaC_SAQA?oc=5",
  "cleanedUrl": "https://crypto.news/promising-privacy-coins-of-2024-zephyr-monero-and-algotech/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiUGh0dHBzOi8vZGVjcnlwdC5jby8yMTc5NzAvdGhpcy13ZWVrLWNyeXB0by1nYW1lcy1zdXJwcmlzZS1waXhlbC1haXJkcm9wLWFwZWNoYWlu0gFWaHR0cHM6Ly9kZWNyeXB0LmNvLzIxNzk3MC90aGlzLXdlZWstY3J5cHRvLWdhbWVzLXN1cnByaXNlLXBpeGVsLWFpcmRyb3AtYXBlY2hhaW4_YW1wPTE?oc=5",
  "cleanedUrl": "https://decrypt.co/217970/this-week-crypto-games-surprise-pixel-airdrop-apechain"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiVWh0dHBzOi8vY29pbnRlbGVncmFwaC5jb20vbmV3cy9jZWxzaXVzLWRpc3RyaWJ1dGlvbi1jcnlwdG8tY3JlZGl0b3JzLWJpdGNvaW4tZXRoZXJldW3SAQA?oc=5",
  "cleanedUrl": "https://cointelegraph.com/news/celsius-distribution-crypto-creditors-bitcoin-ethereum"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiWWh0dHBzOi8vY3J5cHRvLm5ld3MvYml0Y29pbi1jYXNoLWFuZC10b25jb2luLWdhaW4taW50ZXJlc3Qtd2hpbGUtbnVnZ2V0cnVzaC1leWVzLXVwc3dpbmcv0gEA?oc=5",
  "cleanedUrl": "https://crypto.news/bitcoin-cash-and-toncoin-gain-interest-while-nuggetrush-eyes-upswing/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiNWh0dHBzOi8vY3J5cHRvLm5ld3MvYmxvY2tjaGFpbi1kdWVsYml0cy1jcnlwdG8taGVpc3Qv0gEA?oc=5",
  "cleanedUrl": "https://crypto.news/blockchain-duelbits-crypto-heist/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMicmh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS9wb2xpY3kvMjAyNC8wMi8xMy9iYW54YS1wYXltZW50cy1wYXJ0bmVyLWZvci1iaW5hbmNlLWFuZC1va3gtbGFuZHMtb24tdWstY3J5cHRvLXJlZ2lzdGVyL9IBdmh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS9wb2xpY3kvMjAyNC8wMi8xMy9iYW54YS1wYXltZW50cy1wYXJ0bmVyLWZvci1iaW5hbmNlLWFuZC1va3gtbGFuZHMtb24tdWstY3J5cHRvLXJlZ2lzdGVyL2FtcC8?oc=5",
  "cleanedUrl": "https://www.coindesk.com/policy/2024/02/13/banxa-payments-partner-for-binance-and-okx-lands-on-uk-crypto-register/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiVWh0dHBzOi8vY29pbnRlbGVncmFwaC5jb20vbmV3cy9jcnlwdG8tY291bGQtbGVhcm4tZnJvbS1zZWN1cml0aWVzLWV4Y2hhbmdlLWNvbW1pc3Npb27SAQA?oc=5",
  "cleanedUrl": "https://cointelegraph.com/news/crypto-could-learn-from-securities-exchange-commission"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMidmh0dHBzOi8vd3d3LmNvaW5kZXNrLmNvbS90ZWNoLzIwMjQvMDIvMTMvbGVkZ2VyLWNvaW5iYXNlLXBheS1pbnRlZ3JhdGUtdG8tZ2l2ZS11c2Vycy1kaXJlY3QtYWNjZXNzLXRvLWJ1eS1zZWxsLWNyeXB0by_SAXpodHRwczovL3d3dy5jb2luZGVzay5jb20vdGVjaC8yMDI0LzAyLzEzL2xlZGdlci1jb2luYmFzZS1wYXktaW50ZWdyYXRlLXRvLWdpdmUtdXNlcnMtZGlyZWN0LWFjY2Vzcy10by1idXktc2VsbC1jcnlwdG8vYW1wLw?oc=5",
  "cleanedUrl": "https://www.coindesk.com/tech/2024/02/13/ledger-coinbase-pay-integrate-to-give-users-direct-access-to-buy-sell-crypto/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMiTWh0dHBzOi8vY29pbnRlbGVncmFwaC5jb20vbmV3cy9maXhlZC1mbG9hdC1jb25maXJtcy0yNm0tZXhwbG9pdC1iaXRjb2luLWV0aGVy0gEA?oc=5",
  "cleanedUrl": "https://cointelegraph.com/news/fixed-float-confirms-26m-exploit-bitcoin-ether"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMikAFodHRwczovL3d3dy5jb2luZGVzay5jb20vYnVzaW5lc3MvMjAyNC8wMi8xMy9mb3JkZWZpLXJhaXNlcy0xMG0tdG8tbWFrZS1jcnlwdG8tc2FmZXItd2l0aC1pbnN0aXR1dGlvbmFsLWdyYWRlLXdhbGxldC10by1yZXRhaWwtZmFjaW5nLXBsYXRmb3Jtcy_SAZQBaHR0cHM6Ly93d3cuY29pbmRlc2suY29tL2J1c2luZXNzLzIwMjQvMDIvMTMvZm9yZGVmaS1yYWlzZXMtMTBtLXRvLW1ha2UtY3J5cHRvLXNhZmVyLXdpdGgtaW5zdGl0dXRpb25hbC1ncmFkZS13YWxsZXQtdG8tcmV0YWlsLWZhY2luZy1wbGF0Zm9ybXMvYW1wLw?oc=5",
  "cleanedUrl": "https://www.coindesk.com/business/2024/02/13/fordefi-raises-10m-to-make-crypto-safer-with-institutional-grade-wallet-to-retail-facing-platforms/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMihgFodHRwczovL3d3dy50cmFkaW5ndmlldy5jb20vbmV3cy9iaXRjb2luX2NvbTo0YTZiYjZlM2YwOTRiOjAtdGV4YXMtZWxlY3RyaWMtdXRpbGl0eS1jb3VydHMtdW5uYW1lZC1jcnlwdG8tbWluZXJzLXdpdGgtZml2ZS15ZWFyLWRlYWxzL9IBAA?oc=5",
  "cleanedUrl": "https://www.tradingview.com/news/bitcoin_com:4a6bb6e3f094b:0-texas-electric-utility-courts-unnamed-crypto-miners-with-five-year-deals/"
}
{
  "originalUrl": "https://news.google.com/rss/articles/CBMifmh0dHBzOi8vd3d3LnRoZWJsb2NrLmNvL3Bvc3QvMjc3MzM0L2NyeXB0by1nYW1pbmctcGxhdGZvcm0tcGxheWRhcHAtbG9zZXMtMjkwLW1pbGxpb24td29ydGgtb2YtdG9rZW5zLWluLXR3by1leHBsb2l0cy1lbGxpcHRpY9IBggFodHRwczovL3d3dy50aGVibG9jay5jby9hbXAvcG9zdC8yNzczMzQvY3J5cHRvLWdhbWluZy1wbGF0Zm9ybS1wbGF5ZGFwcC1sb3Nlcy0yOTAtbWlsbGlvbi13b3J0aC1vZi10b2tlbnMtaW4tdHdvLWV4cGxvaXRzLWVsbGlwdGlj?oc=5",
  "cleanedUrl": "https://www.theblock.co/post/277334/crypto-gaming-platform-playdapp-loses-290-million-worth-of-tokens-in-two-exploits-elliptic"
}
lewisdonovan commented 9 months ago

This is amazing! Added in https://github.com/lewisdonovan/google-news-scraper/commit/3466c4b0759622350fa6a927e3ed80c28434d722

Published to NPM, please update.

lewisdonovan commented 9 months ago

Closing