Tweet extractor v. 1.5

[fbgallet]

Instructions to install it: Import the JSON file below (unzip it first, of course) in your Roam dababase to be sure to preserve the code structure (copy/past doesn't work well here): Tweet author names SmartBlock v 1.5.zip

📋 Description

Making it easy to archive tweets in Roam:

• extract @username and public full name from tweet's url (in current block or in clipboard), and choose wich one to use as reference
• move tweet to child block and add alias for later sneak peek (optional)
• add a button for extracting text from tweet (optional)

Version log: v.1.5 (13 april, 2021)

• now very stable, should not change much
• fix an important issue with a new way, more stable and fast, to get ref from child block (to create the alias). (was sometime not working, when using SmartBlock in Linked References, for example)
• Hide by default "Tweet - extract text" SmartBlock in SmartBlocks menu. To display it again and use it as a standalone SmartBlock, just remove "<%HIDE%>" command after its name. Thanks to @gijigae (Sangmin) suggestion.

v.1.4 (12 april, 2021)

• much faster execution
• more coherent code, the user variables can finally be placed in the header of the 1st javascript block. So the whole main SmartBlock can easily be copy/pasted. ("Tweet - extract text" has not been changed)

v.1.3 (11 april, 2021)

• if the block is empty, automatically paste the clipboard, assuming that tweet's url has been copied in clipboard. Therefore, the fastest way to use this SmartBlock is to create an empty block, open workbench and quick search "twe"

v. 1.22 (10 april, 2021)

• fix a small issue with button name (line 16 of the first JA block): button name call now "Tweet - extract text" SmartBlock and not "Extract tweet from text
• add "Text from tweet:\n" before the extracted text of the tweet (line 25 of the JA block in corresponding SmartBlock)

v. 1.21 (10 april, 2021)

• works also if there is already some other text or refs in the block, but the tweet URL has to be the last url of the block. If this case, all the content of the current block will be moved in the child block (no data loss), with the embeded tweet.
• Change of the SmartBlock to extract text, so that it appear after the main Smartblock about tweets.

v 1.1 (9 april, 2021)

• extract both @username and full name (public author name) and print the both (since @username is sometimes odd)
• setting for choosing which name is used as reference, according to each person's habits to reference name in his database

✅ Prerequisites or dependencies that are required for this SmartBlock

Need of course Roam42 installed and running in you Roam graph.

The tweet URL has to be the last url of the block (it works of course if there is only the tweet url!)

📷 Screenshot

Extract text from tweet SmartBlock:

💡 Additional Info

Import the JSON file below (unzip it first, of course) in your Roam dababase to be sure to preserve the code structure (copy/past doesn't work well here): Tweet author names SmartBlock v 1.5.zip

Fastest way (tweet's url in clipboard + workbench):

More complere demo: https://youtu.be/QqnD1U_j9Fw

✂️ Code of the Smartblocks:

- #42SmartBlock Tweet - extract author names & alias child block
    - <%NOBLOCKOUTPUT%> <%JA:```javascript
/* 
Version: 1.5
Published: April 13, 2021
By: Fabrice Gallet
Twitter: @fbgallet

Support my work on: https://www.buymeacoffee.com/fbgallet

************************ USER SETTINGS ************************/

let publicNameAsRef = true; // true: by [[Full public Name]] (@username), false: [[@username]] (Full public Name)
let prefixName = "@";       // "" for no change,  "@" for Ref like [[@username]] or [[@Author Name]], 
                            // (@username), when not used as reference, has always @ prefix
let withAlias = true;       // if false, no alias to tweet block-ref is added
let formatAlias = "👁‍🗨";    // icon to click for sneak peek

/* You can also disable the button to extract text, line 28
/* And change or remove the prefix text in the "Tweet - extract text" SmartBlock, line 26
/***************************************************************/

let startingBlockUID = roam42.common.currentActiveBlockUID();

/* if the block is empty, suppose that the tweet url is in the clipboard, then paste it*/
let blockContent = document.activeElement.value;
if (blockContent=="" || blockContent=="  ") { blockContent = await navigator.clipboard.readText(); }

/* Move tweet in child block and add button for extracting text */
blockContent += " {{📑:42SmartBlock:Tweet - extract text}}  "; // put '//' before this line if you want to disable this button
// the 3 lines below replace the old and unstable way to get child block ref (or uid)
await roam42.common.createBlock(startingBlockUID, -1, blockContent);
let blockInfo = await roam42.common.getBlockInfoByUID(startingBlockUID, true);
let blockRef = blockInfo[0][0].children[0].uid;

/* extract only the last URL of the block as tweet URL, in case some comments and already in the block */
let urlRegex =/(\b(https?|ftp|file):\/\/[-A-Z0-9+&@#\/%?=~_|!:,.;]*[-A-Z0-9+&@#\/%=~_|])/ig;
function linkify(text) {
    return text.match(urlRegex);
} 
let urlTweet = blockContent;
let urlsTab = linkify(urlTweet);
urlTweet = urlsTab[urlsTab.length - 1];

/* Extract username from tweet url */
let stringArray = urlTweet.split("/",4);
var userName = stringArray[3];

/* Get Public Name with oembed JQuerie from Twitter API */
$.ajax({
        url: "https://publish.twitter.com/oembed?omit_script=1&url=" + urlTweet,
        dataType: "jsonp",
        success: function(data){
            var authorName = data.author_name;
            let authorNameTab = authorName.split(" ");
            authorName = authorNameTab[0];
            let index = 1;
            while ((index < authorNameTab.length) && !(/\W+/).test(authorNameTab[index].charAt(0))) {
              authorName += " " + authorNameTab[index];
              index++;
            }
/* Print [[Full public Name]] as reference before (@username) or the opposite according to user settings */ 
            if (publicNameAsRef) {
                PrintTitle(FormatUserName(authorName, "@" + userName, prefixName), withAlias, formatAlias, startingBlockUID, blockRef);
            } else {
                PrintTitle(FormatUserName(userName, authorName, prefixName), withAlias, formatAlias, startingBlockUID, blockRef);
            }
    }
});

function FormatUserName(nameR, nameP, prefix) {
  let names = "[[" + prefix + nameR + "]] " + "(" + nameP + ")";
  return names;
}

function PrintTitle(names, k, alias, refP, refC) {
    var title = "#tweet by " + names;
    if (k) {
        title += " [" + alias + "](((" + refC + ")))";  
    }
    roam42.common.updateBlock(refP, title, true);
}
roam42.common.moveCursorToPreviousBlock(document.activeElement);
//await roam42.common.sleep(150);
```%>

- #42SmartBlock Tweet - extract text <%HIDE%>
    - <%JA:```javascript
let urlTweet = document.activeElement.value;

/* extract only the last URL of the block as tweet URL, in case some comments and already in the block */
let urlRegex =/(\b(https?|ftp|file):\/\/[-A-Z0-9+&@#\/%?=~_|!:,.;]*[-A-Z0-9+&@#\/%=~_|])/ig;
function linkify(text) {
    return text.match(urlRegex);
} 
let urlsTab = linkify(urlTweet);
urlTweet = urlsTab[urlsTab.length - 1];

// call Twitter API and stripe Html text (some special caracter may remain)
$.ajax({
        url: "https://publish.twitter.com/oembed?omit_script=1&url=" + urlTweet,
        dataType: "jsonp",
        success: function(data){
            let htmlString= data.html;
            var stripedHtml = htmlString.replace(/<br[^>]*>/gi, "\n");
            stripedHtml = stripedHtml.replace(/<[^>]+>/g, '');
//          stripedHtml = stripedHtml.replace(/&quot;|&#39;|&mdash;/g,' ');
            stripedHtml = stripedHtml.replace(/&quot;/g,'"');
            stripedHtml = stripedHtml.replace(/&#39;/g,'\'');
            stripedHtml = stripedHtml.replace(/&mdash;/g,'—');

/* print the text in sibling block
    you can change or delete the header text of the block "Text from tweet:\n" if you prefer */
            roam42.common.createSiblingBlock(roam42.common.currentActiveBlockUID(), "Text from tweet:\n" + stripedHtml);
        }
});
await roam42.common.sleep(150);
``` %> <%NOBLOCKOUTPUT%>

[zidingz]

Nice, thanks!

[JimmyLv]

It seems not to work anymore.

[fbgallet]

It seems not to work anymore.

Still working for me. Are your other SmartBlocks working ? Is there some error message in the console ?

[JimmyLv]

Thank you. I got to this one and it works 😁 https://roamjs.com/docs/extensions/twitter