Open balajis opened 4 years ago
Here is a GIF for a PoC for CLI app: The current CLI app can filter users through complex queries to select specific users (above 1000 followers, etc.) I'm working on the Dashboard now & will keep updating this comment as I make more progress.
A Mock Flow for Dashboard UI (Youtube Video)
Code is open-sourced here: https://bit.ly/MarketingBird
Under heavy work...I'll add more context about how will the CLI, and hosted version would work in the README soon. If I have time left till the bounty closes, I'll go for an electron app too! (If this project takes off, we'll shift the stack to Flutter for all-in-one platform coverage)
We don't have a good name for it yet :sweat_smile: Feel free to contribute :wink:
Some results of using the CLI tool. Signups on simpleaswater.com skyrocketed due to the DMs. Best day ever :partying_face:
With the current stack, we can fetch 100 followers in about 4-5 secs (running on my laptop). So, doing the math:
Follower count Est time to fetch
10k followers 400 secs to 500 secs
100k followers 4000 secs to 5000 secs
Able to fetch all public data associated with an account and list/rank them using different parameters. Here is how the public data of a single account looks in raw form:
16473957 | Dr. Tayo Oyedeji | @tayooye | Private: 0 | Verified: 0 | Bio: Founder/CEO at @overwoodng (http://overwood.ngΒ ) | Former corporate CEO & university professor | I help people manage their money. | Location: Nigeria/USA | Url: http://www.overwood.ng | Joined: 26 Sep 2008 1:20 PM | Tweets: 4211 | Following: 392 | Followers: 92384 | Likes: 1614 | Media: 271 | Avatar: https://pbs.twimg.com/profile_images/1091079425624600576/M_ZJ-MN8_400x400.jpg
I coded this Python library. It can extract the followers through the anonymous API. It might be useful...
Working prototype built with Node (TypeScript) if anyone would like to work together: https://github.com/bconnorwhite/twitter-dm
Currently have a basic CLI wizard working. Both follower data and API cursors are saved in a state file incase the script is stopped.
Can add full follower data export (name, location, account creation date, follower count, verified status, etc.), filtering based on these parameters, and a slick webapp, but only if others want to contribute so we end up with one or a few good tools rather than 20 half baked solutions.
Hi @bconnorwhite and @balajis , I'm also working on Node-based version, along with Express-driven front-end.
Nice work, @vasa-develop !
Will update as I progress.
Update 6/27/2020, 11:45pm Alaska time!
What a couple of weeks! I want to thank @balajis for lighting such a great fire under my rear, as I have done more hard core development and learning in the last 2 weeks than certainly any time after about January 20 of this year. So grazie for that. I had hoped to have my working app online, but as I switched mid stream from Node.js to Python, deploying the my aiohttp app with all of the awesome power of the scraping scripts combined with the official API turned out to be harder than I realized. It will be live within a few days after the Digital Ocean guys get back to me! But for now I'll leave you with my screenshots and my thoughts. This app requires only a Twitter login from the user, with no need for their own API keys.
I spent a lot of time thinking about how you determine which followers to direct message first, given that somebody with 100,000 followers is looking at that taking 3 whole months to do. For people with really big followings, achieving a sorting ranking algorithm becomes vital. This is what lead me to abandon the Node.js app you see in these screenshots! To arrive at a meaningful value for which followers you should DM first, a simple sort by followers is extremely insufficient. In fact, some of the followers with a smaller following may indeed have a much more powerful reach, as seen in the amount of likes and retweets you see in their timelines.
The official free API limits you to just 20 or so tweets, and just 1 week of history. The paid API moves that up to 30 days and more tweets - but that's still just not good enough. People go on vacation, or get busy. So tweets will need to be scraped, and luckily Python has some fantastic tools like Twint that will do that for you. Twint does a much better job at getting tweets than getting your followers, and the official API is actually pretty good at doing that within a few hours even for an account with 200,000 followers. But you need the scraping tools to also collect somewhere between 50 and 100 tweets per user, in order to use them in the ranking algorithm.
I envision a user defined ranking where you can play with the settings a little - giving more or less weight to things like being verified, quantity of followers, ratio of followers to friends, and the average amount of likes and retweets per tweet. You could segment that further if you want to categorize by subject parsed from their content.
You can also check engagement in your own feed. People who have mentioned you will be far more receptive to a DM from you than a follower with 1 million followers who has never mentioned you or given you a RT. The scraped data will be the key for all of these metrics.
I built a rather playful UI, as my background is in education - sorry about that! But here are some of the pages I put together, with a backend built both in Node.js and later in Python (luckily I used Nunjucks templating which transferred perfectly to Jinja2) - with data stored to Redis, although eventually there would need to be both a server side and client side database - I like LevelUp a lot, but don't know if it's the most stable thing to use, so I'd ask around before settling on that. At any time the user can export all of their data to CSV, XSL, or JSON as well.
I just picked some random copy for the home page, may not be quite right but I want the app to do MORE than just export your following: I want it to help people grow their social media presence wherever they may want it, via Twitter, their blog, FB, etc.
My idea for this placeholder page is to integrate my own meme maker which generates art for social media using a database I've developed of around 60,000 vector images that can be used to quickly make a cool graphic. It's a huge update to kwippe.com - and the idea here is that the user can craft a really great public page customizing the colors, graphics, fonts, etc. They can also generate images to use in campaigns, as ads may end up being an effective tool, like the ones Bill Gates runs that encourages people to sign up for Gates Notes
My dashboard is a bit spreadsheety, and that can be made spiffier - but I wanted a quick way to get at the followers (and friends, which will be in a separate tab). This is where the "reach ranking" will be key, and you'll be able to select 1000 more people to DM, and that will be entered into Redis. I also intended to add a shiny STATS section to the top, with things like total followers, total likes and retweets, total reach, etc.
The page above just shows how you can search throughout the fields. It looks in the description, as well as their screen name and full name, but once you have tweets indexed for the users, you could also choose to include all of their tweets in your search. Twitter offers NO easy way to search just your own followers or friends, so this is a feature I would actually like to use myself just to manage my timeline better.
When you click on a user's picture - it pulls up their 20 tweets going back 7 days from the official Twitter API. The Python app will try to have much of that data scraped either in realtime, or as a task that keeps going even after you log off. Finding an efficient way to do this without taking up too much memory, bandwidth, etc - is something that would have to be looked at. You could opt to send emails to the user when their data is done filling out, and their metrics are updated.
While I see some beautiful work has been done on the DM campaign, as well as generating affilate links - and those could be integrated here - the other thing I thought about if you wanted to grow your Twitter following as well as export users, is using a hashtag incentive. Here I'm not sure if you could get enough data from the official API, or if you would want to use the scrapers. The app can use both.
Offer users the incentive that if they RT your stuff and include their own username plus a chosen keyword - let's say
Great job to all - I've seen some really awesome stuff here on this thread, and I know how hard folks have worked. Good luck to all and I hope you find a good solution to your issue.
I'm working in this challenge too. I'm very excite to learn a lot π€© and create an excellent solution that can win the bounty.
I bet the competence will be hard, especially because @vasa-develop is working in his repo since 2015!!
Good luck for everyone π and thank you to @balajis for making this possible! π
For any clarification or demo, send email to vellanki.sandeep@gmail.com. Will respond to your request as soon as I can.
The Jupyter notebook that acts as a local application that can send Direct Messages (DMs) to all of your followers based on the keywords in their bio and/or count of followers they have. It allows you to update your followers list with new followers whenever you want to and add these to the list of followers whom you want to send automated DMs to.
This works without any issues for twitter accounts with huge followers. (tested with an account having ~450k followers, but would work for even bigger accounts as well.)
Subsequent load/run times are very minimal (under a minute).
A Saas tool as follows:
Here is my submission
Code: https://github.com/daisy1754/tw-megaphone Hosted version: https://tw-megaphone.herokuapp.com/
It's a rails app that can be easily deployed to heroku or run locally. I'll also provide hosed version but given twitter has per-app DM limit you may just deploy your version on heroku
These past two weeks have been pretty fun, and @DeveloperHarris and I have definitely learned a lot. Thank you to everyone involved!
Project Pineapple is a collection of tools that we've been working on to address this competition. So far, our CLI tool is completed and our email web app and electron desktop application are still under work.
All the source code is available under an MIT license at https://github.com/DeveloperRyan/project-pineapple.
Project Pineapple CLI - Finished:
Features:
Setup:
Pineapple Project - Electron Local App - Under Construction:
Planned Features:
Pineapple Project - Email List / Referral Webapp - Early Stage Construction
Planned Features:
We plan on continuing these projects (after a short break) to increase our portfolio and add to our resumes. Please let us know any feedback you have, and any features you would like to see. If we receive enough interest, we might spin this out into a more fleshed out open-source project.
2020-06-15T18:13:16Z: Working on this after my work time.
My project takes care of the stealthiness required to do this follower base exodus. A prototype mostly functional is at the src/unstable
directory.
Not only it does send Mass DMs, it can also extract email addresses from DMs and dump these in a CSV file for easy importing.
If you require help at testing it, I am available at Twitter/Facebook/Instagram/LinkedIn using the same username I'm using here at GitHub.
Here's a pretty robust Node.js solution: twitter-flock.
It uses Twitter OAuth and stores the state of each BatchJob
in a serializable, resumable format in order to be as robust as possible.
It also includes a simple Workflow
abstraction for aggregating sequential BatchJob
tasks in the same serializable and resumable format.
I'll be using Saasify to turn this core functionality into a full, hosted SaaS product. You can think of Saasify as a Shopify for SaaS that handles all of the tedious OAuth, billing, and boilerplate for SaaS products like this.
Some basic stats:
I don't think the DM approach will be the best solution as discussed in #3 and #4, so I'm currently working on an alternative approach that tries to infer emails for Twitter users (like an MVP of clearbit which is a very difficult sub-problem in and of itself).
Screenshot of an example DM (handlebars template is used for the message body)
I'll be updating this comment with progress over the next few days.
Happy to collaborate on the OSS repo if anyone's interested. π₯ π π₯
The Flybird desktop app runs on Mac and Windows and automates sending of direct messages to your Twitter followers, with a focus on soliciting newsletter subscriptions. Keep your API keys on your own machine, send up to 1000 messages per day.
GitHub repo at https://github.com/treylorswift/FlybirdDesktopApp
The Flybird web app provides users with a quick and simple way to create a newsletter sign up page at https://flybirdy.herokuapp.com. It tracks all your subscriptions as well as the referrer responsible for generating the sign up. The "Referrals" tab shows you who has brought the most subscribers to you.
GitHub repo at https://github.com/treylorswift/Flybird
Cross platform application built using Electron & Node.js
Downloads your complete follower list from Twitter at roughly 300k followers per hour. Download can be resumed later if interrupted. Followers can be updated/re-downloaded again later.
Followers are displayed in a table and can be sorted by "Most Followers" (your most influential followers) or "Most Recently Followed" (the people who followed you most recently). Filter results by entering tags which will be matched against each user's Twitter bio.
Message composition has a primitive template engine which allows the user to insert the follower's Twitter handle into the message wherever they want. The intended use case is to insert the follower's Twitter handle in the referral id of a newsletter sign up link.
Message sending history is tracked to ensure each follower is contacted only once. Message sends are scheduled to avoid hitting Twitter API rate limit errors.
A separate "Sandbox" message history allows you to simulate sending of messages to see how the program operates without sending real messages.
The default outgoing message directs followers to the user's subscription page with a unique referral code for the follower. For example if you are 'treylorswift', the default outgoing message will be:
Hey there, are you interested in receiving my newsletter?
You can sign up at https://flybirdy.herokuapp.com/subscribe/treylorswift?twRef=${followerTwitterHandle}
When messages are sent, the follower's Twitter handle will be included in the link. They can share this link with their audience and they will receive credit for anyone who uses the link to sign up.
For example if I send the above to @balajis, he will receive the link https://flybirdy.herokuapp.com/subscribe/treylorswift?twRef=balajis
If he shares that link with others, and others use that link to sign up, he will get credit on the referrals leaderboard displayed on the Flybird web app.
A "hosted site" version of the above Electron app where people can login with their Twitter account and get right to work.
Expand on the template variables that can be used in the outgoing DM's to customize each message further.
Allow users of ITK Sign Up to provide an API key to kickbox which can score email addresses submitted to the sign up engine
My command line follower downloading, caching, and message sending engine (the same engine underlying the desktop app) is currently located here:
https://github.com/treylorswift/InfluencerToolkitCLI
Just seeing this, will be back in few days
Nice work everyone. Am looking at these over the next few days along with other submissions as they come in.
Please also take at this writeup on a complementary affiliate link approach: https://github.com/balajis/twitter-export#the-affiliate-link-approach
As well as this proposed scoring mechanism: https://github.com/balajis/twitter-export#bounty-scoring
It's possible to combine the mass DM and affiliate link approach by sending a mass DM to a selected subset of people, each of whom gets a custom signup and affiliate link. @thumpri put together an excellent infographic on this: https://github.com/balajis/twitter-export/issues/9
To answer a recurring question, any email list we get can be exported/imported to any site given the consent of the users (here's how that works for Substack.
One thing we're thinking about is how to give folks partial credit. One possible approach is that the $10k bounty goes to the final tool, and the remaining funds are split to give individual prizes to folks whose code or writeup helped contribute to the answer. The overall goal is that everyone learns something and has fun by participating, of course.
Hey everyone, love all the submissions in here!
Gave this challenge a try with a web app that:
https://github.com/shea256/movement-for-twitter
NOTE THE APP WILL NOT WORK UNTIL YOU SET THE DATABASE AND TWITTER CREDENTIALS ON THE SETTINGS PAGE - THIS WILL BE SIMPLER IN A FUTURE VERSION
The logging experience is a bit janky for now, so I recommend carefully reading the instructions in the README.md. Even better, I recommend running the app locally and watching your console logs so you know when the logging has completed. This limitation is just temporary. I plan on spending another day or so on it to create a queue that will log all of the followers in a more reliable and convenient way.
The message feature currently only lets you message one person at a time and it doesn't show you a history of the people you've already messaged. A future version will have support for this.
An implementation using Python: https://github.com/JordanDworaczyk/Twitterbot
Twitterbot consists of a command line interface for downloading followers, ranking followers, and then sending out a message to each follower based on their priority which is determined by their ranking.
Using Twitterbot a user can download up to an estimated 75,000 followers every 15 minutes and send up to 1000 direct messages each day.
Hey everyone, great submissions!
Here is my webapp with the salient points:-
Code
https://github.com/MohitKumar1991/twitter-export
Planned for Next Week:-
Hey guys,
I created a python CLI and GUI app for the DM Link Approach
Please feel free to contribute or clone the repo to add improvements
I am open to collaborating for a web app for the DM Link Approach or a new solution for the Affiliate Link approach.
I am attaching the code below https://github.com/CodeHownd/twitter-export-followers
GUI demo https://streamable.com/5t7oqd
Sup guys, these submissions looking π₯ so far!
Here's my solution to the mass DM approach: https://github.com/drizzleco/twitter-blast
Here's the hosted version: https://twitter-blast.herokuapp.com/ (π to @fangherk)
My solution uses Python, tweepy, Flask, and SQLAlchemy. Check out the README in the repo for more in-depth documentation. Questions and suggestions are welcome!
the dropdown menus didn't show up on the recording for some reason :(
make install
to install dependencies
Edit secrets.py
(automatically created) in the same directory as twitter_blast.py
and add your app credentials:
HOSTED_CONSUMER_KEY = "" # for the flask app
HOSTED_CONSUMER_SECRET = "" # for the flask app
CONSUMER_KEY = "" # for the CLI version
CONSUMER_SECRET = "" # for the CLI version
SECRET_KEY = ""
On first run, you'll be prompted to authorize with Twitter
$ python twitter_blast.py
Visit to authorize with twitter: https://api.twitter.com/oauth/authorize?oauth_token=_______________________
Paste the verification code here: ________
python twitter_blast.py fetch
to fetch your followers
python twitter_blast.py preview
to test out the ranking system and see how your followers will be prioritized
python twitter_blast.py send
to dry send a DM to your followers(add --real
to send them for real!)
http://127.0.0.1:5000
to your callback URLs in Twitter dev app settingsmake start
OR
3) source .venv/bin/activate && python app.py
followers/ids
followers/ids
returns 5,000 user ids/request(max 15 requests every 15 minutes )users/lookup
users/lookup
can get 100 user objects per requestdirect_messages/events/new (message_create)
I created a web app based on the referral link approach: https://socialexporter.web.app/
Code: https://github.com/moesalih/socialexporter
Once an influencer logs in with their Twitter account. A public page gets created to ask their followers for their emails. And the home page shows the link to that page and some other links to export all follower emails to a text file, see the referral leaderboard, and change settings.
When a follower opens that public page, they get a simple email form to sign up, and once they do, they see a custom referral link to the same page they accessed and get assigned a follower ID.
Here's my public sign up page: https://socialexporter.web.app/moesalih_
The follower can share this custom referral link with others, and get credit for anyone who signs up from that link.
A public leaderboard page will show the top follower IDs and how many others they referred. If this leaderboard is accessed by a follower who submitted their email and referred others, then their follower ID gets highlighted (like bellow). If this leaderboard is accessed by the influencer, then they see the emails of the top followers (in case they want to contact them).
I'd love to hear feedback on what I have so far, and if you have any questions.
This still doesn't include determining the quality of the emails, preventing referral abuse, and the payments part. And there's lots of improvements that can be done, but this is a functional MVP of the approach.
Hi there!
We (me, @supra08 and @palakg11) have made the submission application at these links -
See our application in action -
Command Line App -
Web App -
Our app provides an elegant way of reaching the twitter followers with the mass DM approach. This MacOS app has the benefits of native performance giving it an edge over web versions. But for non-mac users we have also prepared solutions. Those tech savvy guys who want to get their hands dirty can use the CLI with loads of features and campaign deployments plans that gives you a quick way to reach your followers. For those who want a quick web solution, we have a react based web version deployed The deployment plans give an extimate duration and you can plan you DMs accordingly. The processes run in background and be paused and resumed at ease. We can modify campaigns with follower specific plans and also verify whether a particular follower has received a DM or not.
Hello everyone!
https://outfluencer.co/ is my solution for this challenge! It is a hosted application coded in JavaScript that runs on Node.js and uses MongoDB as a database.
The app requires minimum access permissions (read only) just for the Sign in process. Additionally, to use the tools it provides, you need the following keys (session storage only):
wallet:transactions:send
permission (for enhanced security it is recommended to whitelist https://outfluencer.co/ 's IP address) - note that the rewarding system is scheduled for future development;https://outfluencer.co/subscribe/username
where anyone can agree to subscribe and share their email βhttps://outfluencer.co/subscribe/username?aff=username
to expand the affiliate network βhttps://outfluencer.co/leaderboard/username
with ranked subscribers βYou log in with Twitter OAuth, enter your API Keys (session storage) and start extracting your followers. On average, it fetches approximately 3.000 followers/sec for those accounts with less than 75.000 followers, after that, the 15min Twitter API restriction kicks in (max. 75.000 followers/15 min). note: entering your API Keys is mandatory until you extract your follower DB (you'll get an error if your keys are incorrect), after that, you can leave the inputs empty BUT only to see the dashboard (if you want to send DM your keys must be correct).
After the followers have been extracted, you get redirected to the Dashboard where you can download your data as .csv files and have an overview of the numbers behind it.
This is where you can sort and filter you followers and start sending mass DMs. I've added some little things to help you write more personalized things, such as writing {{follower}} to insert the follower's name or {{url}} to insert your public page or quick replies in case you expect an answer from the recipient.
This page acts like history, keeping records of the mass direct messages you've sent, showing some 'must have' details.
Creating this app with the sole purpose of collecting emails was the best approach considering the following:
If you will be asking a user to provide personal or private information via an automated Direct Message, you must clearly explain how you will use the information youβre collecting. Consider including a link to your privacy policy in your Direct Message to the user, as well as in your Twitter profile bio.
note: the follower can subscribe to multiple influencers and the app will ask for authorization each time.
On this page all the subscribers will be displayed and they are ranked by the no. of people that subscribed as well.
After someone subscribes, they are redirected to this page where an affiliate link is generated.
From a dedicated page, similar to Mass DM, the influencer will be able to create a New Reward Campaign by setting:
In order to activate the Reward Campaign, the influencer will have authorize it by entering his/hers Coinbase API Keys.
Under the hood, the following steps will be taken:
Pros:
Cons:
unverified_email
error, you could opt to send a direct message informing the subscriber that he/she won and needs to register at Coinbase to claim the reward;_ fast, international, automated, small payments to users for decentralized work
... it made me think about micropayments with Bitcoin using Lightning Network, more precisely it made me think of the Tippin.me app. I do have limited knowledge in this area, but I'm waiting for a response from Tippin.me to see if it is feasible to build an automated tipping process for the rewarding system and also if they are open for collaboration in this regard.
https://github.com/snowdot/outfluencer
This was a fun and interesting challenge and I'm glad to be part of it. I believe that with this project we've only scratched the surface and that there is an immense potential to build great things with the Twitter API.
Really amazing submissions everyone. I spend a lot of time empathising with the problem and figured out the solution approach as explained through the following mind map and mentioned in issue #9:
While working on the Hybrid approach, I encountered another problem and further modified the solution to the following : β¨β¨β¨
β¨As explained in the above mind-map, I have built a ranking algorithm which serves the purpose and the code for which can be found here : https://github.com/thumpri/Soporter
While coding the proposed solution, majority of my time was spent analysing the Twitter API and finding loopholes to surpass the limits.β¨ Following are my findings :
I think weβll have a brilliant tool if we keep this algorithm as the base and add functionalities like- β’ The front end code by @snowdot or @moesalih β’ Maintaining an apt database which preserves the state as done by @MohitKumar1991 β’ generating Auth bearer token for better speed (5x) β’ Twitter authentication, sending DMs as done by in Python by @petabite and so many others.
I would love to continue working on it as a side project and bring all the pieces together. This has surely been a great learning experience for me to encounter a seemingly easy problem, iterating through several solutions and finding the one that fits (for now!). :D β¨ Thank you @balajis for hosting this. I hope I was able to add value to it.
Messaging Automation for Social Media Influencers XD
Video Link: https://www.youtube.com/watch?v=4-OiEdxJxKw
Basic overview of the UI. You sign up, update keys, start indexing followers.
Filters
And then go to the Filters
page. Create whatever targeted segments you think are relevant. Currently the filters I provide are, follower count, friend count, keywords, muted by you, verified, last active, twitter handle to test your messaging campaigns. I have more filters in pipeline.
Campaigns
After you create your targeted segment, you start your messaging campaign. There you can enable a custom link or subscription link I provide to send with the message. Using these links I track, clicks and conversions. conversion is when the user successfully subscribed. I built the tracking of conversions and clicks. /subscribe/user
link. These things will be shown on a campaign page. I will also be tracking other metrics for the next day after the campaign is sent.
I currently disabled the actual campaign sending part. Its actually scary, its too powerful, worried I might accidentlly send it to all my followers becuse of a bug or etc. I want to test more and then enable it. Also it feels like I over engineered this a little bit in two weeks. I used workers and message passing. Lots of things can go wrong. You can send a test dm tho for now. It's to test right before you start a messaging campaign.
Even though you wont be able to start campaigns, You can sign in and index your followers, and then play with the segmenting your followers. Its really fun. The filters UI came out really well.
If people start using this, I will be implementing A/B testing of your campaign messages, tracking unfollows right after campaigning, more checks to send dms based on whether a follower received a message recently.
Please sign up and let me know if there are any bugs. I hope not!!
Thanks @balajis for hosting this fun product challenge.
I'm really happy with the Filters UX, you add an extra filter by clicking on the plus, and you can delete a filter by clicking on the <
next to the filter.
link to the cmd line tool I built initially that supports the backend to this webapp https://github.com/syllogismos/balaji
Implementation Details and Technologies Used:
A simple tool to let influencers create a link using which followers can signup to their newsletter and get rewarded in BTC Repo : socionity/jmel
Influencer signs up with Twitter account, granting full permission to account
A link gets created, a bitcoin address is generated
Influencer fuels the bitcoin address
Influencer types a message that is to be displayed before the users sign up, from the settings tab
Influencer goes to the Invite tab and invites the top 1000 followers by sending them a DM (can be repeated multiple times, over days)
Influencer can track who all have signed up on the Subscribers tab
Subscriber receives a link
Subscriber logsin with a social media account giving permission to access email
Once registered, an affiliate link and a scratch card is generated
Scratch card can be opened once in 24 hours
More the number of people who have registered using the user's link, more the likelihood of winning on the scratch card
Subscriber gives the BTC address and opens the scratch card
BTC is transferred to the given address. Next scratch card will be available in 24 hours. All affiliate sign ups from this point on will be considered for the next scratchcard's probability.
Introducing Rabble, a Flask App developed in Python to send prioritized mass messages to your Twitter followers.
The repo can be found here Github Repo for Rabble: A Twitter App for Mass Messaging your Followers
Rabble: A Twitter Application for Mass Messaging your Followers
Use this app to gather, sort, and send a message to a database of your Twitter followers. Sort your follower database with 8 unique parameters. Export your followers to a CSV file.
Choose how many followers you'd like to reach. Choose a parameter to prioritize them by. Filter by location if you so choose. Write a message and inform your twitterverse followers. Twitter only allows 1000 DM's to be sent per day. With large amounts of followers, this can take a while. Feel free to set it and forget it. This app was designed on a timer with Twitter Rate Limits built in.
Export your followers from a pre-sorted database to a CSV file. Load time is approximately 90 seconds per 5000 followers, patience is key!
Users need to ensure they have "Read, write, and Direct Messages" enabled on their app tokens. Twitter Apps
Due to heroku timeout limits at 30 seconds, the GIFs above were locally hosted.
Twitter Exporter is designed to be a desktop application with single user in mind. However this solution can be scaled to cloud based solution with added security features like OAuth sign-in and higher performance database with minimal code changes.
https://github.com/ShreyasJothish/twitter-export
https://github.com/ShreyasJothish/twitter-export/blob/master/README.md
Twitter Exporter is developed on Flask framework and many of enhancement can be achieved with minimal code changes.
Repo: https://github.com/neelsomani/audience-analysis
Hi there! My unique insight for this problem is that many of the posted solutions don't scale to very large numbers of followers. Aside from that, the mass DM approach violates Twitter's TOS and will almost certainly get a user shadow banned or worse.
I built my project with the intent of not violating Twitter's TOS while handling the scalability concerns for accounts with very large (100,000+) followings.
This tool streams a user's Twitter followers (by parallelizing the Twitter API requests across API keys) and infers various attributes about each individual follower, including their email address and LinkedIn profile.
Feel free to take a look at my README, which explains why I think my methodology is best. Here's an image of what the results look like:
P.S. Many of the submissions are structured as web apps, but they cannot actually function as such for even two users, since the work isn't properly parallelized (especially for users with large followings).
Hello Everyone
I have made multiple improvements over the week and sharing the second version again.
Affiliate Links support tracking entire hierarchy of who recommended you.
In the third week, I will make the app in a very simple deploy to heroku app that anyone can deploy to their heroku account and start work.
I will also add simple analytics, esp around filtering followers by country( not so simple from what response twitter is providing), calculating conversion rates for your links and finding best people who recommended you to their followers.
With my third week work, it will become a complete solution to migrate twitter users to your personal email list.
Jupiter is an electron application built for MacOS/Windows. This application primarily fetches a list of your followers and provides features to send Mass DMs to them.
This app runs locally. It uses SQLite database to save state and record details of who have been contacted and who are yet to be contacted.
Jupiter comes packed with the following features:
AND
or OR
based filtersA decoupled architecture where we have an adapter for a given social media platform (Twitter) and connection to external databases through Sequelize ORM enables us to have flexibility with the DB engine used.
The react components used within the electron app are also decoupled from the IPC messaging which enables us to reuse the same components for local/hosted web apps in the future.
https://www.youtube.com/watch?v=PLQT1RAWcMo
If you wish to see how the app works in MacOS. You can download our Jupiter GUI Alpha* build here.
Hi, we've created Exit Social, name inspired by Exit, Voice, and Loyalty. We went via viral route. Influencer shares a link with Twitter followers. Each follower get points for joining (more influential the follower, more points he receives) and for referring other followers.
The influencer can pay most valued followers via Metamask if they provided Ethereum address or use the points on their own in the new community. For example top 10 followers can have once a month private conversation with the follower.
You can export your followers to csv for easy upload (for example Ghost supports csv import)
Sharing the link:
When follower clicks on the Link, he can fill in email and ethereum address. He needs to login via twitter(only existing followers are allowed)
After validation, follower gets own refferal link to share
Paying out users via Metamask
Each community has it's own public leader dashboard
Limitations
Technical Implementation
You can find public clean repo here
Hey all, really great seeing all the submissions and different approaches.
Here's something I worked on over a few days, written from scratch in JS with minimal dependencies: https://github.com/mrdavey/doyen.gg/tree/master/Backend. I didn't have enough time to do a really nice UI like most of the others, so I kept it simple and plain (for now).
Main screen
Filter screen
Logging in terminal of network activity
Logging of DM campaign (cold run)
Logging of DM campaign (hot run)
Feel free to reach out to me on https://twitter.com/daveytea π
Hey all,
We're built project exodus as a platform for influencers to export their followers from platforms like Twitter. The goal of this app is to provide our users techniques that employ virality tricks and incentive alignment so they can easily organize an independent channel to their followers.
https://exodus-281501.wl.r.appspot.com/
Features:
Limitations
Future Work
Screenshots from parts of the app are shown below:
I haven't actually made this product as I've been busy with exams and my internship for the past few weeks, but I've thought of an approach to solve this problem.
Problem: Can't export followers from social media. Tools don't exist to make exit easy.
TL;DR Solution: Rank followers by several factors including their engagement (have they retweeted any of your recent tweets?), send the top followers an individualised DM with their affiliate link, develop a better email validation process (to protect against Sybil attacks such as those from catch-all email addresses) and use USDC as the payment mechanism (with possible ShapeShift integration to avoid tribalism).
Complete Solution:
socialexport.com
with Twitter and socialexport.com
automatically makes you a page at socialexport.com/username
that has an email form on itsocialexport.com
affiliate link is generated for your top followers (this could be measured by factors like: how many followers do they have? can they receive DMs? do they follow you back? are they verified? how engaged are they? etc)socialexport.com/username
. This maximises the number of eyeballs that see your socialexport.com
page.socialexport.com
will recommend 1000n followers to DM. The first 1000 will be DMed on the first day, the next 1000 on the second day, etc.Hey {{first-name}}, you can tweet https://socialexport.com/username?referer={{username}} for a chance to win up to $100 in crypto!
(obviously it should sound less scammy)socialexport.com/username
, they should first see an email form. After they enter their email, they will be shown a form to optionally enter their Twitter username to generate an affiliate link for a chance to win up to $100.
socialexport.com/username
should also have links to view the leaderboard and to generate an affiliate link without having to enter an email. This is because if a user forgets to generate a link after entering their email, they can go back to the page and do so.@socialexport
tweeting at them when they win something. The tweet will have a link to claim.socialexport.com
. When a user goes to claim.socialexport.com
they can login with Twitter and input their Ethereum address to receive the USDC. If they don't have an Ethereum address, the website will recommend them to download Metamask for desktop users and Coinbase Wallet for mobile users.mail+alias@gmail.com
, the email will be stored in a database with and without the +
. The entry with the +
will be stored normally, while the entry without the +
will be used for validation, to ensure the same user isn't submitting a bunch of their own aliases.@gmail.com
, @outlook.com
or any of the major providers, it will be instantly validated, since they usually have barriers to creating many emails addresses.@hey.com
emails and other providers.I can finish building this by July 5th if there is enough interest, as my exams finish on July 2nd.
Hi everyone! I created a hosted twitter export app called Migrate. I implemented the DM approach to assist Twitter influencers to migrate their followers out of Twitter. Check out my app here: Migrate: Export Twitter Followers Easily
Features:
Future Work:
I am so inspired to see everyone's submissions! This has been a really rewarding experience. π
42
DMs are sent out every hour (42 * 24 = 1008
, there is some spillover)
Feel free to contact me if you encounter any issues. I am happy to give white glove service, especially for the first users!
Hi, we are a group from Australia and we have created social exporter (socexporter.com). We implemented both the direct DMs and affiliate campaign solutions. An influencer can choose to run both if they choose.
Social exporter relies on 3 components. There is a front end web app implemented in Flask, a multithreaded accounting software program written in c++, and bitcoind to create payments and accept deposits.
The flask front end uses sqlite to store information about users and influencer data and redis to for queues and job processing. It uses rq to allow for follower importing and the sending of Dms to be done in worker threads so the website doesn't become unresponsive with multiple users.
The accounting software uses mysql and implements user balance tracking and management in a similar way to a crypto exchange. When an influencer or an affiliate requests a payout the flask app sends the requests to the accounting software for validation before the accounting software notifies bitcoind to make the payment via RPC.
We utilise bitcoind's ZMQ interface to notify the accounting software of a deposit into a users address.
We are using BCH not BTC. The mempool backlog and high fees on BTC make it unsuitable for this project. We thought it would affect user deposits and payouts too much and degrade our overall user experience. Switching to lightning or liquid would be possible in the future when the developers of those applications say that are stable and production ready, as far as i know right now they are not.
When an influencer chooses to start a direct DM campaign they need to authorise our app to their twitter account. After authorisation we import their followers to our site. Once importing is complete we automatically start to send our DMs to the followers at a maximum rate of 1000 per 24 hours until all followers have received a DM. Due to the daily DM limit, we did not implement a robust ranking system to determine who to send DMs to first. We came to the conclusion that if you have so many followers you need to rank them to determine who should get a DM first, then you are much better off using the affiliate campaign.
An influencer can choose to run an affiliate campaign. They choose how much to payout a day and how many days they want to run the campaign. If they have enough balance on the site the campaign will begin. The top 3 affiliates will get paid a proportional amount to how many people they have on-boarded that day. Our flask app uses a cron scheduler to run payouts every 24 hours.
For development purposes we have been running bitcoind on the regtest network to avoid loss of real funds. There was an small snippet about scoring but we aren't sure how scoring will be done. Simply due to running on regtest right now some of the functionality (such as making a deposit into a user account to start a campaign) is only available locally. We would be more than happy to either be present during some testing so we can fund accounts with regtest coins or change the network to run on testnet instead (we cannot provide testnet coins). Please let us known on this matter. We are located in Australia.
these screenshots can also be found in the repo here: https://github.com/socexporter/social_exporter_public
to give the user a balance we generated coins on regtest and send them to the address of the user using the sendtoaddress rpc command
By The Individual Company
An influencer has an account on a platform separate from Twitter and wants his or her followers on Twitter to migrate and use that platform. The ideal situation is having every person following the influencer on Twitter to migrate to another platform where that influencer is available. However, there is no simple way of doing this. Furthermore, different methods have both PROS and CONS.
Extract all followers currently following an influencer and then send out 1000 DMs daily such that every follower is eventually notified of the new platform.
PROS:
CONS:
Affiliate link based competition for followers.
PROS:
CONS:
Rather than simply DM all followers of an influencer, DM followers who are most actively engaged with the influencer's content. A engaged follower is one who is retweeting or mentioning an influencer. They are not passively following an influencer, but actively consuming content and redistributing it or engaging in it. In a sense, they are an influencer's most active fans.
We hold these assumptions on engaged followers:
PROS:
CONS:
BT is an Electron App. We'll be opening the code base up pretty so anyone who clones the Github repository can build it themselves to ensure there is no malicious code being executed. After all, this is a bitcoin bounty, We have a hunch those sending Bitcoin prefer to keep their Twitter API keys local.
Furthermore, we use json files as our "database" (npm package conf). It is not recommended to close the app when it is processing a "campaign" or there will be data lost on who has been sent a DM in that campaign.
Influencers load this app up to periodically build engagement and run a new campaign so that DMs are sent to their most engaged followers. These followers then, due to being engaged, are more likely to sign up to a newsletter or register to a new platform.
To use the application influencers must enter their Twitter API keys and their Twitter Handle. Once signed in they can navigate by clicking the title of the page they're on.
On the "Followers" page influencers will be able to see a button called "Build Engagement". Once clicked, this will scan their current timeline for up to (800) of their tweets and log their statuses in a "tweets.json" file. A set of (25) tweets that had the most retweets since the last retweeter scan for them will have their last 100 retweeters pulled and logged into the "users.json" file. The last (800*) mentions are scanned and logged into the "users.json" file. Each "user" in the users.json has all their retweet and mentions logged when found in a scan. Finally, a ranking score is calculated and then the most engaged users are sorted on this score and saved to "rankings.json". This scan builds on itself, data is not removed except for new rankings which are generated after every scan. By clicking the "export" button they can save a csv file of their most engaged users.
*This number is variable, but not yet changeable in the app GUI.
A "retweeter" look-up can only scan the last 100 retweeters of any influencer's tweet. Influencers that have tweets with more than 100 retweets may not get a complete rankings analysis. However, periodically scanning throughout the day as more people retweet a tweet will enhance the analysis.
The current ranking formula is just: retweets + mentions by any specific user We think the formula can be enhanced by adding a time component, but we would also like influencer input on what type of formula could best calculate who is the most "engaged" .
Once the scan is done, influencers will see the rankings of their most engaged users.
On the "Campaigns" page influencers are able to write up their message, use codes to reference their integrations and then run a "campaign" by pressing "send". The integration being used is displayed at the top. A "campaign" grabs the top ranking users which can be seen on the "followers" page. It filters out all users who have been sent a DM in any prior campaigns, then it starts grabbing batches of the remaining ranked users (starting with those ranked the highest) to verify if they are at that moment followers. This process continues until enough users are found to satisfy the campaign size requested by the influencer and a batch of DMs are sent out with the influencer's message. All these campaigns are stored in the "campaigns.json" file. DM messages that have been sent out have their metadata stored in a "messages.json" file.
Note: there Californian laws to be aware of when automating direct messages.
To test the functionality of campaigns, a "dry-run" may be initiated. This mode will mimic the process of sending out DMs and generate output to files, but won't actually send out any DMs. You can then check the files to ensure the right people would receive a DM. If you then disable the dry-run option and hit "send" the dry-run campaigns will be deleted from the "campaigns.json" file and the messages will be sent out.
On the "Settings" page influencers are able to set integrations which can be referenced through special syntax on the "Campaigns" page.
For MacOS you should find the data at:
~/Libary/Application Support/bt
For Windows you should find the data at:
C:\Users\
We envision Better Twitter to have more features, but could not complete them all within the current deadline.
bt bounty project specfic plans
This is my submission to the Twitter Exporter contest.
I worked with a partner. Together we completed both the requirement for a local app and a hosted web site.
First, some features about the local app, which uses the "Mass DM" approach:
https://i.imgur.com/2FO15Ba.png
The script used to make the .exe and the .exe itself can be found here:
https://github.com/plutownium/twitterExporter
We analyze your followers to make your efforts count. We know what followers have the largest social media footprint, which are most loyal to you, and can help you leverage this inormation to build your brand. By targeting your most prominent "cadets" with give aways or exclusive material, you can make them more likely to give you exposure with mentions or retweets. By giving your loyal influencers access to insider information, you can reward them for sticking by your side and help them better represent you. Finally, you can DM the masses to keep them informed of whatever you want.
Our UI is rudimentary right now, but we have the backend to support advanced analytics to make your DMs count.
https://drive.google.com/file/d/15w7rIS0Zhh67yPT8rdbe47B2-Ha7U7Io/view
And this is the landing page followers will see when they click the included link:
https://cdn.discordapp.com/attachments/651923786903453702/722511234553085982/unknown.png
You can try the app yourself by going here, authorizing the app, and filling in the info. Click "send your followers a dm" after you get past authorization to open the dashboard
Here is the code for the hosted website:
https://github.com/Spade-and-Archer/MassDM
If our project is selected as the winner, please let me know via my Twitter handle, @rolypolyistaken
An app that lets users DM their twitter followers en masse.
A bit of a background. Mon Droit is French for 'my right,' it comes from the motto of the English crown, 'dieu et mon droit, honi soit qui mal y pense' 'god and my right, shame on he who thinks evil of it.' It only felt right that those who have built their own empires on twitter have the right to take their followers to other locales (platforms), and perhaps see what comes of it.
6/30 Update: Added Dark Mode
https://github.com/sagardesai90/mon-droit
Dark Mode:
Tokens Page - Dark Mode
Campaign Page - Dark Mode:
History Page - Dark Mode
There is a rate limit of ~3000 followers being added to the followers.json every 15m.
You can send out 1000 DMs each day.
Status updates on a particular campaign, especially useful for campaigns that may span multiple days (1000+ DMs)
Overall speed optimizations across the board
Will look into implementing saasify
So many awesome submissions by everyone. It will take us a little while to go through them, but we have begun the review process. Please feel free to reply with any questionsl
Props to this initiative, this is twitter at its best.
@balajis it's my assumption that you guys don't want people posting about updates to their apps, right? Am I correct that submissions have to stand on what was submitted before the deadline, and you'll be notifying people who've made the next round to then submit their updated versions?
@balajis curious about this too, some apps were already updated.
@mspanish @Trudko Updates to the apps are fine. We are setting up a systematic framework to score all of these. The goal is really to get the best open source program out there to the public, for free.
Divya Dhar Cohen (@dvd22dvd) and Ryan Shea (@shea256) are helping with the evaluation process. So if you get a note or email from them, don't be surprised :)
Hey @plutownium @femyeda @socexporter @mrdavey @Trudko @npgeorge @socionity @syllogismos @thumpri @snowdot @petabite @JordanDworaczyk @IvanMontillaM @daisy1754 @mspanish @bconnorwhite @brunneis there wasnβt an email in your profile. Please email me at twitterexport@protonmail.com so that we can communicate with you.
@balajis @dvd22dvd
Here some updates for the third week for https://github.com/MohitKumar1991/twitter-export
Very happy about this update because now anyone can use this by deploying to heroku. Total setup time is 10mins for heroku + twitter auth.
For the fourth week I will
@dvd22dvd sent
I missed it, so just sent! @dvd22dvd :-)
@balajis @dvd22dvd
Here some updates for the fourth week for https://github.com/MohitKumar1991/twitter-export Now you can filter by occupation (founder, engineer, investor etc) UI/UX Redo - much better looking and multiple confusing flows were simplified. Couple of bug fixes
Very happy about this update as well because now it's quite usable.
For the fifth week I will fix some bugs and that's it. I am not proud of how much time I have spent on this by now.
See here for context on the bounty for an open source tool to export your Twitter following and here for notes on what one possible solution might look like.
Please submit your bounty entry by adding a comment below. Keep your entry as a single comment, and include the following:
Feel free to edit your comment later if you want, but please don't add more than one comment as spam.
We plan to review this by end of day on June 21, 2020 at 11:59pm PT but may extend the deadline if there are a lot of submissions or unanticipated complexities.
UPDATE: we'll extend this to June 28, 2020 at 11:59pm PT given all the interest.
Update: June 28, 2020 - Review has begun
Wow! Review has begun.
So many awesome submissions by everyone. It will take us a little while to go through them, but we have begun the review process. Please feel free to reply with any questionsl