search

aws-samples / real-time-social-media-analytics-with-generative-ai

MIT No Attribution
13 stars 3 forks source link

[Issue] X Free API version no longer compatible #11

Open daviddurairaj opened 4 weeks ago

daviddurairaj commented 4 weeks ago

Following Elon Musk's acquisition of X (formerly Twitter), the X Free API version is no longer compatible with this solution. The Basic tier, a paid subscription, is now the most affordable option that supports this solution. Unaware of this change, we initially tried to integrate using the Free API tier, which caused our Apache Flink service to enter an errored state. It took some time to realize that we needed to force-stop and restart the service. This situation highlights two potential areas for improvement:

  1. Ensure compatibility of this solution with the free X API tier.
  2. Update the documentation to clearly explain how to debug and restart the Apache Flink service, and/or modify the Flink service to fail more gracefully, so that even when invalid data is pushed, it doesn't go into a failed state and can continue responding to subsequent valid requests.
FranMorilloAWS commented 1 week ago

Hi David! Yes, With X changing their API terms, you need to have at least the Basic API in order to pull tweets. We will be updating the job soon, so its able to recover from receiving credentials from the free tier.

For your first point. This solution wont work with the Free X Api tier, as that doesnt allow you to pull tweets.