Gathering Facebook Data

ghost commented 9 years ago

Hi All, First of all thanks for kalyan sir for taking this initiative. And thanks for all fellow mates for showing interest on this.

So i am thinking to initiate our project. As a part of that i am creating a first issue here.

Gathering Facebook Data is our first issue. The very first thing required to initiate our project is Data. So lets start from there on wards. Please post if there is any thing required before this.

Please put your answers/solutions or ways to get the facebook data.

preeti04 commented 9 years ago

Hi,

I tried to fetch the sample data(to check GraphApi feature) of one of the page of FaceBook using GraphApi.

Sample screenshot is :

Steps 1) Create an facebook app id. 2) open developers.facebook.com/tools 3) Choose Graph API 4) There is a box just next to GET button paste the url of facebook page and press submit 5) data will be available in json format in below box in the page.

Another way, in the below mention link https://developers.facebook.com/docs/graph-api/using-graph-api/v2.3 Open the open Graph Explorer mentioned in Reading section. It will direct you to GraphApi page directly.

You can fetch yours favorite details by choosing the option Get Token (in Graph API page) and select GetAcess Token and choose your option based on the available option.

I am working on fetching the comments/ like details for any facebook page. Please let me know whether I am heading in right direction or not.

Thanks

preeti04 commented 9 years ago

Hi,

I am able to get the comments of any particular post in FB (for which FB policy allows and is public)

Screenshot is

Steps 1) Goto Graphi API as mentioned in above comment 2) Paste the post id/comments in GET section of graph API explorer

Steps to get post id a) Open any post in FB page , at side of post there will be down arrow button, click and choose embed this post b) Will open a box with url ,copy the url and take the section after /post, for instance , suppose url obtained : (small section of complete url ) after /post is the post_id.

Hope this help to fetch some data. Will update you guys if I am able to fetch bulk of data in a single shot from FB using Graph API.

preeti04 commented 9 years ago

Example screen shot : sample_fb_comment_data

shivank22 commented 9 years ago

I have written a python code using Facebook-sdk(Graph) to extract posts of user(yourself).

here is the link to download API

http://facebook-sdk.readthedocs.org/en/latest/api.html

type sudo apt-install facebook-sdk or type sudo pip install facebook-sdk

for token generation follow the steps in trailing mail and get user_posts access to run the code graph =

import facebook

from bs4 import BeautifulSoup

token =

facebook.GraphAPI(token)

profile= graph.get_object("100000608439037")

posts = graph.get_connections('me','posts')

print posts

My question is what data we have to extract from facebook ????

On Tue, Apr 28, 2015 at 10:48 PM, durgasarat notifications@github.com wrote:

Hi All, First of all thanks for kalyan sir for taking this initiative. And thanks for all fellow mates for showing interest on this.

So i am thinking to initiate our project. As a part of that i am creating a first issue here.

Gathering Facebook Data is our first issue. The very first thing required to initiate our project is Data. So lets start from there on wards. Please post if there is any thing required before this.

Please put your answers/solutions or ways to get the facebook data.

— Reply to this email directly or view it on GitHub https://github.com/kalyanhadooptraining/facebook/issues/1.

preeti04 commented 9 years ago

Hi ,

Found another easy way to fetch the data (not limited to your post only, yours along with anyone's post) I tried by myself and able to get data very easily. Follow the link : https://www.youtube.com/watch?v=S9kYApoR8U4

So now we have the idea how to fetch data, if anyone can specify type of data (specially for this problem) then we can proceed further and can move to step 2.

chandra4082 commented 9 years ago

hii .. i tried by using youtube link whichi is mentioned by preeti..& got some data in CSV format..thnx preeti.. but above i ve attached data ..just check & tell me that is cotrrect or not.. Q. How can i get jason data?? Q2.What is the nex step so that i can move forward..?? plz help me....thnx..

preeti04 commented 9 years ago

Hi,

Once you get the data next step is filtration of data ie pre-processing of data which means removing unnecessary stuff from data so that processing can be done easily Like :

1) url 2) repetitive characters etc.

I followed these two links to understand the procedure for human sentiment analyses.

http://people.sabanciuniv.edu/berrin/share/LDA/Stanford-NLP-Course-termproject-ssoriajr-kanej.pdf http://researchweb.iiit.ac.in/~ayushi.dalmia/projects/sentimentanalysisintwitter.html

Thanks

chandra4082 commented 7 years ago

Hello Kalyan sir ,

I am trying to connect hive through java code but unable to connect thrift server ,

and java code throwing error.

should i have add any properties in hive-site.xml file for thrift server ?

screen shot

chandra4082 commented 7 years ago

Hello Kalyan sir / all ,

Please help me in this .I am not able run Jdbchive connection code... On Jan 28, 2017 4:35 AM, "Chandrakanta Acharya" chandra4082@gmail.com wrote:

Hello Kalyan sir ,

I am trying to connect hive through java code but unable to connect thrift server ,

and java code throwing error.

should i have add any properties in hive-site.xml file for thrift server ?

screen shot

kalyanhadooptraining commented 7 years ago

no attachment......

On Sat, Jan 28, 2017 at 3:43 PM, chandra4082 notifications@github.com wrote:

Hello Kalyan sir / all ,

Please help me in this .I am not able run Jdbchive connection code... On Jan 28, 2017 4:35 AM, "Chandrakanta Acharya" chandra4082@gmail.com wrote:

Hello Kalyan sir ,

I am trying to connect hive through java code but unable to connect thrift server ,

and java code throwing error.

should i have add any properties in hive-site.xml file for thrift server ?

screen shot

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/kalyanhadooptraining/facebook/issues/1#issuecomment-275839719, or mute the thread https://github.com/notifications/unsubscribe-auth/ALd9Ib8i9dDwJ_zPfUA9TVjThYW-JL5Tks5rWxTIgaJpZM4EK1uZ .

-- Thanks & Regards Kalyan

Follow me on :- Email: kalyanhadooptraining@gmail.com Blog: http://www.kalyanhadooptraining. http://kalyanhadooptraining.blogspot.in/com Web: http://www.bigdatatraininghyderabad.com http://bigdatatraininghyderabad.com/

Youube: https://www.youtube.com/kalyanhadooptraining LinkedIn: https://in.linkedin.com/in/kalyanhadooptraining Facebook: https://www.facebook.com/orienit.hadoop Twitter: https://twitter.com/kalyanhadoop Google+: https://plus.google.com/+KalyanHadoopTraining

chandra4082 commented 7 years ago

hive-0.x command is => hive --service hiveserver hive-1.x command is => hive --service hiveserver2

as per screenshot ... hive service is not started

On Sat, Jan 28, 2017 at 3:43 PM, Chandrakanta Acharya <chandra4082@gmail.com

wrote:

Hello Kalyan sir / all ,

Please help me in this .I am not able run Jdbchive connection code... On Jan 28, 2017 4:35 AM, "Chandrakanta Acharya" chandra4082@gmail.com wrote:

Hello Kalyan sir ,

I am trying to connect hive through java code but unable to connect thrift server ,

and java code throwing error.

should i have add any properties in hive-site.xml file for thrift server ?

screen shot

-- Thanks & Regards Kalyan

Follow me on :- Email: kalyanhadooptraining@gmail.com Blog: http://www.kalyanhadooptraining. http://kalyanhadooptraining.blogspot.in/com Web: http://www.bigdatatraininghyderabad.com http://bigdatatraininghyderabad.com/

Youube: https://www.youtube.com/kalyanhadooptraining LinkedIn: https://in.linkedin.com/in/kalyanhadooptraining Facebook: https://www.facebook.com/orienit.hadoop Twitter: https://twitter.com/kalyanhadoop Google+: https://plus.google.com/+KalyanHadoopTraining

kalyanhadooptraining / facebook