euagendas / m3inference

A deep learning system for demographic inference (gender, age, and individual/person) that was trained on massive Twitter dataset using profile images, screen names, names, and biographies
http://www.euagendas.org
GNU Affero General Public License v3.0
145 stars 57 forks source link

Error:"profile_image_url_https" #33

Closed dishanisen closed 2 years ago

dishanisen commented 2 years ago

I am getting the following error with m3twitter.transform_jsonl() The data has been shared privately with Zijian Wang.

Screenshot 2022-05-13 at 5 56 59 PM
computermacgyver commented 2 years ago

Is your data from the v1.1 or v2 API @dishanisen ?

Currently only data in the v1.1 API format is supported. I think this may duplicate #31 , but would appreciate your confirmation of what version of the API the data came from.

dishanisen commented 2 years ago

Hi,

I have the Academic Twitter API, so I do not exactly know if it's v1 or v2.

On Fri, May 13, 2022 at 11:02 PM Scott Hale @.***> wrote:

Is your data from the v1.1 or v2 API @dishanisen https://github.com/dishanisen ?

Currently only data in the v1.1 API format is supported. I think this may duplicate #31 https://github.com/euagendas/m3inference/issues/31 , but would appreciate your confirmation of what version of the API the data came from.

— Reply to this email directly, view it on GitHub https://github.com/euagendas/m3inference/issues/33#issuecomment-1126507636, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKHIVUV7RXKGKLN2K4W6HTLVJ27NPANCNFSM5V4N4IFA . You are receiving this because you were mentioned.Message ID: @.***>

computermacgyver commented 2 years ago

That is the v2 API. It was released after our project. I hope we'll extend the code to support data from it, but at the moment you would need to manually reform the data to the m3 input format.

I'm going to close this as a duplicate of #31 for now.

computermacgyver commented 2 years ago

Also to clarify, I mean that if you can transform the data to look the the examples in this file https://github.com/euagendas/m3inference/blob/master/test/data.jsonl then it will work. Unfortunately we don't have code to do that right now.