moda20 / facebook-scraper

Scrape Facebook public pages without an API key
MIT License
78 stars 28 forks source link

poste['time'] Incorrect #6

Closed aymen-ch closed 8 months ago

aymen-ch commented 10 months ago

@moda20 Why is the post time incorrect?

basheerpaliyathu commented 9 months ago

i think the time zone is UTC

moda20 commented 9 months ago

@aymen-ch please give an executable example and your output, and an explanation of your issue so that we can help you

Cartasiane commented 9 months ago

Still with the same script:

import json
from facebook_scraper import get_posts
from datetime import datetime

def datetime_serializer(o):
    if isinstance(o, datetime):
        return o.isoformat()
    raise TypeError("Type not serializable")

all_posts = []

for post in get_posts(group='890901752414740', base_url="https://mbasic.facebook.com/groups", 
                      start_url="https://mbasic.facebook.com/groups/890901752414740?v=timeline", 
                      pages=3, cookies="cookies.txt"):
    all_posts.append(post)

print(json.dumps(all_posts, default=datetime_serializer, indent=4))

Most of the times are wrong (Nothing about timezone):


[
    {
        "post_id": "893656292139286",
        "text": "test\n\ntest",
        "post_text": "test\n\ntest",
        "shared_text": "",
        "original_text": null,
        "time": "2023-12-16T23:53:00",
        "timestamp": null,
        "image": null,
        "image_lowquality": null,
        "images": [],
        "images_description": [],
        "images_lowquality": [],
        "images_lowquality_description": [],
        "video": null,
        "video_duration_seconds": null,
        "video_height": null,
        "video_id": null,
        "video_quality": null,
        "video_size_MB": null,
        "video_thumbnail": null,
        "video_watches": null,
        "video_width": null,
        "likes": null,
        "comments": 0,
        "shares": 0,
        "post_url": null,
        "link": null,
        "links": [],
        "user_id": null,
        "username": "Gilbert Gerber",
        "user_url": "https://facebook.com/gilbert.rochat.165?eav=AfbL2-wlcwUZJzeDH9athC4tuOK6ZglUxHuSYeZsdU_qvay91ari2hW-ps0Z1BexHl0&refid=18&_ft_=encrypted_tracking_data.0AY_GsPrkuCT85zv3otriRAiIR_wsJloeQzmuAsxyekeYhtd-Ay_MGSxo6v7o96D_hifPmxffvbhBcV6jOh5_xrhgBcqZ9aM1pj0zFNYfsXqToPI3DqEr9Y9BC6KL_tSGETkAcSfAXdoSNQiregVBakwmdBsL7fPTQ0Be1qYGFVjlq5P7rLAwSa-SLlC8Uof7Nc0O72LMwko297dpflLkJewzZqxYo5Gfq9Q0lTs9YZ4tdjITDzkm8Uq2DxQSzzrF1qdNdvtNzljjxKPRW3XrjLwmaY6MBdYzg5Th9gBYQv4gBj39gzEDmYrXT5V_3foks3JyigjB753ejuEJDAFxTYEsfIly2ZG64RrWaeJitEX11Gue5Hh3B0XU-rYvZzs5OLo6PDDGxbG0HxTg-F8J1zbQ4fjjBCbU9J8wfi1pkN0MAfFifKVSR4ibLof8B5nHa0X49hFZkglyCDynLQap2HjkHrND7edyx3kiVK0Ukfci2YL6-GAqatxqVzOnw-qv-Iq1bivKAj5hH1gpfyKK3gUZlm7NyotUzAepb0NW1RL5K8WTy20cr8RpesWsa_6oHi0-J2yrUBMMEU_CwX8sLlSXz_ca2kPLX7IEGxX3xXCHoCsUwjyMd4OmVakoPOqDhbEx_UdllgSDpt3xlVdvK5mu14c9c5NYE26s5RLX41F5Smi25A1G70ioo4KotWSzNvRYfUltIQFXjEDkRv9NyAhwZb9zvmNLNKEcYJyLa7uwf0p1jD1O7KRIbsLSJwlcLaAPYRpQCHOhCE_4Yqnbf7YQGbScIqRCunZiObMtGGGYGOdbgbdeI0YW0Uo3ze-ij46JOJPNS1fBoNfkeZpQDccJXE7LooEVIyeEvrhBQkEUXDhrvZ6EedGp29171p0ri7zKcGvQlyAagosiIrd5E7YsRnPj1L67lbADd91rj1wpHoctr-gYjg&__tn__=C-R&paipv=0",
        "is_live": false,
        "factcheck": null,
        "shared_post_id": null,
        "shared_time": null,
        "shared_user_id": null,
        "shared_username": null,
        "shared_user_url": null,
        "shared_post_url": null,
        "available": true,
        "comments_full": null,
        "reactors": null,
        "w3_fb_url": null,
        "reactions": null,
        "reaction_count": null,
        "with": [
            {
                "name": "nalah is god",
                "link": "https://mbasic.facebook.com/groups/890901752414740/?refid=18&_ft_=encrypted_tracking_data.0AY_GsPrkuCT85zv3otriRAiIR_wsJloeQzmuAsxyekeYhtd-Ay_MGSxo6v7o96D_hifPmxffvbhBcV6jOh5_xrhgBcqZ9aM1pj0zFNYfsXqToPI3DqEr9Y9BC6KL_tSGETkAcSfAXdoSNQiregVBakwmdBsL7fPTQ0Be1qYGFVjlq5P7rLAwSa-SLlC8Uof7Nc0O72LMwko297dpflLkJewzZqxYo5Gfq9Q0lTs9YZ4tdjITDzkm8Uq2DxQSzzrF1qdNdvtNzljjxKPRW3XrjLwmaY6MBdYzg5Th9gBYQv4gBj39gzEDmYrXT5V_3foks3JyigjB753ejuEJDAFxTYEsfIly2ZG64RrWaeJitEX11Gue5Hh3B0XU-rYvZzs5OLo6PDDGxbG0HxTg-F8J1zbQ4fjjBCbU9J8wfi1pkN0MAfFifKVSR4ibLof8B5nHa0X49hFZkglyCDynLQap2HjkHrND7edyx3kiVK0Ukfci2YL6-GAqatxqVzOnw-qv-Iq1bivKAj5hH1gpfyKK3gUZlm7NyotUzAepb0NW1RL5K8WTy20cr8RpesWsa_6oHi0-J2yrUBMMEU_CwX8sLlSXz_ca2kPLX7IEGxX3xXCHoCsUwjyMd4OmVakoPOqDhbEx_UdllgSDpt3xlVdvK5mu14c9c5NYE26s5RLX41F5Smi25A1G70ioo4KotWSzNvRYfUltIQFXjEDkRv9NyAhwZb9zvmNLNKEcYJyLa7uwf0p1jD1O7KRIbsLSJwlcLaAPYRpQCHOhCE_4Yqnbf7YQGbScIqRCunZiObMtGGGYGOdbgbdeI0YW0Uo3ze-ij46JOJPNS1fBoNfkeZpQDccJXE7LooEVIyeEvrhBQkEUXDhrvZ6EedGp29171p0ri7zKcGvQlyAagosiIrd5E7YsRnPj1L67lbADd91rj1wpHoctr-gYjg&__tn__=C-R&paipv=0&eav=Afa7To_rXeUidI0M4MPavNmgyII6h506ghyjektiHCaQmOB7NywniUPG9S3yezqBefk"
            }
        ],
        "page_id": null,
        "sharers": null,
        "translated_text": "",
        "image_id": null,
        "image_ids": [],
        "was_live": false,
        "header": "Gilbert Gerber > \u200enalah is god"
    },
    {
        "post_id": "893131828858399",
        "text": "How are you today my fellow dev?\n\nHow are you today my fellow dev?",
        "post_text": "How are you today my fellow dev?\n\nHow are you today my fellow dev?",
        "shared_text": "",
        "original_text": null,
        "time": "2023-12-16T02:00:00",
        "timestamp": null,
        "image": null,
        "image_lowquality": null,
        "images": [],
        "images_description": [],
        "images_lowquality": [],
        "images_lowquality_description": [],
        "video": null,
        "video_duration_seconds": null,
        "video_height": null,
        "video_id": null,
        "video_quality": null,
        "video_size_MB": null,
        "video_thumbnail": null,
        "video_watches": null,
        "video_width": null,
        "likes": null,
        "comments": 0,
        "shares": 0,
        "post_url": null,
        "link": null,
        "links": [],
        "user_id": null,
        "username": "Gilbert Gerber",
        "user_url": "https://facebook.com/gilbert.rochat.165?eav=AfbL2-wlcwUZJzeDH9athC4tuOK6ZglUxHuSYeZsdU_qvay91ari2hW-ps0Z1BexHl0&refid=18&_ft_=encrypted_tracking_data.0AY-CrfeIVC4j8m_9T1Ln9FZ33Mh79RUAAcylnUT6_8paQ7tl1jdatKHtCdgP2F6O-1Zwwc76LouC_irr6bEWCFB45f810LOBcWU_NabxHYNg__V8iYHUHOk1dmtsljD-lS7W5cJDGB4Hen35t-RHJROmTJcBJFx2MIqSUrTHFj4USDnSfeKcNjzSBa6G95BpKMrgNLzllt5wXi_yLVwZJfiCdTcmR0u6Qh1EY8oeJDeai7qjJgG0MDumlkCv4ZdIE60OaZSnDB6bCDAZCoS-I9NPbc0Qa3PjUef1USjzYbwFUhmFTAM4SL_4jQa-uVghxj7B245gFt9eHptYSh1YsYBMuQHEGwQqm8WWpQ3V9Zaap3YSXF5ESyQ7xC0IazO-HtmWxb6AKB1i9VzF492op6bVTWS29qgd0mB9VJhDEdGRv2H8_rxzDiEEE3T7rmBzkWM7-_zJ3jse50k2av-85tzptBniRZ8AVHp8kIjEvuKg3dlKv4fHSf6wosnkdVGsM4-qrQut3pIWeN_2teZsgOoKzrT81TM1Ex3ZPbd0Z8M5HNQqTxiul0LILKS-LJG0BziucUWiHwnWgM09hN6Ffz_S4qEHhigJ3ul3AT6R3GQr-Tun3-UGa9Rdy_ggmXCZCqlENVX90JIM1FQoabLKQTcMpPrPCsdDy_kkQD6D1hr07_gIRgC6vW_kKQ0km6U6w_ruA_MzN-T06MS2VCfvd8IrSX8iRklVQhYBCnvpIog9In-uwk8TePfUg48lqQ_bjCY0XEZHVJPBsYK5lzg_Gkt38KbjMljb9CMhBlUe8PifeZMC2CFKEqi8TtkzRDORg_Dr9hFtqD_poHJQK_GP9yrSNjSlAMBi4Z4wwVNutOlKbcPIBrJytv_rVvxiDzS09s-7GxvuUwLFEQ7Lwt1xD31dKagpbRhoCkkX17Um6OtHSNhIOKstrg&__tn__=C-R&paipv=0",
        "is_live": false,
        "factcheck": null,
        "shared_post_id": null,
        "shared_time": null,
        "shared_user_id": null,
        "shared_username": null,
        "shared_user_url": null,
        "shared_post_url": null,
        "available": true,
        "comments_full": null,
        "reactors": null,
        "w3_fb_url": null,
        "reactions": null,
        "reaction_count": null,
        "with": [
            {
                "name": "nalah is god",
                "link": "https://mbasic.facebook.com/groups/890901752414740/?refid=18&_ft_=encrypted_tracking_data.0AY-CrfeIVC4j8m_9T1Ln9FZ33Mh79RUAAcylnUT6_8paQ7tl1jdatKHtCdgP2F6O-1Zwwc76LouC_irr6bEWCFB45f810LOBcWU_NabxHYNg__V8iYHUHOk1dmtsljD-lS7W5cJDGB4Hen35t-RHJROmTJcBJFx2MIqSUrTHFj4USDnSfeKcNjzSBa6G95BpKMrgNLzllt5wXi_yLVwZJfiCdTcmR0u6Qh1EY8oeJDeai7qjJgG0MDumlkCv4ZdIE60OaZSnDB6bCDAZCoS-I9NPbc0Qa3PjUef1USjzYbwFUhmFTAM4SL_4jQa-uVghxj7B245gFt9eHptYSh1YsYBMuQHEGwQqm8WWpQ3V9Zaap3YSXF5ESyQ7xC0IazO-HtmWxb6AKB1i9VzF492op6bVTWS29qgd0mB9VJhDEdGRv2H8_rxzDiEEE3T7rmBzkWM7-_zJ3jse50k2av-85tzptBniRZ8AVHp8kIjEvuKg3dlKv4fHSf6wosnkdVGsM4-qrQut3pIWeN_2teZsgOoKzrT81TM1Ex3ZPbd0Z8M5HNQqTxiul0LILKS-LJG0BziucUWiHwnWgM09hN6Ffz_S4qEHhigJ3ul3AT6R3GQr-Tun3-UGa9Rdy_ggmXCZCqlENVX90JIM1FQoabLKQTcMpPrPCsdDy_kkQD6D1hr07_gIRgC6vW_kKQ0km6U6w_ruA_MzN-T06MS2VCfvd8IrSX8iRklVQhYBCnvpIog9In-uwk8TePfUg48lqQ_bjCY0XEZHVJPBsYK5lzg_Gkt38KbjMljb9CMhBlUe8PifeZMC2CFKEqi8TtkzRDORg_Dr9hFtqD_poHJQK_GP9yrSNjSlAMBi4Z4wwVNutOlKbcPIBrJytv_rVvxiDzS09s-7GxvuUwLFEQ7Lwt1xD31dKagpbRhoCkkX17Um6OtHSNhIOKstrg&__tn__=C-R&paipv=0&eav=AfajVATq-_z4W_meJ3MKftmHuqcvEGOVLWyDpwAWRYdgPOFXWabg_7QpXC6qNM56X1c"
            }
        ],
        "page_id": null,
        "sharers": null,
        "translated_text": "",
        "image_id": null,
        "image_ids": [],
        "was_live": false,
        "header": "Gilbert Gerber > \u200enalah is god"
    },
    {
        "post_id": "890902099081372",
        "text": "I'm a sad cake",
        "post_text": "I'm a sad cake",
        "shared_text": "",
        "original_text": null,
        "time": "2023-12-12T21:36:00",
        "timestamp": null,
        "image": null,
        "image_lowquality": "https://scontent-zrh1-1.xx.fbcdn.net/m1/v/t6/An_awEcP5a-VJkiSKC4SklmLyo8p7Q3iP5vL6HDsa_ZTJdFfRRdtUFNJfr9LXPYfMhVSkFk4hqLRcj3zU9hTsyzpPGIc4jC3fiqwidCEo8AGZ4Rq.png?ccb=10-5&oh=00_AfBCFHExAYMUyyFG7SmbhjI4MuVhiFbBGuTjVCzX85I5Sg&oe=65A6B692&_nc_sid=7da55a",
        "images": [],
        "images_description": [],
        "images_lowquality": [
            "https://scontent-zrh1-1.xx.fbcdn.net/m1/v/t6/An_awEcP5a-VJkiSKC4SklmLyo8p7Q3iP5vL6HDsa_ZTJdFfRRdtUFNJfr9LXPYfMhVSkFk4hqLRcj3zU9hTsyzpPGIc4jC3fiqwidCEo8AGZ4Rq.png?ccb=10-5&oh=00_AfBCFHExAYMUyyFG7SmbhjI4MuVhiFbBGuTjVCzX85I5Sg&oe=65A6B692&_nc_sid=7da55a"
        ],
        "images_lowquality_description": [
            null
        ],
        "video": null,
        "video_duration_seconds": null,
        "video_height": null,
        "video_id": null,
        "video_quality": null,
        "video_size_MB": null,
        "video_thumbnail": null,
        "video_watches": null,
        "video_width": null,
        "likes": 1,
        "comments": 0,
        "shares": 0,
        "post_url": null,
        "link": null,
        "links": [],
        "user_id": null,
        "username": "Gilbert Gerber",
        "user_url": "https://facebook.com/gilbert.rochat.165?eav=AfbL2-wlcwUZJzeDH9athC4tuOK6ZglUxHuSYeZsdU_qvay91ari2hW-ps0Z1BexHl0&refid=18&_ft_=encrypted_tracking_data.0AY_Tnz8JmyP13RUyZI6pJSs4XUPs98MlDF7Egn_oTvMHulrzRc3cwsQweA8sO3WwSmQrvM7Cr5xHwRjQqUho-wwilzgbi0yWyinLfFSUlZg-6DV-ruyTORIr2p8llSPwIWZnDSKmqG18Pnf2vH0a9-zDwZZbQqEVVDnZLDSa2_zsgAz61cBW4vbP--N-_70DI26_et5WeiFb6eMOU2xisyoUqKzgSOqiO_cBOJ-a-Qtj0l9WRRkZVIHs97RkUSzHyYH_UXHaPvlmM0QJDzWUzZX6DLeivBOej0_ChJbRVRO9Oykn8zHvfvo24UD-87JK9InI9vjLQj0mInQec4BcONYVzH6IILNu4vP5Qwlr3jRNx_QUnB0hz1P6xqT24Pyj9Zcu94dFIw3ewMPwISOo79HMtO9GDqyuN7U7qkvcyOuXdz_L_nbj6r_kZ4IgklNXKDDqn-fPmMRU98QpUTDhGJ302TdgS6DcwbxSok7E_1lvRs7LJkyVgS9m0U_xlhcZie1bo5yjVeGEiqNLM2Eq7h-fU566wPxtFJKYSHmU8roMQ952PwNuboaAeHAu7DOamWZwubv2OXGYsX5X6VIIdmjsKcLciZ52pe5a0KRbaTvX9BcFD37H5pjnO-MOYaW2nI5MXIMs3t7PQeXX2g_yFlAkwRhivVGSRFOcEleOGD7qKrhJobmsLQK3RYfmBGAe6FRyncMsirYh8tQ6xE0p_CsdgUj4CiuXBKvTtB7xpe2Z0OC5aUB_AV-7xK0Zk-0KuYjO0Yp7D1FI8E_SnorZ7K29bhFcyxnvHXc8rFyGeWf63bFgPDshICu_wMcOVQbYT_Oa0T0E7oiLJcH5zfGjGyDpqvmAMcStzB-lO0j59lGOQ41HLScbN2UkoqU8rkb-j6tl5mx1S7eZEgzMwZC3OJIzbQp-T_uvdgEyFhprF6D1X-TA9XIDA0Fd97jS_q0RkZPqUZirxNRYUKCR77HKdZAtt9ZN4QJbf0o-Fw&__tn__=C-R&paipv=0",
        "is_live": false,
        "factcheck": null,
        "shared_post_id": null,
        "shared_time": null,
        "shared_user_id": null,
        "shared_username": null,
        "shared_user_url": null,
        "shared_post_url": null,
        "available": true,
        "comments_full": null,
        "reactors": null,
        "w3_fb_url": null,
        "reactions": null,
        "reaction_count": 1,
        "with": [
            {
                "name": "nalah is god",
                "link": "https://mbasic.facebook.com/groups/890901752414740/?refid=18&_ft_=encrypted_tracking_data.0AY_Tnz8JmyP13RUyZI6pJSs4XUPs98MlDF7Egn_oTvMHulrzRc3cwsQweA8sO3WwSmQrvM7Cr5xHwRjQqUho-wwilzgbi0yWyinLfFSUlZg-6DV-ruyTORIr2p8llSPwIWZnDSKmqG18Pnf2vH0a9-zDwZZbQqEVVDnZLDSa2_zsgAz61cBW4vbP--N-_70DI26_et5WeiFb6eMOU2xisyoUqKzgSOqiO_cBOJ-a-Qtj0l9WRRkZVIHs97RkUSzHyYH_UXHaPvlmM0QJDzWUzZX6DLeivBOej0_ChJbRVRO9Oykn8zHvfvo24UD-87JK9InI9vjLQj0mInQec4BcONYVzH6IILNu4vP5Qwlr3jRNx_QUnB0hz1P6xqT24Pyj9Zcu94dFIw3ewMPwISOo79HMtO9GDqyuN7U7qkvcyOuXdz_L_nbj6r_kZ4IgklNXKDDqn-fPmMRU98QpUTDhGJ302TdgS6DcwbxSok7E_1lvRs7LJkyVgS9m0U_xlhcZie1bo5yjVeGEiqNLM2Eq7h-fU566wPxtFJKYSHmU8roMQ952PwNuboaAeHAu7DOamWZwubv2OXGYsX5X6VIIdmjsKcLciZ52pe5a0KRbaTvX9BcFD37H5pjnO-MOYaW2nI5MXIMs3t7PQeXX2g_yFlAkwRhivVGSRFOcEleOGD7qKrhJobmsLQK3RYfmBGAe6FRyncMsirYh8tQ6xE0p_CsdgUj4CiuXBKvTtB7xpe2Z0OC5aUB_AV-7xK0Zk-0KuYjO0Yp7D1FI8E_SnorZ7K29bhFcyxnvHXc8rFyGeWf63bFgPDshICu_wMcOVQbYT_Oa0T0E7oiLJcH5zfGjGyDpqvmAMcStzB-lO0j59lGOQ41HLScbN2UkoqU8rkb-j6tl5mx1S7eZEgzMwZC3OJIzbQp-T_uvdgEyFhprF6D1X-TA9XIDA0Fd97jS_q0RkZPqUZirxNRYUKCR77HKdZAtt9ZN4QJbf0o-Fw&__tn__=C-R&paipv=0&eav=AfZzBX7pcy5KunDfeSgFwf-MxCfFFnR_8uYckZyORsJ6LCLERMZw_5cFQd4IqL7TmaI"
            }
        ],
        "page_id": null,
        "sharers": null,
        "translated_text": "",
        "image_id": null,
        "image_ids": [],
        "was_live": false,
        "header": "Gilbert Gerber > \u200enalah is god"
    },
    {
        "post_id": "890901879081394",
        "text": "",
        "post_text": "",
        "shared_text": "",
        "original_text": null,
        "time": "2023-12-12T21:36:00",
        "timestamp": null,
        "image": null,
        "image_lowquality": null,
        "images": [],
        "images_description": [],
        "images_lowquality": [],
        "images_lowquality_description": [],
        "video": null,
        "video_duration_seconds": null,
        "video_height": null,
        "video_id": null,
        "video_quality": null,
        "video_size_MB": null,
        "video_thumbnail": null,
        "video_watches": null,
        "video_width": null,
        "likes": null,
        "comments": 0,
        "shares": 0,
        "post_url": null,
        "link": null,
        "links": [],
        "user_id": null,
        "username": "Gilbert Gerber",
        "user_url": "https://facebook.com/gilbert.rochat.165?eav=AfZKRuKtF9GMBrG7shzCwCg634BAt0mnTcLodsTPuPQwSxHhxSSkj5Ey_MBsTnW3F7o&refid=18&_ft_=encrypted_tracking_data.0AY9SC2uKy4KWTJu_-Ctyw0ZnXxeRASADvjpXp6TbOWDnodUaWAihn3kXTwIkEmmEN0ieE31xQ_HsBctqyr7NZ4tqkL5yQr9-OfUwxPtUqyVi9Nzd6SoMcL7vpn8PEQsFFmY-zigKzGxb2-mr2EQs9fgf8TZcd42qvjRCzJUlM31OR4Oz5wmkt_IyG7yMmU33kTxD5fe17NHJ4b0jsKQkeN6UwrOd0n_vIVKGLh2kLvZ2hiCCG_7tXNeFtLzDf_Ry8EKhFD2HwwrkR3dQteBnO6xDLEVNmqa2wl4VBjlQdNh-YCB_h-w2NyfJzEErx-jXuXm-D-jlPJviLhU99RjSgl6LpB-ogIHVRdErprzbQANeU1m4_x0lAZ4alohUbgVzMwKsxdbhYm_wON4nqi55hrj9hgIeKbbhc3ipf25ImmS6lrSRj8h1lKHg-GioC7iasjyWtVnSfjRz4gchmfpqCUE10-3KHOeuwAqVS6AbwQ58vi5ebsou-iJCGUfASw5q41bbSBc4jiwMffclGHk_71-n6l-3FHZC_TjNpkJ6A-fJeLnL2I8jBVqQYYCZhxQfmQ7NJPmaGU225Rr9QGYXtOhoHDmuFO18xQs7HVL8PN_0VA5DALBm3CsFlQr3eQ7x7QwPHXw-gIprew4eYCAEvlugRGMqJELdSGnCSb-nATKZ41CktKqVg9j_YjGU2LZ9QsAZ6HSUBHbT_2MIyZUSx-ePyJNV4AFawcs-TkaRDKM8XW8lgV3p7zI5lTfiglAiJKB0f2KCY00aiN5QHc6-zuZAygPLwACQr-zmzO8nDh7M6pf3BvAjONh3Nz7-LhCvib_zjBWK-xxibUqBwvGOI6kaJoczbIuGugN_eUG28T7W4q8SBu13Z7-V3V8Dbepmhc3jy_hIugYGSuVglRxmq4KYFzLV-_1NKb07MKP5ONsPlyyXCrc&__tn__=C-R&paipv=0",
        "is_live": false,
        "factcheck": null,
        "shared_post_id": null,
        "shared_time": null,
        "shared_user_id": null,
        "shared_username": null,
        "shared_user_url": null,
        "shared_post_url": null,
        "available": true,
        "comments_full": null,
        "reactors": null,
        "w3_fb_url": null,
        "reactions": null,
        "reaction_count": null,
        "with": [
            {
                "name": "nalah is god",
                "link": "https://mbasic.facebook.com/groups/890901752414740/?refid=18&_ft_=encrypted_tracking_data.0AY9SC2uKy4KWTJu_-Ctyw0ZnXxeRASADvjpXp6TbOWDnodUaWAihn3kXTwIkEmmEN0ieE31xQ_HsBctqyr7NZ4tqkL5yQr9-OfUwxPtUqyVi9Nzd6SoMcL7vpn8PEQsFFmY-zigKzGxb2-mr2EQs9fgf8TZcd42qvjRCzJUlM31OR4Oz5wmkt_IyG7yMmU33kTxD5fe17NHJ4b0jsKQkeN6UwrOd0n_vIVKGLh2kLvZ2hiCCG_7tXNeFtLzDf_Ry8EKhFD2HwwrkR3dQteBnO6xDLEVNmqa2wl4VBjlQdNh-YCB_h-w2NyfJzEErx-jXuXm-D-jlPJviLhU99RjSgl6LpB-ogIHVRdErprzbQANeU1m4_x0lAZ4alohUbgVzMwKsxdbhYm_wON4nqi55hrj9hgIeKbbhc3ipf25ImmS6lrSRj8h1lKHg-GioC7iasjyWtVnSfjRz4gchmfpqCUE10-3KHOeuwAqVS6AbwQ58vi5ebsou-iJCGUfASw5q41bbSBc4jiwMffclGHk_71-n6l-3FHZC_TjNpkJ6A-fJeLnL2I8jBVqQYYCZhxQfmQ7NJPmaGU225Rr9QGYXtOhoHDmuFO18xQs7HVL8PN_0VA5DALBm3CsFlQr3eQ7x7QwPHXw-gIprew4eYCAEvlugRGMqJELdSGnCSb-nATKZ41CktKqVg9j_YjGU2LZ9QsAZ6HSUBHbT_2MIyZUSx-ePyJNV4AFawcs-TkaRDKM8XW8lgV3p7zI5lTfiglAiJKB0f2KCY00aiN5QHc6-zuZAygPLwACQr-zmzO8nDh7M6pf3BvAjONh3Nz7-LhCvib_zjBWK-xxibUqBwvGOI6kaJoczbIuGugN_eUG28T7W4q8SBu13Z7-V3V8Dbepmhc3jy_hIugYGSuVglRxmq4KYFzLV-_1NKb07MKP5ONsPlyyXCrc&__tn__=C-R&paipv=0&eav=AfZN2I6NeaeoOCDcPtDqCxiMbTdxDBYrm9FSkCeclgG3DPSkadu1VSfZqdrB6WOQ-j8"
            }
        ],
        "page_id": null,
        "sharers": null,
        "translated_text": "",
        "image_id": null,
        "image_ids": [],
        "was_live": false,
        "header": "Gilbert Gerber created the group nalah is god."
    }]
526319491 commented 9 months ago

Is it like this? When I collect posts that have just been posted, this situation occurs. In 'extractors.py', the 'date_element.text' ,The return value is similar to '2 jam' 。 Then, This sentence of code “date = utils.parse_datetime(date_element.text, search=False)”。Unable to return the correct value 。 I use openAi to solove it。 (I am using translation software and I don't know if you can understand it) Snipaste_2023-12-18_09-48-24

moda20 commented 9 months ago

@526319491 again, this is still an issue with your locale, being in chinese ( i assume ), Can you use the group example above and show me, in a screenshot, how does the page look to you. For me the time is exactly correct if it is an issue i think we should create different processes based on different locales

moda20 commented 8 months ago

@526319491 i am closing this issue, but i would accept a PR to add the custom date_element extraction and we can discuss the update there