AndyTheFactory / newspaper4k

đź“° Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.
MIT License
422 stars 34 forks source link

Some Links cannot be parsed #472

Closed AndyTheFactory closed 10 months ago

AndyTheFactory commented 10 months ago

Issue by shreshthasarkar Mon Aug 10 07:02:54 2020 Originally opened as https://github.com/codelucas/newspaper/issues/832


These however can be easily parsed by s normal beautiful soup and getting the text from p tags.

Example :

https://www.forbes.com/sites/jimwang/2020/08/09/could-you-get-a-second-stimulus-check-by-executive-order/#26adba60433a

AndyTheFactory commented 10 months ago

Comment by bharath-kumarn Wed Mar 24 13:41:51 2021


Its working fine

see below data

{ "newspaper_data": { "article_meta_data": { "apple-itunes-app": "app-id=588647136", "article": { "author": "Jim Wang", "channel": "Money", "id": "blogAndPostId/blog/post/7444-5f2fe801c87fcb00069be0e1", "modified": "2020-12-15", "published": "2020-08-09", "publisher": "https://www.facebook.com/forbes", "section": "Personal Finance", "section_url": "https://www.forbes.com/personal-finance/" }, "author": "Jim Wang", "description": "Could President Trump issue stimulus checks by executive order?", "fb": { "app_id": 123694841080850 }, "og": { "description": "Could President Trump issue stimulus checks by executive order?", "image": "https://thumbor.forbes.com/thumbor/fit-in/1200x0/filters%3Aformat%28jpg%29/https%3A%2F%2Fspecials-images.forbesimg.com%2Fimageserve%2F5f2feff799a631f3b202e6c1%2F0x0.jpg", "site_name": "Forbes", "title": "Could You Get A Second Stimulus Check By Executive Order?", "type": "article", "updated_time": "2020-12-15T01:45:27.019-05:00", "url": "https://www.forbes.com/sites/jimwang/2020/08/09/could-you-get-a-second-stimulus-check-by-executive-order/" }, "referrer": "no-referrer-when-downgrade", "robots": "max-image-preview:large", "twitter": { "card": "summary_large_image", "creator": "@WalletHacks", "description": "Could President Trump issue stimulus checks by executive order?", "image": "https://thumbor.forbes.com/thumbor/fit-in/1200x0/filters%3Aformat%28jpg%29/https%3A%2F%2Fspecials-images.forbesimg.com%2Fimageserve%2F5f2feff799a631f3b202e6c1%2F0x0.jpg", "site": "@forbes", "title": "Could You Get A Second Stimulus Check By Executive Order?" }, "viewport": "width=device-width,initial-scale=1,maximum-scale=5,minimum-scale=1,user-scalable=yes" }, "article_text_description": "US President Donald Trump signs executive orders extending coronavirus economic relief, during a ... [+] news conference in Bedminster, New Jersey, on August 8, 2020. (Photo by JIM WATSON / AFP) (Photo by JIM WATSON/AFP via Getty Images) AFP via Getty Images\n\nYou may have heard that President Trump signed a series of executive orders yesterday and wondering if a second stimulus check was one of them.\n\nTechnically, it wasn't.\n\nHe signed one executive order and three executive memorandums covering additional unemployment insurance benefits, a payroll tax holiday, student loan forbearance, and an eviction moratorium.\n\nThe payroll tax holiday would let working Americans keep more of their paychecks but it was not a lump-sum $1,200 stimulus check.\n\nBut this led to many wondering - is it possible that he could sign an order issuing a second stimulus check?\n\nNo, but the payroll tax holiday is the closest thing he could do. I’ll explain why.\n\nPresident Trump, during the news conference, referred to the executive orders as \"acts\" but executive orders and memorandums are not laws. A \"bill\" that is passed into law is called an \"act\" but executive orders are not \"acts.\"\n\nThey are more like official instructions.\n\nArticle II of the Constitution gives the President the authority to run the Executive Branch and two of the tools at his disposal are executive orders and memorandums.\n\nMORE FROM FORBES Where's The Second $1,200 Stimulus Check?\n\nDoes this mean he could just instruct the Treasury Department to pay everyone a second stimulus check?\n\nNo, because every executive order can be challenged in a court of law and there are numerous ways an instruction like this would be challenged. If you recall, President Trump instituted a travel ban in 2017 through executive order and was immediately challenged. The orders he signed yesterday are almost guaranteed to face this type of scrutiny in the coming weeks.\n\nThe quickest way to challenge it, and a reason why such an executive order would never get signed in the first place, is none other than Article 1 Section 9 Clause 7 of the Constitution - “No money shall be drawn from the Treasury but in Consequence of Appropriations made by Law.”\n\nThe first $1,200 stimulus check, created by the Cares Act, was an advance on a newly-created refundable tax credit. The Cares Act did this by amending existing tax law, specifically the Internal Revenue Code of 1986.\n\nThe United States Constitution, in Article I, Section 8, gives Congress the power to \"lay and collect taxes, duties, imposts and excises, to pay the debts and provide for the common defense and general welfare of the United States.\" This is known as the Taxing and Spending Clause of the Constitution and it grants Congress, not the President, the authority over taxes.\n\nAny executive order that encroached on this authority would be challenged in court. So, the President can’t simply order the Treasury to issue checks and cannot change tax law unilaterally.\n\nThis is one possible reason that yesterday’s “Memorandum on Deferring Payroll Tax Obligations in Light of the Ongoing COVID-19 Disaster” was structured not as a waiver of payroll tax but a “deferring” of payroll tax.\n\nI see the payroll tax as the President’s attempt to create a stimulus check in the only way he can - by deferring the collection of payroll taxes.\n\nMORE FROM FORBES How Trump's Payroll Tax Holiday Might Work\n\nThe memorandum instructs the Secretary of the Treasury to “defer the withholding, deposit, and payment of the [payroll] tax” from September 1st, 2020 through December 31st, 2020. This applied to employees who earn less than $4,000 every two weeks or its equivalent.\n\nIf you notice the language, it’s very specific.\n\nAdditionally, he’s instructing the Secretary of the Treasury to “explore avenues, including legislation, to eliminate the obligation to pay the taxes deferred pursuant to the implementation of this memorandum.”\n\nHe hasn’t changed or challenged the payroll tax - he’s just told the Treasury Department to stop collecting it for a little while.\n\nIf you recall, President Obama also had a payroll tax cut as a means of economic stimulus back in 2012. But in his case, he did so by signing The Middle Class Tax Relief and Job Creation Act of 2012 and not by executive order. Congress was involved in that payroll tax cut, whereas they were not involved in Trump’s order.\n\nSo, if you are waiting on a second stimulus check, the only way you’ll see one is whenever Congress is able to come to an agreement and pass the next stimulus package.\n\nAdditional Resources", "authors": [ "Jim Wang", "Kelly Anne Smith", "Forbes Staff", "Lisa Rowan" ], "description_length": 4585, "nlp_keywords": [ "challenged", "orders", "president", "payroll", "check", "second", "tax", "stimulus", "treasury", "order", "executive" ], "publish_date": "Sun, 09 Aug 2020 00:00:00 GMT", "summary": "He signed one executive order and three executive memorandums covering additional unemployment insurance benefits, a payroll tax holiday, student loan forbearance, and an eviction moratorium.\nBut this led to many wondering - is it possible that he could sign an order issuing a second stimulus check?\nPresident Trump, during the news conference, referred to the executive orders as \"acts\" but executive orders and memorandums are not laws.\nThis is one possible reason that yesterday’s “Memorandum on Deferring Payroll Tax Obligations in Light of the Ongoing COVID-19 Disaster” was structured not as a waiver of payroll tax but a “deferring” of payroll tax.\nSo, if you are waiting on a second stimulus check, the only way you’ll see one is whenever Congress is able to come to an agreement and pass the next stimulus package.", "title": "Could You Get A Second Stimulus Check By Executive Order?", "title_length": 57, "url": "https://www.forbes.com/sites/jimwang/2020/08/09/could-you-get-a-second-stimulus-check-by-executive-order/?sh=36c7d6fa433a" } }

AndyTheFactory commented 10 months ago

works, tested v0.9.2