wcgray / Untagger

Removal and full text extraction of HTML in Swift inspired by Boilerpipe
MIT License
44 stars 3 forks source link

Edge case bug #1

Closed tetron432 closed 3 years ago

tetron432 commented 5 years ago

Untagger would sometimes give both the main text and some of the code in the HTML in some articles in CNN.

Example: https://www.cnn.com/2019/07/25/us/colorado-missing-girl-remains-found-after-34-years/index.html

Output:

Article body: By Allen Kim , CNN Updated 7:42 PM ET, Thu July 25, 2019 Chat with us in Facebook Messenger. Find out what's happening in the world as it unfolds. ');$vidEndSlate.removeClass('videoend-slate--inactive').addClass('videoend-slate--active');}};CNN.autoPlayVideoExist = (CNN.autoPlayVideoExist === true) ? true : false;var configObj = {thumb: 'none',video: 'us/2017/12/16/lorenzen-wright-slaying-wife-charged-nr.cnn',width: '100%',height: '100%',section: 'domestic',profile: 'expansion',network: 'cnn',markupId: 'large-media_0',adsection: 'const-article-carousel-pagetop',frameWidth: '100%',frameHeight: '100%',posterImageOverride: {"mini":{"width":220,"type":"jpg","uri":"//cdn.cnn.com/cnnnext/dam/assets/171216122101-sherra-wright-robinson-billy-ray-turner-mugshot-split-small-169.jpg","height":124},"xsmall":{"width":307,"type":"jpg","uri":"//cdn.cnn.com/cnnnext/dam/assets/171216122101-sherra-wright-robinson-billy-ray-turner-mugshot-split-medium-plus-169.jpg","height":173},"small":{"width":460,"type":"jpg","uri":"//cdn.cnn.com/cnnnext/dam/assets/171216122101-sherra-wright-robinson-billy-ray-turner-mugshot-split-large-169.jpg","height":259},"medium":{"width":780,"type":"jpg","uri":"//cdn.cnn.com/cnnnext/dam/assets/171216122101-sherra-wright-robinson-billy-ray-turner-mugshot-split-exlarge-169.jpg","height":439},"large":{"width":1100,"type":"jpg","uri":"//cdn.cnn.com/cnnnext/dam/assets/171216122101-sherra-wright-robinson-billy-ray-turner-mugshot-split-super-169.jpg","height":619},"full16x9":{"width":1600,"type":"jpg","uri":"//cdn.cnn.com/cnnnext/dam/assets/171216122101-sherra-wright-robinson-billy-ray-turner-mugshot-split-full-169.jpg","height":900},"mini1x1":{"width":120,"type":"jpg","uri":"//cdn.cnn.com/cnnnext/dam/assets/171216122101-sherra-wright-robinson-billy-ray-turner-mugshot-split-small-11.jpg","height":120}}},autoStartVideo = false,isVideoReplayClicked = false,callbackObj,containerEl,currentVideoCollection = [{"title":"Ex-wife of NBA player charged in his murder","duration":"01:01","sourceName":"CNN","sourceLink":"http://www.cnn.com/","videoCMSUrl":"/video/data/3.0/video/us/2017/12/16/lorenzen-wright-slaying-wife-charged-nr.cnn/index.xml","videoId":"us/2017/12/16/lorenzen-wright-slaying-wife-charged-nr.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/171216122101-sherra-wright-robinson-billy-ray-turner-mugshot-split-large-169.jpg","videoUrl":"/videos/us/2017/12/16/lorenzen-wright-slaying-wife-charged-nr.cnn/video/playlists/top-news-videos/","description":"Police have arrested and charged Sherra Wright-Robinson with the murder of her ex-husband, former NBA Memphis Grizzlies player Lorenzen Wright.","descriptionText":"Police have arrested and charged Sherra Wright-Robinson with the murder of her ex-husband, former NBA Memphis Grizzlies player Lorenzen Wright."},{"title":"Obama: Toni Morrison's 'distinct and inclusive' voice","duration":"01:23","sourceName":"CNN","sourceLink":"","videoCMSUrl":"/video/data/3.0/video/us/2019/08/06/toni-morrison-obama-medal-of-freedom-orig-mg.cnn/index.xml","videoId":"us/2019/08/06/toni-morrison-obama-medal-of-freedom-orig-mg.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190806150153-06-toni-morrison-file-2012-large-169.jpg","videoUrl":"/videos/us/2019/08/06/toni-morrison-obama-medal-of-freedom-orig-mg.cnn/video/playlists/top-news-videos/","description":"On Tuesday, May 29th, 2012, President Barack Obama delivered remarks about Toni Morrison at a ceremony awarding her with the Presidential Medal of Freedom.","descriptionText":"On Tuesday, May 29th, 2012, President Barack Obama delivered remarks about Toni Morrison at a ceremony awarding her with the Presidential Medal of Freedom."},{"title":"A look at the life of author Toni Morrison ","duration":"02:53","sourceName":"CNN","sourceLink":"https://www.cnn.com/","videoCMSUrl":"/video/data/3.0/video/us/2019/08/06/toni-morrison-obit-vpx.cnn/index.xml","videoId":"us/2019/08/06/toni-morrison-obit-vpx.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190806144007-05-toni-morrison-file-2012-large-169.jpg","videoUrl":"/videos/us/2019/08/06/toni-morrison-obit-vpx.cnn/video/playlists/top-news-videos/","description":"Author Toni Morrison has died at the age of 88, according to her publisher. She died last night at Montefiore Medical Center in New York.","descriptionText":"Author Toni Morrison has died at the age of 88, according to her publisher. She died last night at Montefiore Medical Center in New York."},{"title":"Video shows shooter just before he opens fire","duration":"01:29","sourceName":"CNN","sourceLink":"http://www.cnn.com/","videoCMSUrl":"/video/data/3.0/video/us/2019/08/05/dayton-ohio-surveillance-video-ebof-sot-vpx.cnn/index.xml","videoId":"us/2019/08/05/dayton-ohio-surveillance-video-ebof-sot-vpx.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805192550-dayton-blind-bobs-surveillance-large-169.jpg","videoUrl":"/videos/us/2019/08/05/dayton-ohio-surveillance-video-ebof-sot-vpx.cnn/video/playlists/top-news-videos/","description":"Surveillance video shows a gunman run past a packed restaurant just before going on a shooting rampage in Dayton, Ohio.","descriptionText":"Surveillance video shows a gunman run past a packed restaurant just before going on a shooting rampage in Dayton, Ohio."},{"title":"Everything to know about the Apple credit card","duration":"00:54","sourceName":"CNN Business","sourceLink":"","videoCMSUrl":"/video/data/3.0/video/business/2019/08/05/apple-credit-card-launch.cnn-business/index.xml","videoId":"business/2019/08/05/apple-credit-card-launch.cnn-business","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805141631-20190805-apple-credit-card-gfx-main-large-169.jpg","videoUrl":"/videos/business/2019/08/05/apple-credit-card-launch.cnn-business/video/playlists/top-news-videos/","description":"The Apple Card will work in the iPhone Wallet app to let users see the interest they're paying, map transactions and avoid hidden fees. And, yes, the company will make a physical credit card too.","descriptionText":"The Apple Card will work in the iPhone Wallet app to let users see the interest they're paying, map transactions and avoid hidden fees. And, yes, the company will make a physical credit card too."},{"title":"British Airways cabin fills with smoke, prompts evacuation","duration":"00:55","sourceName":"CNN","sourceLink":"","videoCMSUrl":"/video/data/3.0/video/world/2019/08/06/british-airways-flight-ba422-smoke-evacuation-heathrow-valencia-ge-lon-orig.cnn/index.xml","videoId":"world/2019/08/06/british-airways-flight-ba422-smoke-evacuation-heathrow-valencia-ge-lon-orig.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190806100919-01-british-airways-evacuation-large-169.jpg","videoUrl":"/videos/world/2019/08/06/british-airways-flight-ba422-smoke-evacuation-heathrow-valencia-ge-lon-orig.cnn/video/playlists/top-news-videos/","description":"The cabin of flight BA422 from London to Valencia, Spain, filled with smoke moments before the flight was due to land. After the plane touched down on the tarmac, the crew evacuated all 175 passengers.","descriptionText":"The cabin of flight BA422 from London to Valencia, Spain, filled with smoke moments before the flight was due to land. After the plane touched down on the tarmac, the crew evacuated all 175 passengers."},{"title":"Dayton suspect appeared to have leftist Twitter feed","duration":"02:58","sourceName":"CNN","sourceLink":"http://www.cnn.com","videoCMSUrl":"/video/data/3.0/video/us/2019/08/06/dayton-shooting-shooter-profile-drew-griffin-pkg-vpx.cnn/index.xml","videoId":"us/2019/08/06/dayton-shooting-shooter-profile-drew-griffin-pkg-vpx.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805135345-02-connor-megan-betts-large-169.jpg","videoUrl":"/videos/us/2019/08/06/dayton-shooting-shooter-profile-drew-griffin-pkg-vpx.cnn/video/playlists/top-news-videos/","description":"A Twitter account that appears to belong to Dayton mass shooter Connor Betts retweeted extreme left-wing and anti-police posts. CNN's Drew Griffin investigates.","descriptionText":"A Twitter account that appears to belong to Dayton mass shooter Connor Betts retweeted extreme left-wing and anti-police posts. CNN's Drew Griffin investigates."},{"title":"Servers drop website linked to El Paso shooting","duration":"03:30","sourceName":"CNN","sourceLink":"https://www.cnn.com","videoCMSUrl":"/video/data/3.0/video/politics/2019/08/05/hate-websites-sidner-pkg-lead-vpx.cnn/index.xml","videoId":"politics/2019/08/05/hate-websites-sidner-pkg-lead-vpx.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805115342-01-8chan-grab-large-169.jpg","videoUrl":"/videos/politics/2019/08/05/hate-websites-sidner-pkg-lead-vpx.cnn/video/playlists/top-news-videos/","description":"8chan, an internet forum popular with white supremacists, is one of many similar websites to host hate speech that have law enforcement struggling to keep up with and regulate their dark online communities.","descriptionText":"8chan, an internet forum popular with white supremacists, is one of many similar websites to host hate speech that have law enforcement struggling to keep up with and regulate their dark online communities."},{"title":"Trump: We must condemn white supremacy ","duration":"02:34","sourceName":"CNN","sourceLink":"https://www.cnn.com/","videoCMSUrl":"/video/data/3.0/video/politics/2019/08/05/donald-trump-mass-shooting-white-supremacy-sot-nr-vpx.cnn/index.xml","videoId":"politics/2019/08/05/donald-trump-mass-shooting-white-supremacy-sot-nr-vpx.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805102304-donald-trump-8-5-01-large-169.jpg","videoUrl":"/videos/politics/2019/08/05/donald-trump-mass-shooting-white-supremacy-sot-nr-vpx.cnn/video/playlists/top-news-videos/","description":"President Donald Trump addressed the nation after the mass shootings in El Paso, Texas, and Dayton, Ohio, that left at least 29 people dead. Trump called the shootings a crime against humanity and called for the nation to come together to condemn white supremacy.","descriptionText":"President Donald Trump addressed the nation after the mass shootings in El Paso, Texas, and Dayton, Ohio, that left at least 29 people dead. Trump called the shootings a crime against humanity and called for the nation to come together to condemn white supremacy."},{"title":"Trump offered prayers for 'those who perished in Toledo'","duration":"01:51","sourceName":"CNN","sourceLink":"https://www.cnn.com/","videoCMSUrl":"/video/data/3.0/video/politics/2019/08/05/president-trump-toledo-tim-ryan-reaction-tweet-sot-nr-vpx.cnn/index.xml","videoId":"politics/2019/08/05/president-trump-toledo-tim-ryan-reaction-tweet-sot-nr-vpx.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805152109-03-trump-presser-0805-large-169.jpg","videoUrl":"/videos/politics/2019/08/05/president-trump-toledo-tim-ryan-reaction-tweet-sot-nr-vpx.cnn/video/playlists/top-news-videos/","description":"Presidential candidate Tim Ryan (D-OH) reacted to President Donald Trump giving condolences to Toledo, Ohio, rather than Dayton, Ohio, where \u003ca href=\"http://www.cnn.com/2019/08/04/us/dayton-shooting-victims/index.html\" target=\"_blank\">a mass shooting killed at least nine people\u003c/a>.","descriptionText":"Presidential candidate Tim Ryan (D-OH) reacted to President Donald Trump giving condolences to Toledo, Ohio, rather than Dayton, Ohio, where \u003ca href=\"http://www.cnn.com/2019/08/04/us/dayton-shooting-victims/index.html\" target=\"_blank\">a mass shooting killed at least nine people\u003c/a>."},{"title":"8chan goes offline after Cloudflare pulls support","duration":"02:21","sourceName":"CNN","sourceLink":"http://www.cnn.com/","videoCMSUrl":"/video/data/3.0/video/tech/2019/08/05/8chan-cloudfare-pulling-support-glenn-schoen-howell-nr-sot.cnn/index.xml","videoId":"tech/2019/08/05/8chan-cloudfare-pulling-support-glenn-schoen-howell-nr-sot.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805115342-01-8chan-grab-large-169.jpg","videoUrl":"/videos/tech/2019/08/05/8chan-cloudfare-pulling-support-glenn-schoen-howell-nr-sot.cnn/video/playlists/top-news-videos/","description":"Controversial internet message board 8chan went offline Monday after internet infrastructure company Cloudflare stopped providing support for the website used by the suspected gunman in El Paso to post a hate-filled screed.","descriptionText":"Controversial internet message board 8chan went offline Monday after internet infrastructure company Cloudflare stopped providing support for the website used by the suspected gunman in El Paso to post a hate-filled screed."},{"title":"Three mass shootings. One week. Too many victims","duration":"02:44","sourceName":"CNN","sourceLink":"","videoCMSUrl":"/video/data/3.0/video/us/2019/08/05/three-mass-shootings-one-week-orig.cnn/index.xml","videoId":"us/2019/08/05/three-mass-shootings-one-week-orig.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190804164427-10-el-paso-shooting-0804-large-169.jpg","videoUrl":"/videos/us/2019/08/05/three-mass-shootings-one-week-orig.cnn/video/playlists/top-news-videos/","description":"Shots rang out as Americans attended a local food festival in California, shopped at a Walmart in Texas, and headed downtown to enjoy some nightlife in Ohio. ","descriptionText":"Shots rang out as Americans attended a local food festival in California, shopped at a Walmart in Texas, and headed downtown to enjoy some nightlife in Ohio. "},{"title":"Chicago police chief: What more is it going to take?","duration":"00:54","sourceName":"WLS","sourceLink":"http://www.abc7chicago.com/","videoCMSUrl":"/video/data/3.0/video/us/2019/08/05/chicago-police-weekend-gun-violence-press-conference-sot-vpx.wls/index.xml","videoId":"us/2019/08/05/chicago-police-weekend-gun-violence-press-conference-sot-vpx.wls","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805004112-chicago-police-weekend-gun-violence-press-conference-sot-vpx-00002804-large-169.jpg","videoUrl":"/videos/us/2019/08/05/chicago-police-weekend-gun-violence-press-conference-sot-vpx.wls/video/playlists/top-news-videos/","description":"Chicago Police Dept. Superintendent Eddie Johnson addresses the spat of deadly shootings that took place across the country over the weekend. ","descriptionText":"Chicago Police Dept. Superintendent Eddie Johnson addresses the spat of deadly shootings that took place across the country over the weekend. "},{"title":"Severe storms threaten Upper Midwest ","duration":"01:35","sourceName":"CNN","sourceLink":"","videoCMSUrl":"/video/data/3.0/video/weather/2019/08/05/daily-weather-forecast-severe-storms-threat-excessive-heat.cnn/index.xml","videoId":"weather/2019/08/05/daily-weather-forecast-severe-storms-threat-excessive-heat.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805034357-daily-weather-forecast-severe-storms-threat-excessive-heat-00000000-large-169.jpg","videoUrl":"/videos/weather/2019/08/05/daily-weather-forecast-severe-storms-threat-excessive-heat.cnn/video/playlists/top-news-videos/","description":"Severe storms threaten Upper Midwest, bringing enhanced risk (level 3 of 5) to the area. CNN meteorologist Ivan Cabrera has the affected cities and who will be affected most. ","descriptionText":"Severe storms threaten Upper Midwest, bringing enhanced risk (level 3 of 5) to the area. CNN meteorologist Ivan Cabrera has the affected cities and who will be affected most. "},{"title":"At least 9 people dead in Ohio shooting","duration":"01:50","sourceName":"CNN","sourceLink":"","videoCMSUrl":"/video/data/3.0/video/us/2019/08/04/dayton-ohio-shooting-overview-orig-ch.cnn/index.xml","videoId":"us/2019/08/04/dayton-ohio-shooting-overview-orig-ch.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190804092301-02-dayton-shooting-0804-large-169.jpg","videoUrl":"/videos/us/2019/08/04/dayton-ohio-shooting-overview-orig-ch.cnn/video/playlists/top-news-videos/","description":"A lone gunman killed at least 9 people and injured at least 27 others in less than one minute in a popular Dayton nightlife district.","descriptionText":"A lone gunman killed at least 9 people and injured at least 27 others in less than one minute in a popular Dayton nightlife district."},{"title":"Classmates: Dayton gunman had 'kill list' in high school","duration":"02:59","sourceName":"CNN","sourceLink":"http://www.cnn.com/","videoCMSUrl":"/video/data/3.0/video/us/2019/08/05/drew-griffin-dayton-shooter-hit-list-ac360-vpx.cnn/index.xml","videoId":"us/2019/08/05/drew-griffin-dayton-shooter-hit-list-ac360-vpx.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190804102402-03-dayton-shooting-0804-large-169.jpg","videoUrl":"/videos/us/2019/08/05/drew-griffin-dayton-shooter-hit-list-ac360-vpx.cnn/video/playlists/top-news-videos/","description":"As a high school student, the gunman in the Dayton, Ohio, massacre had a \"kill list\" of classmates he wanted to kill or hurt, according to four former students who said they were told by school officials they were on the list. ","descriptionText":"As a high school student, the gunman in the Dayton, Ohio, massacre had a \"kill list\" of classmates he wanted to kill or hurt, according to four former students who said they were told by school officials they were on the list. "},{"title":"At least 20 dead in El Paso shooting","duration":"02:58","sourceName":"CNN","sourceLink":"","videoCMSUrl":"/video/data/3.0/video/us/2019/08/04/el-paso-mass-shooting-mh-orig.cnn/index.xml","videoId":"us/2019/08/04/el-paso-mass-shooting-mh-orig.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190803215322-copy-21-el-paso-shooting-0803-restricted-large-169.jpg","videoUrl":"/videos/us/2019/08/04/el-paso-mass-shooting-mh-orig.cnn/video/playlists/top-news-videos/","description":"Witnesses describe the scene as a shooter opened fire at a shopping center in El Paso, Texas.","descriptionText":"Witnesses describe the scene as a shooter opened fire at a shopping center in El Paso, Texas."}],currentVideoCollectionId = '',isLivePlayer = false,mediaMetadataCallbacks,mobilePinnedView = null,moveToNextTimeout,mutePlayerEnabled = false,nextVideoId = '',nextVideoUrl = '',turnOnFlashMessaging = false,videoPinner,videoEndSlateImpl;if (CNN.autoPlayVideoExist === false) {autoStartVideo = true;if (autoStartVideo === true) {if (turnOnFlashMessaging === true) {autoStartVideo = false;containerEl = jQuery(document.getElementById(configObj.markupId));CNN.VideoPlayer.showFlashSlate(containerEl);} else {CNN.autoPlayVideoExist = true;}}}configObj.autostart = CNN.Features.enableAutoplayBlock ? false : autoStartVideo;CNN.VideoPlayer.setPlayerProperties(configObj.markupId, autoStartVideo, isLivePlayer, isVideoReplayClicked, mutePlayerEnabled);CNN.VideoPlayer.setFirstVideoInCollection(currentVideoCollection, configObj.markupId);var videoHandler = {},isFeaturedVideoCollectionHandlerAvailable = (CNN !== undefined &&CNN.VIDEOCLIENT !== undefined &&CNN.VIDEOCLIENT.FeaturedVideoCollectionHandler !== undefined);if (!isFeaturedVideoCollectionHandlerAvailable) {CNN.INJECTOR.executeFeature('videx').done(function () {jQuery.ajax({dataType: 'script',cache: true,url: '//www.i.cdn.cnn.com/.a/2.162.1/js/featured-video-collection-player.min.js'}).done(function () {initializeVideoAndCollection();}).fail(function () {throw 'Unable to fetch /js/featured-video-collection-player.min.js';});}).fail(function () {throw 'Unable to fetch the videx bundle';});}function initializeVideoAndCollection() {videoHandler = new CNN.VIDEOCLIENT.FeaturedVideoCollectionHandler(configObj.markupId,"cn-featured-uum80r",'js-video_description-featured-uum80r',[{"title":"Ex-wife of NBA player charged in his murder","duration":"01:01","sourceName":"CNN","sourceLink":"http://www.cnn.com/","videoCMSUrl":"/video/data/3.0/video/us/2017/12/16/lorenzen-wright-slaying-wife-charged-nr.cnn/index.xml","videoId":"us/2017/12/16/lorenzen-wright-slaying-wife-charged-nr.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/171216122101-sherra-wright-robinson-billy-ray-turner-mugshot-split-large-169.jpg","videoUrl":"/videos/us/2017/12/16/lorenzen-wright-slaying-wife-charged-nr.cnn/video/playlists/top-news-videos/","description":"Police have arrested and charged Sherra Wright-Robinson with the murder of her ex-husband, former NBA Memphis Grizzlies player Lorenzen Wright.","descriptionText":"Police have arrested and charged Sherra Wright-Robinson with the murder of her ex-husband, former NBA Memphis Grizzlies player Lorenzen Wright."},{"title":"Obama: Toni Morrison's 'distinct and inclusive' voice","duration":"01:23","sourceName":"CNN","sourceLink":"","videoCMSUrl":"/video/data/3.0/video/us/2019/08/06/toni-morrison-obama-medal-of-freedom-orig-mg.cnn/index.xml","videoId":"us/2019/08/06/toni-morrison-obama-medal-of-freedom-orig-mg.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190806150153-06-toni-morrison-file-2012-large-169.jpg","videoUrl":"/videos/us/2019/08/06/toni-morrison-obama-medal-of-freedom-orig-mg.cnn/video/playlists/top-news-videos/","description":"On Tuesday, May 29th, 2012, President Barack Obama delivered remarks about Toni Morrison at a ceremony awarding her with the Presidential Medal of Freedom.","descriptionText":"On Tuesday, May 29th, 2012, President Barack Obama delivered remarks about Toni Morrison at a ceremony awarding her with the Presidential Medal of Freedom."},{"title":"A look at the life of author Toni Morrison ","duration":"02:53","sourceName":"CNN","sourceLink":"https://www.cnn.com/","videoCMSUrl":"/video/data/3.0/video/us/2019/08/06/toni-morrison-obit-vpx.cnn/index.xml","videoId":"us/2019/08/06/toni-morrison-obit-vpx.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190806144007-05-toni-morrison-file-2012-large-169.jpg","videoUrl":"/videos/us/2019/08/06/toni-morrison-obit-vpx.cnn/video/playlists/top-news-videos/","description":"Author Toni Morrison has died at the age of 88, according to her publisher. She died last night at Montefiore Medical Center in New York.","descriptionText":"Author Toni Morrison has died at the age of 88, according to her publisher. She died last night at Montefiore Medical Center in New York."},{"title":"Video shows shooter just before he opens fire","duration":"01:29","sourceName":"CNN","sourceLink":"http://www.cnn.com/","videoCMSUrl":"/video/data/3.0/video/us/2019/08/05/dayton-ohio-surveillance-video-ebof-sot-vpx.cnn/index.xml","videoId":"us/2019/08/05/dayton-ohio-surveillance-video-ebof-sot-vpx.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805192550-dayton-blind-bobs-surveillance-large-169.jpg","videoUrl":"/videos/us/2019/08/05/dayton-ohio-surveillance-video-ebof-sot-vpx.cnn/video/playlists/top-news-videos/","description":"Surveillance video shows a gunman run past a packed restaurant just before going on a shooting rampage in Dayton, Ohio.","descriptionText":"Surveillance video shows a gunman run past a packed restaurant just before going on a shooting rampage in Dayton, Ohio."},{"title":"Everything to know about the Apple credit card","duration":"00:54","sourceName":"CNN Business","sourceLink":"","videoCMSUrl":"/video/data/3.0/video/business/2019/08/05/apple-credit-card-launch.cnn-business/index.xml","videoId":"business/2019/08/05/apple-credit-card-launch.cnn-business","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805141631-20190805-apple-credit-card-gfx-main-large-169.jpg","videoUrl":"/videos/business/2019/08/05/apple-credit-card-launch.cnn-business/video/playlists/top-news-videos/","description":"The Apple Card will work in the iPhone Wallet app to let users see the interest they're paying, map transactions and avoid hidden fees. And, yes, the company will make a physical credit card too.","descriptionText":"The Apple Card will work in the iPhone Wallet app to let users see the interest they're paying, map transactions and avoid hidden fees. And, yes, the company will make a physical credit card too."},{"title":"British Airways cabin fills with smoke, prompts evacuation","duration":"00:55","sourceName":"CNN","sourceLink":"","videoCMSUrl":"/video/data/3.0/video/world/2019/08/06/british-airways-flight-ba422-smoke-evacuation-heathrow-valencia-ge-lon-orig.cnn/index.xml","videoId":"world/2019/08/06/british-airways-flight-ba422-smoke-evacuation-heathrow-valencia-ge-lon-orig.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190806100919-01-british-airways-evacuation-large-169.jpg","videoUrl":"/videos/world/2019/08/06/british-airways-flight-ba422-smoke-evacuation-heathrow-valencia-ge-lon-orig.cnn/video/playlists/top-news-videos/","description":"The cabin of flight BA422 from London to Valencia, Spain, filled with smoke moments before the flight was due to land. After the plane touched down on the tarmac, the crew evacuated all 175 passengers.","descriptionText":"The cabin of flight BA422 from London to Valencia, Spain, filled with smoke moments before the flight was due to land. After the plane touched down on the tarmac, the crew evacuated all 175 passengers."},{"title":"Dayton suspect appeared to have leftist Twitter feed","duration":"02:58","sourceName":"CNN","sourceLink":"http://www.cnn.com","videoCMSUrl":"/video/data/3.0/video/us/2019/08/06/dayton-shooting-shooter-profile-drew-griffin-pkg-vpx.cnn/index.xml","videoId":"us/2019/08/06/dayton-shooting-shooter-profile-drew-griffin-pkg-vpx.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805135345-02-connor-megan-betts-large-169.jpg","videoUrl":"/videos/us/2019/08/06/dayton-shooting-shooter-profile-drew-griffin-pkg-vpx.cnn/video/playlists/top-news-videos/","description":"A Twitter account that appears to belong to Dayton mass shooter Connor Betts retweeted extreme left-wing and anti-police posts. CNN's Drew Griffin investigates.","descriptionText":"A Twitter account that appears to belong to Dayton mass shooter Connor Betts retweeted extreme left-wing and anti-police posts. CNN's Drew Griffin investigates."},{"title":"Servers drop website linked to El Paso shooting","duration":"03:30","sourceName":"CNN","sourceLink":"https://www.cnn.com","videoCMSUrl":"/video/data/3.0/video/politics/2019/08/05/hate-websites-sidner-pkg-lead-vpx.cnn/index.xml","videoId":"politics/2019/08/05/hate-websites-sidner-pkg-lead-vpx.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805115342-01-8chan-grab-large-169.jpg","videoUrl":"/videos/politics/2019/08/05/hate-websites-sidner-pkg-lead-vpx.cnn/video/playlists/top-news-videos/","description":"8chan, an internet forum popular with white supremacists, is one of many similar websites to host hate speech that have law enforcement struggling to keep up with and regulate their dark online communities.","descriptionText":"8chan, an internet forum popular with white supremacists, is one of many similar websites to host hate speech that have law enforcement struggling to keep up with and regulate their dark online communities."},{"title":"Trump: We must condemn white supremacy ","duration":"02:34","sourceName":"CNN","sourceLink":"https://www.cnn.com/","videoCMSUrl":"/video/data/3.0/video/politics/2019/08/05/donald-trump-mass-shooting-white-supremacy-sot-nr-vpx.cnn/index.xml","videoId":"politics/2019/08/05/donald-trump-mass-shooting-white-supremacy-sot-nr-vpx.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805102304-donald-trump-8-5-01-large-169.jpg","videoUrl":"/videos/politics/2019/08/05/donald-trump-mass-shooting-white-supremacy-sot-nr-vpx.cnn/video/playlists/top-news-videos/","description":"President Donald Trump addressed the nation after the mass shootings in El Paso, Texas, and Dayton, Ohio, that left at least 29 people dead. Trump called the shootings a crime against humanity and called for the nation to come together to condemn white supremacy.","descriptionText":"President Donald Trump addressed the nation after the mass shootings in El Paso, Texas, and Dayton, Ohio, that left at least 29 people dead. Trump called the shootings a crime against humanity and called for the nation to come together to condemn white supremacy."},{"title":"Trump offered prayers for 'those who perished in Toledo'","duration":"01:51","sourceName":"CNN","sourceLink":"https://www.cnn.com/","videoCMSUrl":"/video/data/3.0/video/politics/2019/08/05/president-trump-toledo-tim-ryan-reaction-tweet-sot-nr-vpx.cnn/index.xml","videoId":"politics/2019/08/05/president-trump-toledo-tim-ryan-reaction-tweet-sot-nr-vpx.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805152109-03-trump-presser-0805-large-169.jpg","videoUrl":"/videos/politics/2019/08/05/president-trump-toledo-tim-ryan-reaction-tweet-sot-nr-vpx.cnn/video/playlists/top-news-videos/","description":"Presidential candidate Tim Ryan (D-OH) reacted to President Donald Trump giving condolences to Toledo, Ohio, rather than Dayton, Ohio, where \u003ca href=\"http://www.cnn.com/2019/08/04/us/dayton-shooting-victims/index.html\" target=\"_blank\">a mass shooting killed at least nine people\u003c/a>.","descriptionText":"Presidential candidate Tim Ryan (D-OH) reacted to President Donald Trump giving condolences to Toledo, Ohio, rather than Dayton, Ohio, where \u003ca href=\"http://www.cnn.com/2019/08/04/us/dayton-shooting-victims/index.html\" target=\"_blank\">a mass shooting killed at least nine people\u003c/a>."},{"title":"8chan goes offline after Cloudflare pulls support","duration":"02:21","sourceName":"CNN","sourceLink":"http://www.cnn.com/","videoCMSUrl":"/video/data/3.0/video/tech/2019/08/05/8chan-cloudfare-pulling-support-glenn-schoen-howell-nr-sot.cnn/index.xml","videoId":"tech/2019/08/05/8chan-cloudfare-pulling-support-glenn-schoen-howell-nr-sot.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805115342-01-8chan-grab-large-169.jpg","videoUrl":"/videos/tech/2019/08/05/8chan-cloudfare-pulling-support-glenn-schoen-howell-nr-sot.cnn/video/playlists/top-news-videos/","description":"Controversial internet message board 8chan went offline Monday after internet infrastructure company Cloudflare stopped providing support for the website used by the suspected gunman in El Paso to post a hate-filled screed.","descriptionText":"Controversial internet message board 8chan went offline Monday after internet infrastructure company Cloudflare stopped providing support for the website used by the suspected gunman in El Paso to post a hate-filled screed."},{"title":"Three mass shootings. One week. Too many victims","duration":"02:44","sourceName":"CNN","sourceLink":"","videoCMSUrl":"/video/data/3.0/video/us/2019/08/05/three-mass-shootings-one-week-orig.cnn/index.xml","videoId":"us/2019/08/05/three-mass-shootings-one-week-orig.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190804164427-10-el-paso-shooting-0804-large-169.jpg","videoUrl":"/videos/us/2019/08/05/three-mass-shootings-one-week-orig.cnn/video/playlists/top-news-videos/","description":"Shots rang out as Americans attended a local food festival in California, shopped at a Walmart in Texas, and headed downtown to enjoy some nightlife in Ohio. ","descriptionText":"Shots rang out as Americans attended a local food festival in California, shopped at a Walmart in Texas, and headed downtown to enjoy some nightlife in Ohio. "},{"title":"Chicago police chief: What more is it going to take?","duration":"00:54","sourceName":"WLS","sourceLink":"http://www.abc7chicago.com/","videoCMSUrl":"/video/data/3.0/video/us/2019/08/05/chicago-police-weekend-gun-violence-press-conference-sot-vpx.wls/index.xml","videoId":"us/2019/08/05/chicago-police-weekend-gun-violence-press-conference-sot-vpx.wls","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805004112-chicago-police-weekend-gun-violence-press-conference-sot-vpx-00002804-large-169.jpg","videoUrl":"/videos/us/2019/08/05/chicago-police-weekend-gun-violence-press-conference-sot-vpx.wls/video/playlists/top-news-videos/","description":"Chicago Police Dept. Superintendent Eddie Johnson addresses the spat of deadly shootings that took place across the country over the weekend. ","descriptionText":"Chicago Police Dept. Superintendent Eddie Johnson addresses the spat of deadly shootings that took place across the country over the weekend. "},{"title":"Severe storms threaten Upper Midwest ","duration":"01:35","sourceName":"CNN","sourceLink":"","videoCMSUrl":"/video/data/3.0/video/weather/2019/08/05/daily-weather-forecast-severe-storms-threat-excessive-heat.cnn/index.xml","videoId":"weather/2019/08/05/daily-weather-forecast-severe-storms-threat-excessive-heat.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190805034357-daily-weather-forecast-severe-storms-threat-excessive-heat-00000000-large-169.jpg","videoUrl":"/videos/weather/2019/08/05/daily-weather-forecast-severe-storms-threat-excessive-heat.cnn/video/playlists/top-news-videos/","description":"Severe storms threaten Upper Midwest, bringing enhanced risk (level 3 of 5) to the area. CNN meteorologist Ivan Cabrera has the affected cities and who will be affected most. ","descriptionText":"Severe storms threaten Upper Midwest, bringing enhanced risk (level 3 of 5) to the area. CNN meteorologist Ivan Cabrera has the affected cities and who will be affected most. "},{"title":"At least 9 people dead in Ohio shooting","duration":"01:50","sourceName":"CNN","sourceLink":"","videoCMSUrl":"/video/data/3.0/video/us/2019/08/04/dayton-ohio-shooting-overview-orig-ch.cnn/index.xml","videoId":"us/2019/08/04/dayton-ohio-shooting-overview-orig-ch.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190804092301-02-dayton-shooting-0804-large-169.jpg","videoUrl":"/videos/us/2019/08/04/dayton-ohio-shooting-overview-orig-ch.cnn/video/playlists/top-news-videos/","description":"A lone gunman killed at least 9 people and injured at least 27 others in less than one minute in a popular Dayton nightlife district.","descriptionText":"A lone gunman killed at least 9 people and injured at least 27 others in less than one minute in a popular Dayton nightlife district."},{"title":"Classmates: Dayton gunman had 'kill list' in high school","duration":"02:59","sourceName":"CNN","sourceLink":"http://www.cnn.com/","videoCMSUrl":"/video/data/3.0/video/us/2019/08/05/drew-griffin-dayton-shooter-hit-list-ac360-vpx.cnn/index.xml","videoId":"us/2019/08/05/drew-griffin-dayton-shooter-hit-list-ac360-vpx.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190804102402-03-dayton-shooting-0804-large-169.jpg","videoUrl":"/videos/us/2019/08/05/drew-griffin-dayton-shooter-hit-list-ac360-vpx.cnn/video/playlists/top-news-videos/","description":"As a high school student, the gunman in the Dayton, Ohio, massacre had a \"kill list\" of classmates he wanted to kill or hurt, according to four former students who said they were told by school officials they were on the list. ","descriptionText":"As a high school student, the gunman in the Dayton, Ohio, massacre had a \"kill list\" of classmates he wanted to kill or hurt, according to four former students who said they were told by school officials they were on the list. "},{"title":"At least 20 dead in El Paso shooting","duration":"02:58","sourceName":"CNN","sourceLink":"","videoCMSUrl":"/video/data/3.0/video/us/2019/08/04/el-paso-mass-shooting-mh-orig.cnn/index.xml","videoId":"us/2019/08/04/el-paso-mass-shooting-mh-orig.cnn","videoImage":"//cdn.cnn.com/cnnnext/dam/assets/190803215322-copy-21-el-paso-shooting-0803-restricted-large-169.jpg","videoUrl":"/videos/us/2019/08/04/el-paso-mass-shooting-mh-orig.cnn/video/playlists/top-news-videos/","description":"Witnesses describe the scene as a shooter opened fire at a shopping center in El Paso, Texas.","descriptionText":"Witnesses describe the scene as a shooter opened fire at a shopping center in El Paso, Texas."}],'js-video_headline-featured-uum80r','',"js-video_source-featured-uum80r",true,true,'top-news-videos');if (typeof configObj.context !== 'string' || configObj.context.length JUST WATCHED At least 20 dead in El Paso shooting (CNN) Sherra Wright, the ex-wife of former NBA player Lorenzen Wright, pleaded guilty Thursday in Memphis to charges of facilitation to commit first-degree murder and facilitation to commit attempted first-degree murder. Sherra Wright, 48, previously pleaded not guilty, and her appearance in court was unscheduled, as she was not due back until September. She was facing life in prison if she was convicted then. Lorenzen Wright is believed to have been killed on July 19, 2010, when gunshots were heard during his call to 911. His body was found in a wooded area in southeast Memphis on July 28. Ex-wife of NBA player Lorenzen Wright charged in his 2010 slaying For years, his death was a mystery, but in December 2017, Sherra Wright and Billy Ray Turner were arrested on charges related to his death. In exchange for her plea, she received a 30-year prison sentence, and she is eligible for parole after serving 30% of that sentence, in nine years. She has spent roughly 20 months in jail, which a judge has credited toward her sentence. Read More Her attorney, Juni Ganguli, said they came to terms with prosecutor Paul Hagerman on Wednesday night. "We have been working towards this for about a month or so," Ganguli said. "Since we suspected Billy Ray Turner was going to testify against her, our defense was going to be that Sherra recruited Billy to kill Lorenzen because he had beaten Sherra for years." Ganguli claims that evidence of domestic violence was clear on Sherra's face, that her face shape is now different and that even her mouth moves differently. Turner has pleaded not guilty to charges of murder and conspiracy to commit murder and is awaiting trial. Ganguli said Sherra Wright will not testify against him. Search

wcgray commented 3 years ago

Fixed in version 0.0.4.

It requires you to use the new preStripJavascript param to get rid of CNN's massive JS tag bloating the SAX parser.

UntaggerManager.sharedInstance.getText(url: url, preStripJavascript: true) { (title, body, source, error) in
     // use template data...
}