search

lonekorean / wordpress-export-to-markdown

Converts a WordPress export XML file into Markdown files.
MIT License
1.17k stars 229 forks source link

Image Downloads Fail even after changing delay #123

Open d1ddle opened 4 months ago

d1ddle commented 4 months ago

I've read through image related issues and changed the delay to 5s from 500ms.

It'd be great if I could get a look at some sort of logs because I'm not familiar with JS or node at all; But I know that a large portion of my images are 4K resolution and some videos are fairly large.

I don't think that my host provider infinityfree is blocking access specifically, it's more likely wordpress blocking access since I am getting 403 forbidden

I am also running locally. Any help greatly appreciated 😄

edit: same issue with the (now unmaintained) fork at flowershow/wordpress-to-markdown https://github.com/flowershow/wordpress-to-markdown

PS C:\Users\-user-\markdown\wp-export> node index.js

Starting wizard...
? Path to WordPress export file? export.xml
? Path to output folder? output
? Create year folders? Yes
? Create month folders? Yes
? Create a folder for each post? Yes
? Prefix post folders/files with date? No
? Save images attached to posts? Yes
? Save images scraped from post body content? Yes
? Include custom post types and pages? Yes

Parsing...
0 "page" posts found.
15 "post" posts found.
3 "wp_navigation" posts found.
2 "wp_global_styles" posts found.
6 "wp_template" posts found.
0 "wp_block" posts found.
3 "wp_template_part" posts found.
74 attached images found.
48 images scraped from post body content.

Saving 29 posts (0 already exist)...
[OK] post - ive-remodelled
[OK] post - spotty-test
[OK] post - interesting-check-boxes-have-died
[OK] post - student-robotics-2024-robot-py-code
[OK] post - robert-the-robot
[OK] post - sr
[OK] post - hacker-typer
[OK] post - incompetech
[OK] post - what-is-rpcsx-and-fpps4-ps4-emulators-and-compatibility-layers-for-pc
[OK] post - big-o-cheatsheet
[OK] post - interactive-sorting-algorithms-useful
[OK] post - cambridge-tech-day
[OK] post - robotics-simulator
[OK] post - welcome-to-the-party-pal
[OK] post - jason-the-robot-drives-again-development-continues
[OK] wp_navigation - navigation
[OK] wp_navigation - header-navigation-2
[OK] wp_navigation - header-navigation
[OK] wp_global_styles - wp-global-styles-twentytwentyfour
[OK] wp_global_styles - wp-global-styles-wabipress
[OK] wp_template - home
[OK] wp_template - page
[OK] wp_template - archive
[OK] wp_template - category
[OK] wp_template - 404
[OK] wp_template - single
[OK] wp_template_part - header
[OK] wp_template_part - footer
[OK] wp_template_part - category-main
Done, got them all!

Downloading and saving 110 images (0 already exist)...
[FAILED] d1ddle-banner.png (StatusCodeError: 403)
[FAILED] checkbox-death-banner.png (StatusCodeError: 403)
[FAILED] Screenshot_20240422_175251_Gallery.jpg (StatusCodeError: 403)
[FAILED] Screenshot_20240422_175251_Gallery-461x1024.jpg (StatusCodeError: 403)
[FAILED] 20240115_162302-scaled.jpg (StatusCodeError: 403)
[FAILED] IMG-20240129-WA0003-scaled.jpeg (StatusCodeError: 403)
[FAILED] IMG-20240129-WA0001-1-scaled.jpeg (StatusCodeError: 403)
[FAILED] bouquet-of-sensors.jpg (StatusCodeError: 403)
[FAILED] 20240209_203115-scaled.jpg (StatusCodeError: 403)
[FAILED] 20240209_203119-scaled.jpg (StatusCodeError: 403)
[FAILED] 20240209_203124-scaled.jpg (StatusCodeError: 403)
[FAILED] mdf-electronics.jpg (StatusCodeError: 403)
[FAILED] IMG-20240120-WA0001-scaled.jpeg (StatusCodeError: 403)
[FAILED] robot-banner.jpg (StatusCodeError: 403)
[FAILED] motor-epoxied-web.jpg (StatusCodeError: 403)
[FAILED] motor-epoxy-web.jpg (StatusCodeError: 403)
[FAILED] motor-epoxy-warn-web.jpg (StatusCodeError: 403)
[FAILED] bouquet-of-sensors-1024x806.jpg (StatusCodeError: 403)
[FAILED] 20240209_203124-1024x576.jpg (StatusCodeError: 403)
[FAILED] 20240209_203115-1024x576.jpg (StatusCodeError: 403)
[FAILED] 20240209_203119-1024x576.jpg (StatusCodeError: 403)
[FAILED] mdf-electronics-1024x1024.jpg (StatusCodeError: 403)
[FAILED] hero-banner.jpg (StatusCodeError: 403)
[FAILED] hackertyper-banner.png (StatusCodeError: 403)
[FAILED] incompetech.png (StatusCodeError: 403)
[FAILED] image.png (StatusCodeError: 403)
[FAILED] image-1.png (StatusCodeError: 403)
[FAILED] image-2.png (StatusCodeError: 403)
[FAILED] PS4-banner.png (StatusCodeError: 403)
[FAILED] image-3.png (StatusCodeError: 403)
[FAILED] image-4.png (StatusCodeError: 403)
[FAILED] PS4-banner-1.png (StatusCodeError: 403)
[FAILED] know-thy-complexities.png (StatusCodeError: 403)
[FAILED] sorting-ezgif.com-video-to-gif-converter.gif (StatusCodeError: 403)
[FAILED] sorting2.gif (StatusCodeError: 403)
[FAILED] sorting2-2.gif (StatusCodeError: 403)
[FAILED] WIN_20240304_15_51_28_Pro.jpg (StatusCodeError: 403)
[FAILED] robot-banner.jpg (StatusCodeError: 403)
[FAILED] simulator-banner-size.png (StatusCodeError: 403)
[FAILED] 20240129_153017-scaled.jpg (StatusCodeError: 403)
[FAILED] 20240129_155051-scaled.jpg (StatusCodeError: 403)
[FAILED] 20240129_153045-scaled.jpg (StatusCodeError: 403)
[FAILED] bouquet-of-sensors.jpg (StatusCodeError: 403)
[FAILED] 20240115_162911-scaled.jpg (StatusCodeError: 403)
[FAILED] 20240129_161746-scaled.jpg (StatusCodeError: 403)
[FAILED] 20240129_155104-scaled.jpg (StatusCodeError: 403)
[FAILED] 20240209_203126-scaled.jpg (StatusCodeError: 403)
[FAILED] 20240209_203102-scaled.jpg (StatusCodeError: 403)
[FAILED] 20240209_203124-scaled.jpg (StatusCodeError: 403)
[FAILED] IMG-20240120-WA0001-scaled.jpeg (StatusCodeError: 403)
[FAILED] IMG-20240129-WA0003-scaled.jpeg (StatusCodeError: 403)
[FAILED] IMG-20240129-WA0001-scaled.jpeg (StatusCodeError: 403)
[FAILED] robot.jpeg (StatusCodeError: 403)
[FAILED] WhatsApp-Image-2023-11-10-at-6.21.01-PM.jpeg (StatusCodeError: 403)
[FAILED] tuning-in-the-test-arena.jpg (StatusCodeError: 403)
[FAILED] IMG-20240325-WA0000-scaled.jpeg (StatusCodeError: 403)
[FAILED] IMG-20240325-WA0002-scaled.jpeg (StatusCodeError: 403)
[FAILED] IMG-20240325-WA0008.jpg (StatusCodeError: 403)
[FAILED] 20240401_111815-scaled.jpg (StatusCodeError: 403)
[FAILED] 20240401_111813-scaled.jpg (StatusCodeError: 403)
[FAILED] IMG-20240327-WA0021.jpg (StatusCodeError: 403)
[FAILED] IMG-20240327-WA0012.jpg (StatusCodeError: 403)
[FAILED] 20240401_111849-scaled.jpg (StatusCodeError: 403)
[FAILED] 20240401_111911-scaled.jpg (StatusCodeError: 403)
[FAILED] 20240401_123602-scaled.jpg (StatusCodeError: 403)
[FAILED] 20240401_123943-scaled.jpg (StatusCodeError: 403)
[FAILED] 20240401_140529-scaled.jpg (StatusCodeError: 403)
[FAILED] 20240401_225117-scaled.jpg (StatusCodeError: 403)
[FAILED] 20240401_225122-scaled.jpg (StatusCodeError: 403)
[FAILED] IMG-20240402-WA0039.jpg (StatusCodeError: 403)
[FAILED] IMG-20240402-WA0045.jpg (StatusCodeError: 403)
[FAILED] IMG-20240402-WA0049-scaled.jpeg (StatusCodeError: 403)
[FAILED] IMG-20240403-WA0004.jpg (StatusCodeError: 403)
[FAILED] IMG-20240404-WA0000-scaled.jpeg (StatusCodeError: 403)
[FAILED] IMG-20240405-WA0000.jpg (StatusCodeError: 403)
[FAILED] 20240209_203102-1024x576.jpg (StatusCodeError: 403)
[FAILED] 20240209_203124-1024x576.jpg (StatusCodeError: 403)
[FAILED] 20240209_203126-1024x576.jpg (StatusCodeError: 403)
[FAILED] WhatsApp-Image-2023-11-10-at-6.21.01-PM-768x1024.jpeg (StatusCodeError: 403)
[FAILED] robot-1024x768.jpeg (StatusCodeError: 403)
[FAILED] 20240129_153017-1024x576.jpg (StatusCodeError: 403)
[FAILED] 20240129_153045-1024x314.jpg (StatusCodeError: 403)
[FAILED] 20240129_155051-576x1024.jpg (StatusCodeError: 403)
[FAILED] IMG-20240129-WA0001-576x1024.jpeg (StatusCodeError: 403)
[FAILED] 20240115_162911-576x1024.jpg (StatusCodeError: 403)
[FAILED] 20240129_161746-576x1024.jpg (StatusCodeError: 403)
[FAILED] 20240129_155104-576x1024.jpg (StatusCodeError: 403)
[FAILED] IMG-20240120-WA0001-576x1024.jpeg (StatusCodeError: 403)
[FAILED] IMG-20240129-WA0003-576x1024.jpeg (StatusCodeError: 403)
[FAILED] IMG-20240325-WA0000-1024x576.jpeg (StatusCodeError: 403)
[FAILED] IMG-20240325-WA0002-1024x576.jpeg (StatusCodeError: 403)
[FAILED] IMG-20240325-WA0008-1024x576.jpg (StatusCodeError: 403)
[FAILED] 20240401_111815-1024x576.jpg (StatusCodeError: 403)
[FAILED] 20240401_111813-1024x576.jpg (StatusCodeError: 403)
[FAILED] IMG-20240327-WA0021-768x1024.jpg (StatusCodeError: 403)
[FAILED] IMG-20240327-WA0012-576x1024.jpg (StatusCodeError: 403)
[FAILED] 20240401_111849-1024x576.jpg (StatusCodeError: 403)
[FAILED] 20240401_111911-576x1024.jpg (StatusCodeError: 403)
[FAILED] 20240401_123602-576x1024.jpg (StatusCodeError: 403)
[FAILED] 20240401_123943-576x1024.jpg (StatusCodeError: 403)
[FAILED] 20240401_140529-576x1024.jpg (StatusCodeError: 403)
[FAILED] 20240401_225117-576x1024.jpg (StatusCodeError: 403)
[FAILED] 20240401_225122-576x1024.jpg (StatusCodeError: 403)
[FAILED] IMG-20240402-WA0039-1024x576.jpg (StatusCodeError: 403)
[FAILED] IMG-20240403-WA0004-1024x768.jpg (StatusCodeError: 403)
[FAILED] IMG-20240404-WA0000-576x1024.jpeg (StatusCodeError: 403)
[FAILED] IMG-20240405-WA0000-576x1024.jpg (StatusCodeError: 403)
[FAILED] Jared-gertbot-edition.jpeg (StatusCodeError: 403)
[FAILED] Jared-gertbot-edition-edited.jpeg (StatusCodeError: 403)
[FAILED] hm-logo-2-c.png (StatusCodeError: 403)
Done, but with 110 failed.

All done!
Look for your output files in: C:\Users\-user-\markdown\wp-export\output
krisfreedain commented 1 week ago

I'm seeing the same errors - not positive how to resolve it.

Has anyone had luck in fixing this? thanks in advance