Crawling fails for posts with embedded videos. It looks like html end tags are mistakenly considered to be part of the file name.
When editing the post in text mode, the corresponding section reads
[video width="1920" height="934" mp4="http://xxx-ubu/wp-content/uploads/2018/09/50kVp_HA_spectral_segmentation.mp4 "][/video]
The error message is:
2018-11-29 01:23:39 SAVING URL: UNABLE TO SAVE FOR SOME REASON
2018-11-29 01:23:39 FAILED TO CRAWL FILE: http://xxx-ubu/wp-content/uploads/2018/09/50kVp_HA_spectral_segmentation.mp4
2018-11-29 01:23:03 STARTING EXPORT: STATIC EXPORT URL http://xxx.local/projects/blog/browse
2018-11-29 01:23:03 STARTING EXPORT: VIA CLI?
2018-11-29 01:23:03 STARTING EXPORT: PLUGIN VERSION 5.8
2018-11-29 01:23:03 STARTING EXPORT: WP ADDRESS http://xxx-ubu
2018-11-29 01:23:03 STARTING EXPORT: WP HOME http://xxx-ubu
2018-11-29 01:23:03 STARTING EXPORT: WP SITEURL http://xxx-ubu
2018-11-29 01:23:03 STARTING EXPORT: WP URL http://xxx-ubu
2018-11-29 01:23:03 STARTING EXPORT: WP VERSION 4.9.8
2018-11-29 01:23:03 STARTING EXPORT: OS VERSION Linux 3.10.0-693.11.6.el7.x86_64 #1 SMP Thu Jan 4 01:06:37 UTC 2018 x86_64
2018-11-29 01:23:03 STARTING EXPORT: PHP MAX EXECUTION TIME 30
2018-11-29 01:23:03 STARTING EXPORT: PHP VERSION 5.4.16
2018-11-29 01:23:03 STARTING EXPORT2018-11-29 01:23:03
- 8 replies
- Leon Stafford @leonstafford2018-11-30 06:36:32.224Z
Sorry for the delayed response, just caught this now.
Those videos should copy across fine with the latest development version, if not let me know.
Please find it here:https://forum.wp2static.com/-30/how-to-install-the-latest-preview-of-version-59-of-wp2static
Thank you for your response! I tried today with 5.9 but the export fails without a helpful error message:
STARTING EXPORT: 2018-12-03 01:13:32
STARTING EXPORT: PHP VERSION 5.4.16
STARTING EXPORT: PHP MAX EXECUTION TIME 30
STARTING EXPORT: OS VERSION Linux 3.10.0-693.11.6.el7.x86_64 #1 SMP Thu Jan 4 01:06:37 UTC 2018 x86_64
STARTING EXPORT: WP VERSION 4.9.8
STARTING EXPORT: WP URL http://xxx-ubu
STARTING EXPORT: WP SITEURL http://xxx-ubu
STARTING EXPORT: WP HOME http://xxx-ubu
STARTING EXPORT: WP ADDRESS http://xxx-ubu
STARTING EXPORT: PLUGIN VERSION 5.9
STARTING EXPORT: VIA CLI?
STARTING EXPORT: STATIC EXPORT URL http://xxx.local/projects/blog/browse/
I use default settings with export to zip archive.
The preview of the initial crawl list looks reasonable.
The wp-content/uploads folder looks like this:
-rw-r--r-- 1 apache apache 18214 Dec 3 14:09 WP-STATIC-INITIAL-CRAWL-LIST.txt
drwxr-xr-x 2 apache apache 4096 Dec 3 14:11 wp-static-html-output-1543842673/
-rw-r--r-- 1 apache apache 610 Dec 3 14:11 WP-STATIC-EXPORT-LOG.txt
-rw-r--r-- 1 apache apache 66 Dec 3 14:11 WP-STATIC-CURRENT-ARCHIVE
-rw-r--r-- 1 apache apache 0 Dec 3 14:11 WP-STATIC-CRAWLED-LINKS
-rw-r--r-- 1 apache apache 18214 Dec 3 14:11 WP-STATIC-MODIFIED-CRAWL-LIST.txt
-rw-r--r-- 1 apache apache 18543 Dec 3 14:11 WP-STATIC-FINAL-CRAWL-LIST.txt
For some milliseconds I see a "Crawling initial file list: Chunk 0" message, then the error message pops up.
- Leon Stafford @leonstafford2018-12-03 13:30:16.224Z
OK, could you please try with the Crawl Increment set to 1 and let me know if that proceeds a certain number.
Anything in your PHP error log on the server?
I'd also recommend upgrading to PHP 7.2, as per this info: https://docs.wp2static.com/en/troubleshooting/activation/
Though not affecting activation, PHP 5.4 is not going to be supported much longer.
One other thing to inspect if it makes it partially through the crawling, is to compare the INITIAL CRAWL LIST against the CRAWLED LINKS files.
This may show where things progressed to.
This might take us a bit more back and forth to isolate the exact issue, but I'll do my best to get your exporting!
A look into the apache log helped. The problem is PHP 5.4, because curl_reset is not defined below PHP 5.5 (http://php.net/manual/en/function.curl-reset.php). An update to PHP 5.6 solves the problem with WP2Static 5.9.
Thank you for your help!
- Leon Stafford @leonstafford2018-12-05 04:54:01.281Z
Peter, so glad to hear it helped you and you're exporting now!
Please let me know if any other issues encountered or share your success story once you're site is secured and speedy!
- Leon Stafford @leonstafford2018-12-05 04:58:36.951Z
Also, I'm always fishing for reviews here to help encourage more users to try the plugin:https://wordpress.org/support/plugin/static-html-output-plugin/reviews/
Would love if you can post one once it's all working for you.
I found two more problems with 5.9:
- The URLs in my blog title and footer (credits section) are not rewritten
- Some pages are not exported (the page which opens when clicking the "older posts" link on my start page is missing)
I also tried the "brute force" method as well as to add the missing page by hand, but I didn't get it working.
- Leon Stafford @leonstafford2018-12-06 12:50:45.069Z
I've put another build out now, but still more testing to do and a few user reporting issues to fix, hopefully tonight.
Keep an ear out for an updated release.
Slack channel the best for notifications regarding this: https://wp2static.com/community/