Een nieuwe woocommerce site gebruikt warm cache in combinatie met easycron starter pakket.
Dit is de url die de cronjob gebruikt is: https://www.ginis.me/?warm_cache=gzGEEDHWb
Nu krijg ik iedere keer dat de job loopt een fouterror in easycron: 500: Internal Server Error.
Qua output krijg ik wel de files te zien die gecrawled worden. Dit geeft Easycron weer als output:
—
Content-Type: text/html; charset=UTF-8
X-Varnish: 205239378
Pragma: no-cache
Expires: Mon, 13 Mar 2017 16:58:03 GMT
Date: Sat, 11 Feb 2017 16:58:03 GMT
Age: 0
Vary: Accept-Encoding
X-Powered-By: PHP/7.0.15
Cache-Control: no-store, no-cache, must-revalidate, max-age=0, post-check=0, pre-check=0, max-age=2592000
Server: Apache
Via: 1.1 varnish (Varnish/5.0)
Start at item 20 20
Start with submap: http://www.ginis.me/page-sitemap.xml
Start with submap: http://www.ginis.me/product-sitemap.xml
Busy with: https://www.ginis.me/winkel/vegan/vegan-banaan-chocolade-zebracake-groot/
Busy with: https://www.ginis.me/winkel/zout/quiche-prei-bacon-groot/
Busy with: https://www.ginis.me/winkel/zout/quiche-prei-bacon-klein/
Busy with: https://www.ginis.me/winkel/koekjes/amandelbrood/
Busy with: https://www.ginis.me/winkel/zout/focaccia-groot/
Busy with: https://www.ginis.me/winkel/zout/focaccia-klein/
Busy with: https://www.ginis.me/winkel/muffins/chocolade-muffins-groot/
Busy with: https://www.ginis.me/winkel/muffins/chocolade-muffins-klein/
Busy with: https://www.ginis.me/winkel/ontbijt/granola/
Busy with: https://www.ginis.me/winkel/cake/appel-walnoten-cake/
Busy with: https://www.ginis.me/winkel/cake/ginis-cake/
Busy with: https://www.ginis.me/winkel/cake/kokos-cake/
Busy with: https://www.ginis.me/winkel/cake/4×4-cake/
Busy with: https://www.ginis.me/winkel/muffins/muffins-witte-chocoladestukjes-en-walnoten-groot/
Busy with: https://www.ginis.me/winkel/muffins/muffins-witte-chocoladestukjes-en-walnoten-klein/
Busy with: https://www.ginis.me/winkel/cake/cranberry-cake/
Busy with: https://www.ginis.me/winkel/glutenvrij/glutenvrije-muffins-klein/
Busy with: https://www.ginis.me/winkel/glutenvrij/glutenvrije-muffins-groot/
Busy with: https://www.ginis.me/winkel/ontbijt/rozijnenbroodje/
Busy with: https://www.ginis.me/winkel/ontbijt/chocoladebolletjes/
Start with submap: http://www.ginis.me/product_cat-sitemap.xml
Updating to start (next time) at : 40
—
En ook in wp-admin onder ‘warm cache’ krijg ik een lijst te zien van gecrawlde pagina’s:
Anderzijds, als ik naar site ga, zie ik dat de opgelojste pagina’s toch niet gecached zijn met W3TC. Als ik effectief zelf naar een pagina surf, cachet de pagina correct.
Ik heb contact opgenomen met Easycron. Dit is hun antwoord:
—
It seems that your cron job script is having some error (webserver, php setting or php code) inside.
“500 error” is not something that easycron could cause, it’s caused by webserver or php setting or php script at your side.
So I think you should ask the script vendor/developer for help.
—
Volgens hen ligt het probleem dus mogelijk bij de plugin.
Alvast dank!
500 error is indeed not easycron’s fault as of origin of making.
When I visit your crawl url the response is 500 but the output is OK.
SO .. you need to disable plugins to see which one is giving you that.
Then when I visit one random page:
curl -v https://www.ginis.me/over-ginis/
Performance optimized by W3 Total Cache. Learn more: https://www.w3-edge.com/products/
Object Caching 1397/1411 objects using disk
Page Caching using disk: enhanced (SSL caching disabled)
Page cache debug info:
Engine: disk: enhanced
Cache key:
Reject reason: SSL caching disabled
Creation Time: 1486994204.000s
Header info:
X-Powered-By: PHP/7.0.15
Content-Security-Policy: default-src ‘self’ ‘unsafe-inline’ ‘unsafe-eval’ https: data:
X-Frame-Options: SAMEORIGIN
X-XSS-Protection: 1; mode=block
X-Content-Type-Options: nosniff
Strict-Transport-Security: max-age=31536000; includeSubdomains; preload
Content-Type: text/html; charset=UTF-8
Link: <https://www.ginis.me/wp-json/>; rel=”https://api.w.org/”
Link: <https://www.ginis.me/?p=20>; rel=shortlink
* Connection #0 to host http://www.ginis.me left intact
Served from: http://www.ginis.me @ 2017-02-13 14:56:44 by W3 Total Cache
so all is well.. Keep in mind that SSL caching might be better when using WP fastest cache instead of W3TC. Despite of lack of memcached storages
In addition: you need to enable SSL caching in W3TC:
“Reject reason: SSL caching disabled”
Well, it seems to work for now…
I deactivated all plugins and tested them one by one. Strangely enough it was W3TC, which caused the INternal Server Error. By just reactivating him, everything sarted working as expected… Strange.
As for WP Fastest Cache. I used it before W3TC, but it doesn’t cache Woocommerce product pages and product categories, only the ‘traditional’ posts, pages and categories…
I also enabled SSL caching in W3TC.
Thank you!!!
After some more investigation, I think it had something to do with my htaccess file:
I put following rules in comment:
# SetEnvIfNoCase User-Agent “^libwww-perl*” block_bad_bots
# Deny from env=block_bad_bots
After that, every cronjob succeeded.
Just curious, might that have been the issue?
Thx