2026-05-17 00:00:24 [scrapy.utils.log] INFO: Scrapy 2.14.1 started (bot: compuccino) 2026-05-17 00:00:24 [scrapy.utils.log] INFO: Versions: {'lxml': '5.3.2', 'libxml2': '2.12.10', 'cssselect': '1.3.0', 'parsel': '1.10.0', 'w3lib': '2.3.1', 'Twisted': '24.11.0', 'Python': '3.10.12 (main, Mar 3 2026, 11:56:32) [GCC 11.4.0]', 'pyOpenSSL': '25.0.0 (OpenSSL 3.4.1 11 Feb 2025)', 'cryptography': '44.0.2', 'Platform': 'Linux-5.19.0-1027-aws-x86_64-with-glibc2.35'} 2026-05-17 00:00:24 [scrapy.addons] INFO: Enabled addons: [] 2026-05-17 00:00:24 [scrapy.extensions.telnet] INFO: Telnet Password: 7981c70da91a6b17 2026-05-17 00:00:24 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.logcount.LogCount', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.feedexport.FeedExporter', 'scrapy.extensions.logstats.LogStats'] 2026-05-17 00:00:24 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'compuccino', 'DNS_RESOLVER': 'scrapy.resolver.CachingHostnameResolver', 'EDITOR': '/usr/bin/vim', 'LOG_FILE': '/home/sebastian/scrapyd/logs/osk/volkswagen-newsroom.com/63c40b7f518311f1a6aae125cd15e540.log', 'LOG_LEVEL': 'INFO', 'NEWSPIDER_MODULE': 'compuccino.spiders', 'SPIDER_MODULES': ['compuccino.spiders'], 'TEMPLATES_DIR': 'compuccino/templates'} 2026-05-17 00:00:24 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2026-05-17 00:00:24 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.start.StartSpiderMiddleware', 'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2026-05-17 00:00:24 [scrapy.middleware] INFO: Enabled item pipelines: ['scrapy.pipelines.files.FilesPipeline'] 2026-05-17 00:00:24 [scrapy.core.engine] INFO: Spider opened 2026-05-17 00:00:24 [py.warnings] WARNING: /home/sebastian/.penv/scrapyd/lib/python3.10/site-packages/scrapy/core/spidermw.py:490: ScrapyDeprecationWarning: compuccino.spiders.volkswagen_newsroom_com.VolkswagenNewsroomComSpider defines the deprecated start_requests() method. start_requests() has been deprecated in favor of a new method, start(), to support asynchronous code execution. start_requests() will stop being called in a future version of Scrapy. If you use Scrapy 2.13 or higher only, replace start_requests() with start(); note that start() is a coroutine (async def). If you need to maintain compatibility with lower Scrapy versions, when overriding start_requests() in a spider class, override start() as well; you can use super() to reuse the inherited start() implementation without copy-pasting. See the release notes of Scrapy 2.13 for details: https://docs.scrapy.org/en/2.13/news.html warn( 2026-05-17 00:00:24 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2026-05-17 00:00:24 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024 2026-05-17 00:01:24 [scrapy.extensions.logstats] INFO: Crawled 268 pages (at 268 pages/min), scraped 236 items (at 236 items/min) 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/countdown-fuer-den-neuen-golf-golf-iv-die-stilikone-5453>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/countdown-fuer-den-neuen-golf-golf-iii-vorreiter-bei-sicherheitssystemen-5446>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/aus-vision-wird-wirklichkeit-weltpremiere-des-id3-5338>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/countdown-fuer-den-neuen-golf-golf-ii-konzept-perfektioniert-5442>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/t-roc-mit-neuer-top-motorisierung-und-mehr-optionen-zur-individualisierung-5380>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/iaa-2019-volkswagen-leitet-mit-der-weltpremiere-des-id3-den-durchbruch-fuer-das-elektroauto-ein-5341>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/volkswagen-pkw-auslieferungen-leicht-unter-vorjahr-5351>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/werk-emden-startet-in-die-neue-aera-der-elektromobilitaet-6177>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/emissionsfreie-mobilitaet-fuer-alle-verkauf-des-id3-startet-am-20-juli-6229>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/volkswagen-sechsfacher-sieger-bei-wahl-firmenauto-des-jahres-2020-6185>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/sommer-highlight-2020-vorverkauf-des-neuen-arteon-und-arteon-shooting-brake-gestartet-6226>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/draussen-freiheit-innen-freiraum-das-interieur-des-neuen-id4-6361>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/volkswagen-treibt-e-offensive-weiter-voran-zwickau-startet-serienproduktion-des-id4-6299>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/we-charge-neuer-ladeservice-von-volkswagen-bietet-mehr-als-150000-oeffentliche-ladepunkte-6237>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/der-neue-id4-volkswagen-startet-vorverkauf-seines-ersten-rein-elektrischen-suvs-6448>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/plug-in-hybrid-fuer-alle-faelle-emissionsfrei-auf-der-kurzstrecke-effizient-auf-der-langstrecke-6371>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/der-neue-golf-gti-clubsport-weltpremiere-des-300-ps-starken-gti-topmodells-6496>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/jetta-erfolgreich-in-china-gestartet-5647>: HTTP status code is not handled or not allowed 2026-05-17 00:01:54 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/der-neue-id4-weltpremiere-des-rein-elektrisch-angetriebenen-suv-6446>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/mir-ist-kalt-der-neue-golf-reagiert-mit-intelligenter-klimasteuerung-5730>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/elektrifizierte-suv-spitzenmodelle-vorverkauf-des-neuen-touareg-ehybrid-und-touareg-r-beginnt-6493>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/volkswagen-kommt-bei-transformation-zuegig-voran-5688>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/e-mobilitaet-volkswagen-sachsen-baut-ladeinfrastruktur-an-seinen-standorten-massiv-aus-5695>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/volkswagen-idr-ist-elektro-rennwagen-des-jahres-5639>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/volkswagen-pkw-schliesst-2019-erfolgreich-ab-5720>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/start-der-id3-serienproduktion-glaeserne-manufaktur-dresden-wird-volkswagen-home-of-id-6788>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/volkswagen-gibt-konkreten-ausblick-auf-neues-vollelektrisches-kompakt-suv-id4-5846>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/performance-des-neuen-golf-r-setzt-massstaebe-6897>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/volkswagen-beschleunigt-transformation-zum-softwareorientierten-mobilitaetsanbieter-6878>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/id-familie-wird-um-die-neue-performance-marke-gtx-erweitert-7016>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/weltpremieren-der-sportlichen-ikonen-in-genf-neuer-golf-gti-golf-gte-und-golf-gtd-5821>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/neuzugang-bei-volkswagen-der-taigo-kommt-6919>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/noch-mehr-schub-fuer-volkswagen-elektro-offensive-weltauto-id4-kommt-jetzt-in-die-weltmaerkte-6803>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/marke-volkswagen-vor-dem-sprung-ins-e-zeitalter-5907>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/hybrid-weltpremiere-in-genf-der-neue-touareg-r-5809>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/regenbogenfarbenes-vw-logo-volkswagen-und-vfl-wolfsburg-setzen-ein-buntes-zeichen-fuer-vielfalt-6061>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/volkswagen-startet-mit-neuem-t-roc-cabriolet-in-den-fruehling-5999>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/marke-volkswagen-umsatz-und-ergebnis-im-ersten-quartal-aufgrund-covid-19-auswirkungen-unter-vorjahr-6003>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/id3-1st-modelle-werden-anfang-september-ausgeliefert-6122>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/suv-offensive-in-china-sechs-neue-fahrzeuge-und-drei-weltpremieren-bei-auto-shanghai-7023>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/der-neue-arteon-r-und-arteon-r-shooting-brake-neue-fusion-aus-gran-turismo-und-sportwagen-7005>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/volkswagen-gedenkt-kriegsende-vor-75-jahren-ein-tag-der-befreiung-und-der-mahnung-6016>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/der-neue-polo-virtuelle-weltpremiere-am-22-april-7019>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/id4-mit-bestnote-fuenf-sterne-im-euro-ncap-test-7020>: HTTP status code is not handled or not allowed 2026-05-17 00:01:55 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/marke-volkswagen-erholt-sich-im-dritten-quartal-von-covid-19-einbruch-und-bestaetigt-ausblick-6538>: HTTP status code is not handled or not allowed 2026-05-17 00:01:56 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:56 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:56 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:56 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:56 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:56 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying (failed 3 times): 429 Unknown Status 2026-05-17 00:01:56 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/spektakulaere-weltpremiere-des-neuen-id4-gtx-7079>: HTTP status code is not handled or not allowed 2026-05-17 00:01:56 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/e-offensive-in-china-nimmt-weiter-fahrt-auf-weltpremiere-des-id6-7018>: HTTP status code is not handled or not allowed 2026-05-17 00:01:56 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/der-neue-golf-r-startet-durch-weltpremiere-des-staerksten-serien-golf-aller-zeiten-6584>: HTTP status code is not handled or not allowed 2026-05-17 00:01:56 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/volkswagen-emden-bei-transformation-zur-elektromobilitaet-auf-kurs-7122>: HTTP status code is not handled or not allowed 2026-05-17 00:01:56 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/von-der-luxusklasse-ins-kompaktsegment-das-augmented-reality-head-up-display-6730>: HTTP status code is not handled or not allowed 2026-05-17 00:01:56 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/auto-und-smartphone-verschmelzen-touareg-parkt-jetzt-fernbedient-ein-und-aus-6596>: HTTP status code is not handled or not allowed 2026-05-17 00:01:56 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/lokal-zero-emission-arteon-und-arteon-shooting-brake-ab-26-november-mit-plug-in-hybridantrieb-6640>: HTTP status code is not handled or not allowed 2026-05-17 00:01:56 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/marke-volkswagen-pkw-uebererfuellt-europaeische-co2-flottenziele-2020-deutlich-6764>: HTTP status code is not handled or not allowed 2026-05-17 00:01:56 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/volkswagen-baut-ladeinfrastruktur-kraeftig-aus-6734>: HTTP status code is not handled or not allowed 2026-05-17 00:01:56 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/multitalent-im-kompakten-format-der-tsi-evo-motor-mit-10-und-15-liter-hubraum-6695>: HTTP status code is not handled or not allowed 2026-05-17 00:01:56 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/kaefer-in-kisten-70-jahre-export-von-autos-als-bausatz-bei-volkswagen-6726>: HTTP status code is not handled or not allowed 2026-05-17 00:01:56 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/vor-75-jahren-in-wolfsburg-beginn-der-serienfertigung-des-volkswagen-kaefer-6732>: HTTP status code is not handled or not allowed 2026-05-17 00:01:56 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <429 https://www.volkswagen-newsroom.com/de/pressemitteilungen/bremsen-oder-segeln-das-intelligente-rekuperationskonzept-des-id4-6658>: HTTP status code is not handled or not allowed 2026-05-17 00:01:59 [scrapy.core.engine] INFO: Closing spider (finished) 2026-05-17 00:01:59 [scrapy.extensions.feedexport] INFO: Stored csv feed (447 items) in: crawl/archive/volkswagen-newsroom.com.2026-05-17T00-00-24+00-00.csv 2026-05-17 00:01:59 [scrapy.extensions.feedexport] INFO: Stored csv feed (447 items) in: crawl/volkswagen-newsroom.com.csv 2026-05-17 00:01:59 [scrapy.extensions.feedexport] INFO: Stored json feed (447 items) in: crawl/archive/volkswagen-newsroom.com.2026-05-17T00-00-24+00-00.json 2026-05-17 00:01:59 [scrapy.extensions.feedexport] INFO: Stored json feed (447 items) in: crawl/volkswagen-newsroom.com.json 2026-05-17 00:01:59 [scrapy.statscollectors] INFO: Dumping Scrapy stats: {'downloader/request_bytes': 285019, 'downloader/request_count': 707, 'downloader/request_method_count/GET': 707, 'downloader/response_bytes': 13396750, 'downloader/response_count': 707, 'downloader/response_status_count/200': 497, 'downloader/response_status_count/429': 210, 'dupefilter/filtered': 1495, 'elapsed_time_seconds': 94.617986, 'feedexport/success_count/FileFeedStorage': 4, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2026, 5, 17, 0, 1, 59, 453951, tzinfo=datetime.timezone.utc), 'httpcompression/response_bytes': 60771531, 'httpcompression/response_count': 497, 'httperror/response_ignored_count': 58, 'httperror/response_ignored_status_count/429': 58, 'item_scraped_count': 447, 'items_per_minute': 285.3191489361702, 'log_count/ERROR': 58, 'log_count/INFO': 62, 'memusage/max': 107614208, 'memusage/startup': 94474240, 'request_depth_max': 1, 'response_received_count': 555, 'responses_per_minute': 354.25531914893617, 'retry/count': 152, 'retry/max_reached': 58, 'retry/reason_count/429 Unknown Status': 152, 'scheduler/dequeued': 707, 'scheduler/dequeued/memory': 707, 'scheduler/enqueued': 707, 'scheduler/enqueued/memory': 707, 'start_time': datetime.datetime(2026, 5, 17, 0, 0, 24, 835965, tzinfo=datetime.timezone.utc)} 2026-05-17 00:01:59 [scrapy.core.engine] INFO: Spider closed (finished)