• 'pip install logparser' on host 'scrapyd:6800' and run command 'logparser'. Or wait until LogParser parses the log.

PROJECT (crawlbottest), SPIDER (auditor_bot)

  • Log analysis
  • Log categorization
  • Progress visualization
  • View log
  • Crawler.stats
  • projectcrawlbottest
    spiderauditor_bot
    job2026-10-10T19_29_24
    first_log_time2026-10-10 19:29:26
    latest_log_time2026-10-10 19:30:47
    runtime0:01:21
    crawled_pages 50
    scraped_items 1000
    shutdown_reasonN/A
    finish_reasonfinished
    log_critical_count0
    log_error_count0
    log_warning_count3
    log_redirect_count0
    log_retry_count0
    log_ignore_count0
    latest_crawl
    latest_scrape
    latest_log
    current_time
    latest_item{'category': 'audit', 'raw_payload': {'availability': '', 'creation_date': '2026-10-10', 'price': '£26.08', 'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC', 'server_ip': '104.26.15.202'}, 'slug': '1,000-places-to-see-before-you-die.com'}
    • WARNING+

    • warning_logs
      3 in total

      2026-10-10 19:29:27 [py.warnings] WARNING: /usr/local/lib/python3.13/dist-packages/scrapy/pipelines/__init__.py:60: ScrapyDeprecationWarning: AuditMariaDBPipeline.open_spider() requires a spider argument, this is deprecated and the argument will not be passed in future Scrapy versions. If you need to access the spider instance you can save the crawler instance passed to from_crawler() and use its spider attribute.
        self._check_mw_method_spider_arg(mw.open_spider)
      
      2026-10-10 19:29:27 [py.warnings] WARNING: /usr/local/lib/python3.13/dist-packages/scrapy/pipelines/__init__.py:63: ScrapyDeprecationWarning: AuditMariaDBPipeline.close_spider() requires a spider argument, this is deprecated and the argument will not be passed in future Scrapy versions. If you need to access the spider instance you can save the crawler instance passed to from_crawler() and use its spider attribute.
        self._check_mw_method_spider_arg(mw.close_spider)
      
      2026-10-10 19:29:27 [py.warnings] WARNING: /usr/local/lib/python3.13/dist-packages/scrapy/pipelines/__init__.py:66: ScrapyDeprecationWarning: AuditMariaDBPipeline.process_item() requires a spider argument, this is deprecated and the argument will not be passed in future Scrapy versions. If you need to access the spider instance you can save the crawler instance passed to from_crawler() and use its spider attribute.
        self._check_mw_method_spider_arg(mw.process_item)
      

      INFO

      DEBUG

    • scrapy_version

      2.19.0
    • telnet_console

      127.0.0.1:6023
    • telnet_password

      40fe9ee35c9ac2d9
    • latest_crawl

      2026-10-10 19:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://books.toscrape.com/catalogue/page-50.html> (referer: https://books.toscrape.com/catalogue/page-49.html)
    • latest_stat

      2026-10-10 19:30:29 [scrapy.extensions.logstats] INFO: Crawled 38 pages (at 38 pages/min), scraped 760 items (at 760 items/min)
    • latest_scrape

      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
    • latest_item

      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£26.08',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': '1,000-places-to-see-before-you-die.com'}
    • Head

      2026-10-10 19:29:26 [scrapy.utils.log] INFO: Scrapy 2.19.0 started (bot: audit_engine)
      2026-10-10 19:29:26 [scrapy.utils.log] INFO: Versions:
      {'lxml': '6.1.3',
       'libxml2': '2.14.6',
       'cssselect': '1.5.0',
       'parsel': '1.12.1',
       'w3lib': '2.5.0',
       'Twisted': '26.4.0',
       'Python': '3.13.5 (main, Aug 10 2026, 12:06:59) [GCC 14.2.0]',
       'pyOpenSSL': '26.4.0 (OpenSSL 4.0.3 29 Sep 2026)',
       'cryptography': '50.0.2',
       'Platform': 'Linux-6.8.0-138-generic-x86_64-with-glibc2.41'}
      2026-10-10 19:29:26 [scrapy.crawler] DEBUG: Using AsyncCrawlerProcess
      2026-10-10 19:29:26 [asyncio] DEBUG: Using selector: EpollSelector
      2026-10-10 19:29:26 [scrapy.addons] INFO: Enabled addons:
      []
      2026-10-10 19:29:26 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
      2026-10-10 19:29:26 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
      2026-10-10 19:29:26 [scrapy.extensions.telnet] INFO: Telnet Password: 40fe9ee35c9ac2d9
      2026-10-10 19:29:27 [scrapy.middleware] INFO: Enabled extensions:
      ['scrapy.extensions.corestats.CoreStats',
       'scrapy.extensions.logcount.LogCount',
       'scrapy.extensions.telnet.TelnetConsole',
       'scrapy.extensions.memusage.MemoryUsage',
       'scrapy.extensions.feedexport.FeedExporter',
       'scrapy.extensions.logstats.LogStats',
       'scrapy.extensions.throttle.AutoThrottle',
       'scrapy.extensions.remote_control.RemoteControl']
      2026-10-10 19:29:27 [scrapy.crawler] INFO: Overridden settings:
      {'AUTOTHROTTLE_ENABLED': True,
       'AUTOTHROTTLE_MAX_DELAY': 10.0,
       'AUTOTHROTTLE_START_DELAY': 1.0,
       'BOT_NAME': 'audit_engine',
       'CONCURRENT_REQUESTS_PER_DOMAIN': 2,
       'COOKIES_ENABLED': False,
       'DOWNLOAD_DELAY': 1.0,
       'LOG_FILE': '/var/lib/scrapyd/logs/crawlbottest/auditor_bot/2026-10-10T19_29_24.log',
       'NEWSPIDER_MODULE': 'audit_engine.spiders',
       'SPIDER_MODULES': ['audit_engine.spiders']}
      2026-10-10 19:29:27 [scrapy.middleware] INFO: Enabled downloader middlewares:
      ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
       'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
       'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
       'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
       'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
       'scrapy.downloadermiddlewares.retry.RetryMiddleware',
       'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
       'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
       'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
       'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
       'scrapy.downloadermiddlewares.stats.DownloaderStats']
      2026-10-10 19:29:27 [scrapy.middleware] INFO: Enabled spider middlewares:
      ['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
       'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
       'scrapy.spidermiddlewares.referer.RefererMiddleware',
       'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
       'scrapy.spidermiddlewares.depth.DepthMiddleware',
       'scrapy.spidermiddlewares.metacopy.MetaCopyDetectionMiddleware']
      2026-10-10 19:29:27 [scrapy.middleware] INFO: Enabled item pipelines:
      ['audit_engine.pipelines.AuditMariaDBPipeline']
      2026-10-10 19:29:27 [py.warnings] WARNING: /usr/local/lib/python3.13/dist-packages/scrapy/pipelines/__init__.py:60: ScrapyDeprecationWarning: AuditMariaDBPipeline.open_spider() requires a spider argument, this is deprecated and the argument will not be passed in future Scrapy versions. If you need to access the spider instance you can save the crawler instance passed to from_crawler() and use its spider attribute.
        self._check_mw_method_spider_arg(mw.open_spider)
      
      2026-10-10 19:29:27 [py.warnings] WARNING: /usr/local/lib/python3.13/dist-packages/scrapy/pipelines/__init__.py:63: ScrapyDeprecationWarning: AuditMariaDBPipeline.close_spider() requires a spider argument, this is deprecated and the argument will not be passed in future Scrapy versions. If you need to access the spider instance you can save the crawler instance passed to from_crawler() and use its spider attribute.
        self._check_mw_method_spider_arg(mw.close_spider)
      
      2026-10-10 19:29:27 [py.warnings] WARNING: /usr/local/lib/python3.13/dist-packages/scrapy/pipelines/__init__.py:66: ScrapyDeprecationWarning: AuditMariaDBPipeline.process_item() requires a spider argument, this is deprecated and the argument will not be passed in future Scrapy versions. If you need to access the spider instance you can save the crawler instance passed to from_crawler() and use its spider attribute.
        self._check_mw_method_spider_arg(mw.process_item)
      
      2026-10-10 19:29:27 [scrapy.core.engine] INFO: Spider opened
      2026-10-10 19:29:27 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
      2026-10-10 19:29:27 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
      2026-10-10 19:29:27 [scrapy.extensions.remote_control] INFO: Remote control HTTP server listening on port 42291 (job 40-4e96b3838a154cdba577fdd63f52199a)
      2026-10-10 19:29:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://books.toscrape.com/> (referer: None)
      2026-10-10 19:29:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£51.77',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'a-light-in-the-attic.com'}
      2026-10-10 19:29:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£53.74',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'tipping-the-velvet.com'}
      2026-10-10 19:29:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£50.10',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'soumission.com'}
      2026-10-10 19:29:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/>
      {'category': 'audit',
    • Tail

      2026-10-10 19:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-49.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£40.28',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'fruits-basket,-vol-1-(fruits-basket-#1).com'}
      2026-10-10 19:30:47 [charset_normalizer] DEBUG: Encoding detection: Unable to determine any suitable charset.
      2026-10-10 19:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://books.toscrape.com/catalogue/page-50.html> (referer: https://books.toscrape.com/catalogue/page-49.html)
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£38.00',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'frankenstein.com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£28.80',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'forever-rockers-(the-rocker-#12).com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£39.24',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'fighting-fate-(fighting-#6).com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£32.93',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'emma.com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£51.32',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'eat,-pray,-love.com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£47.09',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'deep-under-(walker-security-#1).com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£28.42',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'choosing-our-religion-the-spiritual-lives-of-americas-nones.com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£22.85',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'charlie-and-the-chocolate-factory-(charlie-bucket-#1).com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£41.24',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'charitys-cross-(charles-towne-belles-#4).com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£39.07',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'bright-lines.com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£29.82',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'bridget-joness-diary-(bridget-jones-#1).com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£37.26',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'bounty-(colorado-mountain-#7).com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£20.30',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'blood-defense-(samantha-brinkman-#1).com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£34.65',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'bleach,-vol-1-strawberry-and-the-soul-reapers-(bleach-#1).com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£43.38',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'beyond-good-and-evil.com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£55.53',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'alice-in-wonderland-(alices-adventures-in-wonderland-#1).com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£57.06',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'ajin-demi-human,-volume-1-(ajin-demi-human-#1).com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£16.97',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': 'a-spys-devotion-(the-regency-spies-of-london-#1).com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£53.98',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': '1st-to-die-(womens-murder-club-#1).com'}
      2026-10-10 19:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://books.toscrape.com/catalogue/page-50.html>
      {'category': 'audit',
       'raw_payload': {'availability': '',
                       'creation_date': '2026-10-10',
                       'price': '£26.08',
                       'registrar_name': 'BookRegistry Sandbox Domain Registrar LLC',
                       'server_ip': '104.26.15.202'},
       'slug': '1,000-places-to-see-before-you-die.com'}
      2026-10-10 19:30:47 [scrapy.core.engine] INFO: Closing spider (finished)
      2026-10-10 19:30:47 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (1000 items) in: file:///var/lib/scrapyd/items/crawlbottest/auditor_bot/2026-10-10T19_29_24.jl
      2026-10-10 19:30:47 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
      {'downloader/request_bytes': 15430,
       'downloader/request_count': 50,
       'downloader/request_method_count/GET': 50,
       'downloader/response_bytes': 277108,
       'downloader/response_count': 50,
       'downloader/response_status_count/200': 50,
       'elapsed_time_seconds': 79.66898884018883,
       'feedexport/success_count/FileFeedStorage': 1,
       'finish_reason': 'finished',
       'finish_time': datetime.datetime(2026, 10, 10, 19, 30, 47, 205364, tzinfo=datetime.timezone.utc),
       'httpcompression/response_bytes': 2542961,
       'httpcompression/response_count': 50,
       'item_scraped_count': 1000,
       'items_per_minute': 759.493670886076,
       'log_count/DEBUG': 1099,
       'log_count/INFO': 5,
       'memusage/max': 97693696,
       'memusage/startup': 88256512,
       'request_depth_max': 49,
       'response_received_count': 50,
       'responses_per_minute': 37.9746835443038,
       'scheduler/dequeued': 50,
       'scheduler/dequeued/memory': 50,
       'scheduler/enqueued': 50,
       'scheduler/enqueued/memory': 50,
       'start_time': datetime.datetime(2026, 10, 10, 19, 29, 27, 536374, tzinfo=datetime.timezone.utc)}
      2026-10-10 19:30:47 [scrapy.core.engine] INFO: Spider closed (finished)
    • Log

      /1/log/utf8/crawlbottest/auditor_bot/2026-10-10T19_29_24/?job_finished=True

    • Source

      http://scrapyd:6800/logs/crawlbottest/auditor_bot/2026-10-10T19_29_24.log

  • sourcelog
    last_update_time2026-10-10 19:30:47
    last_update_timestamp1791660647
    downloader/request_bytes15430
    downloader/request_count50
    downloader/request_method_count/GET50
    downloader/response_bytes277108
    downloader/response_count50
    downloader/response_status_count/20050
    elapsed_time_seconds79.66898884018883
    feedexport/success_count/FileFeedStorage1
    finish_reasonfinished
    finish_timedatetime.datetime(2026, 10, 10, 19, 30, 47, 205364, tzinfo=datetime.timezone.utc)
    httpcompression/response_bytes2542961
    httpcompression/response_count50
    item_scraped_count1000
    items_per_minute759.493670886076
    log_count/DEBUG1099
    log_count/INFO5
    memusage/max97693696
    memusage/startup88256512
    request_depth_max49
    response_received_count50
    responses_per_minute37.9746835443038
    scheduler/dequeued50
    scheduler/dequeued/memory50
    scheduler/enqueued50
    scheduler/enqueued/memory50
    start_timedatetime.datetime(2026, 10, 10, 19, 29, 27, 536374, tzinfo=datetime.timezone.utc)