2024-06-17 18:10:48 [scrapy.utils.log] INFO: Scrapy 2.11.0 started (bot: gazette) 2024-06-17 18:10:48 [scrapy.utils.log] INFO: Versions: lxml 4.9.3.0, libxml2 2.10.3, cssselect 1.2.0, parsel 1.8.1, w3lib 2.1.2, Twisted 22.10.0, Python 3.10.7 (main, May 29 2023, 13:51:48) [GCC 12.2.0], pyOpenSSL 23.2.0 (OpenSSL 3.1.3 19 Sep 2023), cryptography 41.0.4, Platform Linux-5.19.0-46-generic-x86_64-with-glibc2.36 2024-06-17 18:10:48 [pr_clevelandia] INFO: Collecting data from 2024-05-01 to 2024-05-31. 2024-06-17 18:10:48 [scrapy.addons] INFO: Enabled addons: [] 2024-06-17 18:10:48 [py.warnings] WARNING: /home/marcos/Documentos/querido-diario/venv/lib/python3.10/site-packages/scrapy/utils/request.py:254: ScrapyDeprecationWarning: '2.6' is a deprecated value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. It is also the default value. In other words, it is normal to get this warning if you have not defined a value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. This is so for backward compatibility reasons, but it will change in a future version of Scrapy. See the documentation of the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting for information on how to handle this deprecation. return cls(crawler) 2024-06-17 18:10:48 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.epollreactor.EPollReactor 2024-06-17 18:10:48 [scrapy.extensions.telnet] INFO: Telnet Password: c2dae934e20e7d02 2024-06-17 18:10:48 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.feedexport.FeedExporter', 'scrapy.extensions.logstats.LogStats', 'spidermon.contrib.scrapy.extensions.Spidermon', 'gazette.extensions.StatsPersist'] 2024-06-17 18:10:48 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'gazette', 'COMMANDS_MODULE': 'gazette.commands', 'DOWNLOAD_TIMEOUT': 360, 'FILES_STORE_S3_ACL': 'public-read', 'LOG_FILE': 'log_pr_clevelandia_intervalo_maio_24.txt', 'NEWSPIDER_MODULE': 'gazette.spiders', 'SPIDER_MODULES': ['gazette.spiders'], 'TEMPLATES_DIR': 'templates', 'USER_AGENT': 'Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:108.0) ' 'Gecko/20100101 Firefox/108.0'} 2024-06-17 18:10:48 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy_zyte_smartproxy.ZyteSmartProxyMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2024-06-17 18:10:48 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2024-06-17 18:10:48 [scrapy.middleware] INFO: Enabled item pipelines: ['gazette.pipelines.GazetteDateFilteringPipeline', 'gazette.pipelines.DefaultValuesPipeline', 'gazette.pipelines.QueridoDiarioFilesPipeline', 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline', 'gazette.pipelines.SQLDatabasePipeline'] 2024-06-17 18:10:48 [scrapy.core.engine] INFO: Spider opened 2024-06-17 18:10:48 [gazette.database.models] INFO: Populating 'querido_diario_spider' table - Please wait! 2024-06-17 18:10:49 [gazette.database.models] INFO: Populating 'querido_diario_spider' table - Done! 2024-06-17 18:10:49 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-06-17 18:10:49 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023 2024-06-17 18:10:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:49 [tzlocal] DEBUG: /etc/timezone found, contents: America/Sao_Paulo 2024-06-17 18:10:49 [tzlocal] DEBUG: /etc/localtime found 2024-06-17 18:10:49 [tzlocal] DEBUG: 2 found: {'/etc/timezone': 'America/Sao_Paulo', '/etc/localtime is a symlink to': 'America/Sao_Paulo'} 2024-06-17 18:10:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D) 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-31', 'edition_number': '3335', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212034%22%2C%22hash%22%3A%22AC1FF087C861916D3DDDB6733276647B83AB3500%22%7D&cidade=padrao'], 'files': [{'checksum': '5566785c11c04a399c2413e0429bdaf6', 'path': '4105706/2024-05-31/2e5920ee12f6399f2534b7442409b2f2ef0e5caa.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212034%22%2C%22hash%22%3A%22AC1FF087C861916D3DDDB6733276647B83AB3500%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:49.842129Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-27', 'edition_number': '3327', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212026%22%2C%22hash%22%3A%224E322783EE331D416BDC027C38982BCA7942A58F%22%7D&cidade=padrao'], 'files': [{'checksum': '6f852b6147f2439d7ccb8802c6e70cfb', 'path': '4105706/2024-05-27/e222c0212f4642451dddf16a3a9560dcbc9802e0.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212026%22%2C%22hash%22%3A%224E322783EE331D416BDC027C38982BCA7942A58F%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:49.857888Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D) 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-28', 'edition_number': '3333', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212032%22%2C%22hash%22%3A%222898FA65A83D8D5F409FE2DF2E3BFD9FD1D8FFEC%22%7D&cidade=padrao'], 'files': [{'checksum': '0e89b2e4e66e9bb1faf5bce0175f1773', 'path': '4105706/2024-05-28/be9bda01faba930886effd67411a2acd88626cfe.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212032%22%2C%22hash%22%3A%222898FA65A83D8D5F409FE2DF2E3BFD9FD1D8FFEC%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:49.846924Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-28', 'edition_number': '3329', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212028%22%2C%22hash%22%3A%226DBF03431C7A7BF424DE205E39B88C54425F29CD%22%7D&cidade=padrao'], 'files': [{'checksum': '8e96b32030e8edd9702831b8d5101320', 'path': '4105706/2024-05-28/a7f47e7f4b63451275fd2579087ee579878c0d42.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212028%22%2C%22hash%22%3A%226DBF03431C7A7BF424DE205E39B88C54425F29CD%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:49.854254Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-28', 'edition_number': '3330', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212029%22%2C%22hash%22%3A%227604BA47659FA08BF661902999034718E6BB6C1B%22%7D&cidade=padrao'], 'files': [{'checksum': 'd8711efc81366398895c4ac5a120933b', 'path': '4105706/2024-05-28/74ab3a26d15049a6bf7d5c89b6ef6031982c5570.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212029%22%2C%22hash%22%3A%227604BA47659FA08BF661902999034718E6BB6C1B%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:49.852596Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-28', 'edition_number': '3331', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212030%22%2C%22hash%22%3A%220791923653606B63C261B71EFB8D45F1A5B22131%22%7D&cidade=padrao'], 'files': [{'checksum': '60be8e7229bf09e4c9cd74681345941c', 'path': '4105706/2024-05-28/9ed13d273c8d0ae324773f84079d6451ccf085da.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212030%22%2C%22hash%22%3A%220791923653606B63C261B71EFB8D45F1A5B22131%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:49.850785Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-28', 'edition_number': '3332', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212031%22%2C%22hash%22%3A%22C19F1B4139B91A8097DAFB36F237594BFBEED608%22%7D&cidade=padrao'], 'files': [{'checksum': '4d09ddcc866bcd7c07c76be0faedc751', 'path': '4105706/2024-05-28/3d9e4120d4a0a35d14e5dd76db48992342db9b2e.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212031%22%2C%22hash%22%3A%22C19F1B4139B91A8097DAFB36F237594BFBEED608%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:49.848833Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-27', 'edition_number': '3328', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212027%22%2C%22hash%22%3A%22E8CD595994E064E24D9700E0BBFED3D1BF77EA57%22%7D&cidade=padrao'], 'files': [{'checksum': '0469489c7ad44c7e6adcc5d538541d81', 'path': '4105706/2024-05-27/2fca91d7d2747d67ab66e505955d5309b1678a21.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212027%22%2C%22hash%22%3A%22E8CD595994E064E24D9700E0BBFED3D1BF77EA57%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:49.856194Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-29', 'edition_number': '3334', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212033%22%2C%22hash%22%3A%229DACA4ACF887A78360765DFE2BA46C55AA44FE26%22%7D&cidade=padrao'], 'files': [{'checksum': '5c322934c2443d3f5b2f72c3a0af0ba1', 'path': '4105706/2024-05-29/e46c57469cf4c3f2ea9d9ad14e74e5a9d376a2ac.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212033%22%2C%22hash%22%3A%229DACA4ACF887A78360765DFE2BA46C55AA44FE26%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:49.845050Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-23', 'edition_number': '3324', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212023%22%2C%22hash%22%3A%22ECD418ECCD3A13753B981CABB9E517AA5248654C%22%7D&cidade=padrao'], 'files': [{'checksum': 'bdc13fae1dab37ad892dbe86300e772d', 'path': '4105706/2024-05-23/23f36acd462302620fdc8152fe458d820d0dafbf.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212023%22%2C%22hash%22%3A%22ECD418ECCD3A13753B981CABB9E517AA5248654C%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.435525Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-22', 'edition_number': '3322', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212021%22%2C%22hash%22%3A%22E49EFA782AF9DFB4EBFFFB4441AFB2C0B52D2CF9%22%7D&cidade=padrao'], 'files': [{'checksum': '3ad3c4c5340f05067c311074edb6cf30', 'path': '4105706/2024-05-22/861c3f49c51343af50d436b1494b7bfc1ffb1ea0.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212021%22%2C%22hash%22%3A%22E49EFA782AF9DFB4EBFFFB4441AFB2C0B52D2CF9%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.439338Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-23', 'edition_number': '3323', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212022%22%2C%22hash%22%3A%22734B6181F8A8B78F54AC3A28C8E2E269BC794DC3%22%7D&cidade=padrao'], 'files': [{'checksum': '72a4c720ebb37f2eda784b4e3cd16966', 'path': '4105706/2024-05-23/a902f38c580824624a0327c8c1188a09c65ddfc2.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212022%22%2C%22hash%22%3A%22734B6181F8A8B78F54AC3A28C8E2E269BC794DC3%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.437069Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-24', 'edition_number': '3325', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212024%22%2C%22hash%22%3A%22A5068CB79379F30793ECC88C87173C0EFEBD64B8%22%7D&cidade=padrao'], 'files': [{'checksum': '851bc32134f24c1ad6ae1fb95622cc73', 'path': '4105706/2024-05-24/1fa1192c47299e793b10de7251a4fbbbdcc1ab3c.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212024%22%2C%22hash%22%3A%22A5068CB79379F30793ECC88C87173C0EFEBD64B8%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.433849Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-24', 'edition_number': '3326', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212025%22%2C%22hash%22%3A%229A1BCFEE08255A014F707846A2EA944A416FB95B%22%7D&cidade=padrao'], 'files': [{'checksum': 'f7b09c0f0382d926a59b2676668d6edf', 'path': '4105706/2024-05-24/d0d4218c772cf92aee8980be0105e9c74c2093f6.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212025%22%2C%22hash%22%3A%229A1BCFEE08255A014F707846A2EA944A416FB95B%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.431826Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-21', 'edition_number': '3321', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212020%22%2C%22hash%22%3A%22FBE04A5ABFCE6CCA0923403152FB661B58DD9210%22%7D&cidade=padrao'], 'files': [{'checksum': '24edb26bddb80e87a989d91badc38e37', 'path': '4105706/2024-05-21/2bbed489b70acc41a662fa155b0f521fa834ad44.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212020%22%2C%22hash%22%3A%22FBE04A5ABFCE6CCA0923403152FB661B58DD9210%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.446022Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-21', 'edition_number': '3320', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212019%22%2C%22hash%22%3A%22DC580928749F465AD3C7F42ACF524F143C488DFA%22%7D&cidade=padrao'], 'files': [{'checksum': '08a100b8f4f7d4570d5d169633e358e5', 'path': '4105706/2024-05-21/493581e82f1555ee27c9a9feec315d32115e4722.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212019%22%2C%22hash%22%3A%22DC580928749F465AD3C7F42ACF524F143C488DFA%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.447872Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-20', 'edition_number': '3318', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212017%22%2C%22hash%22%3A%228E15BF1DD740212F071C232186A51314580AA44E%22%7D&cidade=padrao'], 'files': [{'checksum': '068b684710adc63d6112c9afdb5d9399', 'path': '4105706/2024-05-20/adc2d86991ed671d37aab75bb62496d7c985fa8b.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212017%22%2C%22hash%22%3A%228E15BF1DD740212F071C232186A51314580AA44E%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.482745Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:50 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-17', 'edition_number': '3316', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212015%22%2C%22hash%22%3A%22F1018C368037ED0E8BE4EBB3D3D029400D045104%22%7D&cidade=padrao'], 'files': [{'checksum': '2f8f5c202491a75538eb63791016d9bf', 'path': '4105706/2024-05-17/1106fdf0ffee669444f4d20969613040fda7877f.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212015%22%2C%22hash%22%3A%22F1018C368037ED0E8BE4EBB3D3D029400D045104%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.485123Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D) 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-20', 'edition_number': '3317', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212016%22%2C%22hash%22%3A%2286F04F05FCC78E908AC22834529515CE5720CA86%22%7D&cidade=padrao'], 'files': [{'checksum': '33831b7b150a643a1eea8ef8f4895991', 'path': '4105706/2024-05-20/0b951e292ef3dd1879209e984818bbcd065a46dc.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212016%22%2C%22hash%22%3A%2286F04F05FCC78E908AC22834529515CE5720CA86%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.483992Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-16', 'edition_number': '3312', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212011%22%2C%22hash%22%3A%22B5DE0BD5A05B30FAABD9C79D88D9C5D23C39978C%22%7D&cidade=padrao'], 'files': [{'checksum': '6c747c696a7579c08490b1400e35eb3d', 'path': '4105706/2024-05-16/5716a7868f4c32968daf7840efe72cd21eea33e6', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212011%22%2C%22hash%22%3A%22B5DE0BD5A05B30FAABD9C79D88D9C5D23C39978C%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.489654Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-17', 'edition_number': '3315', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212014%22%2C%22hash%22%3A%22AFF59FDD4E4B71FD643695439E0997A56B69AB64%22%7D&cidade=padrao'], 'files': [{'checksum': '0cc9be5f2b797b0f58901eb349adc583', 'path': '4105706/2024-05-17/58a1afa1fa78bd623721101db621464c86bf0be5.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212014%22%2C%22hash%22%3A%22AFF59FDD4E4B71FD643695439E0997A56B69AB64%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.486223Z', 'territory_id': '4105706'} 2024-06-17 18:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-17', 'edition_number': '3314', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212013%22%2C%22hash%22%3A%227C657A4583CDEB153754FD47814335EDA77D8794%22%7D&cidade=padrao'], 'files': [{'checksum': '4849336ad61c9a6c681a4af2b897e337', 'path': '4105706/2024-05-17/e3d656c71a0697a3ece5e2d905a17dded1c27d96.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212013%22%2C%22hash%22%3A%227C657A4583CDEB153754FD47814335EDA77D8794%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.487417Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%224%22%7D%7D> {'date': '2024-05-16', 'edition_number': '3311', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212010%22%2C%22hash%22%3A%2264DA97E6107EC75D529362425C5B676203DAC540%22%7D&cidade=padrao'], 'files': [{'checksum': 'ac834fbd551c740b857aaf30d2eb1613', 'path': '4105706/2024-05-16/b337ce80cb4b9eb148322a1ec9ef479a5a96f80e.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212010%22%2C%22hash%22%3A%2264DA97E6107EC75D529362425C5B676203DAC540%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.971236Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%224%22%7D%7D> {'date': '2024-05-10', 'edition_number': '3306', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212005%22%2C%22hash%22%3A%22E09C4D9D7201412C2E99EAC41E11C79D401BCE3B%22%7D&cidade=padrao'], 'files': [{'checksum': '7e9c8b6dd5b073c2183d40aacf7e1062', 'path': '4105706/2024-05-10/e1ea27d1573a7e63eba7b4e0f1926df877979aac.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212005%22%2C%22hash%22%3A%22E09C4D9D7201412C2E99EAC41E11C79D401BCE3B%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.985508Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%224%22%7D%7D> {'date': '2024-05-10', 'edition_number': '3308', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212007%22%2C%22hash%22%3A%2262DA83A8D9B703E4FC83D3BDBD7996B40783AAA4%22%7D&cidade=padrao'], 'files': [{'checksum': '7b9529442cb5b21f6d5b2ef7988a1fd2', 'path': '4105706/2024-05-10/085e437f05d54940007454ed1ce2e4e1a2618195.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212007%22%2C%22hash%22%3A%2262DA83A8D9B703E4FC83D3BDBD7996B40783AAA4%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.982107Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%224%22%7D%7D> {'date': '2024-05-10', 'edition_number': '3307', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212006%22%2C%22hash%22%3A%2258A69E4ECE78D3A63C75F2636CFC757C3928D650%22%7D&cidade=padrao'], 'files': [{'checksum': 'b7957b10ba5e53c3fc3d07f317362e0f', 'path': '4105706/2024-05-10/b30c0e57aa68e1f410df58a0a15445887eaddb2d.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212006%22%2C%22hash%22%3A%2258A69E4ECE78D3A63C75F2636CFC757C3928D650%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.983905Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-21', 'edition_number': '3319', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212018%22%2C%22hash%22%3A%228CF66F4A337D4DE51380E2B3748C7FE21FED54D4%22%7D&cidade=padrao'], 'files': [{'checksum': 'ed71a69157d4412e6a338f2ba8b9f08c', 'path': '4105706/2024-05-21/567f04367f8fcdd849324bc8fe268d9483fe5452.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212018%22%2C%22hash%22%3A%228CF66F4A337D4DE51380E2B3748C7FE21FED54D4%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.449602Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%224%22%7D%7D> {'date': '2024-05-14', 'edition_number': '3309', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212008%22%2C%22hash%22%3A%226E562B85CC384AE36E1EA16BE84EEA3C9A7654A4%22%7D&cidade=padrao'], 'files': [{'checksum': 'f6e72cd96dc661569f72aef0407960f7', 'path': '4105706/2024-05-14/5de150316a8bdfae957b17d22b918ea5892b9335.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212008%22%2C%22hash%22%3A%226E562B85CC384AE36E1EA16BE84EEA3C9A7654A4%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.980240Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%224%22%7D%7D> {'date': '2024-05-14', 'edition_number': '3310', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212009%22%2C%22hash%22%3A%2226A579DAF01AD893249CE00E65DC616FE46180C8%22%7D&cidade=padrao'], 'files': [{'checksum': 'ad1ac484653508f3876f1823c6033cdd', 'path': '4105706/2024-05-14/e80e6317a0bbb850ad53d1d3143a4d183f9bb0d9.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212009%22%2C%22hash%22%3A%2226A579DAF01AD893249CE00E65DC616FE46180C8%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.977312Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 18:10:51 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 18:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%224%22%7D%7D> {'date': '2024-05-03', 'edition_number': '3300', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2211999%22%2C%22hash%22%3A%223F829166C77483581E2A634767E842D9B96187DC%22%7D&cidade=padrao'], 'files': [{'checksum': 'b5702fdf1f396d4a0ab460d9aa6b450e', 'path': '4105706/2024-05-03/d348fbc66f1e9f7ae6e14ff2960ede7b0d864dc7.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2211999%22%2C%22hash%22%3A%223F829166C77483581E2A634767E842D9B96187DC%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.993066Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%223%22%7D%7D> {'date': '2024-05-17', 'edition_number': '3313', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212012%22%2C%22hash%22%3A%2218E923C7FC487D783F21A18D09085A15630DFED7%22%7D&cidade=padrao'], 'files': [{'checksum': 'cdf2381b248e6ea1d854ba3c156abded', 'path': '4105706/2024-05-17/cf6930a5b9a76154c68e6c43f27d360c1607d112', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212012%22%2C%22hash%22%3A%2218E923C7FC487D783F21A18D09085A15630DFED7%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.488523Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%224%22%7D%7D> {'date': '2024-05-07', 'edition_number': '3304', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212003%22%2C%22hash%22%3A%225D245F9749592E81D9FD0C6E4E890D402F3942B4%22%7D&cidade=padrao'], 'files': [{'checksum': '9e1b31feecc5082a84646846d7af67ac', 'path': '4105706/2024-05-07/1fa3aecdde3b2584f033b4fbc834c8616440dba7.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212003%22%2C%22hash%22%3A%225D245F9749592E81D9FD0C6E4E890D402F3942B4%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.988473Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%224%22%7D%7D> {'date': '2024-05-09', 'edition_number': '3305', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212004%22%2C%22hash%22%3A%22242ABCEAB37C81F80D57E8B467550E32CB637CF0%22%7D&cidade=padrao'], 'files': [{'checksum': '64ab8c54750db82c63b9ccf8aa44e7e5', 'path': '4105706/2024-05-09/69220da8470a8b6f622682f9849dc4e4265665cf.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212004%22%2C%22hash%22%3A%22242ABCEAB37C81F80D57E8B467550E32CB637CF0%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.987334Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%224%22%7D%7D> {'date': '2024-05-06', 'edition_number': '3303', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212002%22%2C%22hash%22%3A%2298FDFAAE7CB21F5044BD0D728A82C61610868201%22%7D&cidade=padrao'], 'files': [{'checksum': '4a0bf312b5027d4b2b1ba6438fc35ca4', 'path': '4105706/2024-05-06/9406c4a3bbd241b38a8fb692df9a0f4e8fa1c1f2.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212002%22%2C%22hash%22%3A%2298FDFAAE7CB21F5044BD0D728A82C61610868201%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.989615Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%224%22%7D%7D> {'date': '2024-05-06', 'edition_number': '3302', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212001%22%2C%22hash%22%3A%220925B9771D9E12847B115B4EB14BC6D3580F13B3%22%7D&cidade=padrao'], 'files': [{'checksum': 'e240f768fb6b66da3c900b30b23e52f1', 'path': '4105706/2024-05-06/f3d8d6356f1a941ba47a9c384cf5d48710acd4e1.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212001%22%2C%22hash%22%3A%220925B9771D9E12847B115B4EB14BC6D3580F13B3%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.990872Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%224%22%7D%7D> {'date': '2024-05-06', 'edition_number': '3301', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212000%22%2C%22hash%22%3A%22EF73041D3664359E5DC57CA206AEA44F55A784C0%22%7D&cidade=padrao'], 'files': [{'checksum': '9ed9cee8a9dbecb2f1154fdbf4250adf', 'path': '4105706/2024-05-06/2693543b8719432e30011d93c83e348915e53fad.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2212000%22%2C%22hash%22%3A%22EF73041D3664359E5DC57CA206AEA44F55A784C0%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.991991Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%224%22%7D%7D> {'date': '2024-05-02', 'edition_number': '3299', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2211998%22%2C%22hash%22%3A%22365D802A27992C8DD1ED468017107D5633AD3C01%22%7D&cidade=padrao'], 'files': [{'checksum': '56fd8cbb7148bdde2fd625f241c2f6c3', 'path': '4105706/2024-05-02/93df54bd10879fd1d0ad52c4a47ffe48d800093d.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2211998%22%2C%22hash%22%3A%22365D802A27992C8DD1ED468017107D5633AD3C01%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.994192Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%224%22%7D%7D> {'date': '2024-05-02', 'edition_number': '3298', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2211997%22%2C%22hash%22%3A%229EAC2C428AA390C98D6FCF5F2A53A165E1F78130%22%7D&cidade=padrao'], 'files': [{'checksum': '4adc1135ab3c0049926e0cd27da59644', 'path': '4105706/2024-05-02/f08c3f059f41a82b5258642d43d4a14c945be4d6.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2211997%22%2C%22hash%22%3A%229EAC2C428AA390C98D6FCF5F2A53A165E1F78130%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.995307Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%224%22%7D%7D) 2024-06-17 18:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://clevelandia.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%224%22%7D%7D> {'date': '2024-05-02', 'edition_number': '3297', 'file_urls': ['https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2211996%22%2C%22hash%22%3A%225C848446C579BC39CF7FFABE22603CF6D835D2DF%22%7D&cidade=padrao'], 'files': [{'checksum': '9d7c8460ba1aae08ef2096622b97cb20', 'path': '4105706/2024-05-02/aecaf43b64b39738f3c28b6ce9eb8836d7c335a5.pdf', 'status': 'downloaded', 'url': 'https://clevelandia.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%2211996%22%2C%22hash%22%3A%225C848446C579BC39CF7FFABE22603CF6D835D2DF%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T21:10:50.996499Z', 'territory_id': '4105706'} 2024-06-17 18:10:51 [scrapy.core.engine] INFO: Closing spider (finished) 2024-06-17 18:10:51 [scrapy.extensions.feedexport] INFO: Stored csv feed (39 items) in: pr_clevelandia_intervalo_maio_24.csv 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] ------------------------------ MONITORS ------------------------------ 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] Comparison Between Executions/Days without gazettes... OK 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] Requests/Items Ratio/Ratio of requests over items scraped count... OK 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] Error Count Monitor/test_stat_monitor... SKIPPED (Unable to find 'log_count/ERROR' in job stats.) 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] Finish Reason Monitor/Should have the expected finished reason(s)... OK 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] Item Validation Monitor/test_stat_monitor... SKIPPED (Unable to find 'spidermon/validation/fields/errors' in job stats.) 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] ---------------------------------------------------------------------- 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] 5 monitors in 0.003s 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] OK (skipped=2) 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] -------------------------- FINISHED ACTIONS -------------------------- 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] ---------------------------------------------------------------------- 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] 0 actions in 0.000s 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] OK 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] --------------------------- PASSED ACTIONS --------------------------- 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] ---------------------------------------------------------------------- 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] 0 actions in 0.000s 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] OK 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] --------------------------- FAILED ACTIONS --------------------------- 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] ---------------------------------------------------------------------- 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] 1 action in 0.000s 2024-06-17 18:10:51 [pr_clevelandia] INFO: [Spidermon] OK (skipped=1) 2024-06-17 18:10:51 [scrapy.statscollectors] INFO: Dumping Scrapy stats: {'downloader/request_bytes': 22613, 'downloader/request_count': 44, 'downloader/request_method_count/GET': 44, 'downloader/response_bytes': 4322945, 'downloader/response_count': 44, 'downloader/response_status_count/200': 44, 'elapsed_time_seconds': 2.539772, 'feedexport/success_count/FileFeedStorage': 1, 'file_count': 39, 'file_status_count/downloaded': 39, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2024, 6, 17, 21, 10, 51, 555481, tzinfo=datetime.timezone.utc), 'httpcompression/response_bytes': 115958, 'httpcompression/response_count': 5, 'item_scraped_count': 39, 'log_count/DEBUG': 126, 'log_count/INFO': 34, 'log_count/WARNING': 1, 'memusage/max': 123461632, 'memusage/startup': 123461632, 'request_depth_max': 4, 'response_received_count': 44, 'scheduler/dequeued': 5, 'scheduler/dequeued/memory': 5, 'scheduler/enqueued': 5, 'scheduler/enqueued/memory': 5, 'spidermon/validation/fields': 312, 'spidermon/validation/items': 39, 'spidermon/validation/validators': 1, 'spidermon/validation/validators/item/jsonschema': True, 'start_time': datetime.datetime(2024, 6, 17, 21, 10, 49, 15709, tzinfo=datetime.timezone.utc)} 2024-06-17 18:10:51 [scrapy.core.engine] INFO: Spider closed (finished)