2024-06-17 17:56:19 [scrapy.utils.log] INFO: Scrapy 2.11.0 started (bot: gazette) 2024-06-17 17:56:19 [scrapy.utils.log] INFO: Versions: lxml 4.9.3.0, libxml2 2.10.3, cssselect 1.2.0, parsel 1.8.1, w3lib 2.1.2, Twisted 22.10.0, Python 3.10.7 (main, May 29 2023, 13:51:48) [GCC 12.2.0], pyOpenSSL 23.2.0 (OpenSSL 3.1.3 19 Sep 2023), cryptography 41.0.4, Platform Linux-5.19.0-46-generic-x86_64-with-glibc2.36 2024-06-17 17:56:19 [pr_campo_mourao] INFO: Collecting data from 2024-05-01 to 2024-05-31. 2024-06-17 17:56:19 [scrapy.addons] INFO: Enabled addons: [] 2024-06-17 17:56:19 [py.warnings] WARNING: /home/marcos/Documentos/querido-diario/venv/lib/python3.10/site-packages/scrapy/utils/request.py:254: ScrapyDeprecationWarning: '2.6' is a deprecated value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. It is also the default value. In other words, it is normal to get this warning if you have not defined a value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. This is so for backward compatibility reasons, but it will change in a future version of Scrapy. See the documentation of the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting for information on how to handle this deprecation. return cls(crawler) 2024-06-17 17:56:19 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.epollreactor.EPollReactor 2024-06-17 17:56:19 [scrapy.extensions.telnet] INFO: Telnet Password: 27edfd8bd705042b 2024-06-17 17:56:19 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.feedexport.FeedExporter', 'scrapy.extensions.logstats.LogStats', 'spidermon.contrib.scrapy.extensions.Spidermon', 'gazette.extensions.StatsPersist'] 2024-06-17 17:56:19 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'gazette', 'COMMANDS_MODULE': 'gazette.commands', 'DOWNLOAD_TIMEOUT': 360, 'FILES_STORE_S3_ACL': 'public-read', 'LOG_FILE': 'log_pr_campo_mourao_intervalo_maio_24.txt', 'NEWSPIDER_MODULE': 'gazette.spiders', 'SPIDER_MODULES': ['gazette.spiders'], 'TEMPLATES_DIR': 'templates', 'USER_AGENT': 'Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:108.0) ' 'Gecko/20100101 Firefox/108.0'} 2024-06-17 17:56:19 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy_zyte_smartproxy.ZyteSmartProxyMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2024-06-17 17:56:19 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2024-06-17 17:56:19 [scrapy.middleware] INFO: Enabled item pipelines: ['gazette.pipelines.GazetteDateFilteringPipeline', 'gazette.pipelines.DefaultValuesPipeline', 'gazette.pipelines.QueridoDiarioFilesPipeline', 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline', 'gazette.pipelines.SQLDatabasePipeline'] 2024-06-17 17:56:19 [scrapy.core.engine] INFO: Spider opened 2024-06-17 17:56:20 [gazette.database.models] INFO: Populating 'querido_diario_spider' table - Please wait! 2024-06-17 17:56:20 [gazette.database.models] INFO: Populating 'querido_diario_spider' table - Done! 2024-06-17 17:56:20 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-06-17 17:56:20 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023 2024-06-17 17:56:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:56:20 [tzlocal] DEBUG: /etc/timezone found, contents: America/Sao_Paulo 2024-06-17 17:56:20 [tzlocal] DEBUG: /etc/localtime found 2024-06-17 17:56:20 [tzlocal] DEBUG: 2 found: {'/etc/timezone': 'America/Sao_Paulo', '/etc/localtime is a symlink to': 'America/Sao_Paulo'} 2024-06-17 17:56:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D) 2024-06-17 17:56:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:56:22 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:56:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D> {'date': '2024-05-28', 'edition_number': '3033', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223970%22%2C%22hash%22%3A%221888037D24C799D7156BAE544880683CB8C9E593%22%7D&cidade=padrao'], 'files': [{'checksum': 'dc761dc285b46a804f67c50850608b45', 'path': '4104303/2024-05-28/1955f150add666b77dda2d8edde8b2b8b641f958.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223970%22%2C%22hash%22%3A%221888037D24C799D7156BAE544880683CB8C9E593%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:56:20.699247Z', 'territory_id': '4104303'} 2024-06-17 17:56:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:56:22 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:56:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D> {'date': '2024-05-21', 'edition_number': '3030', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223965%22%2C%22hash%22%3A%2262E64DB9762F26DADFAE545AB23E9A5A05DB880A%22%7D&cidade=padrao'], 'files': [{'checksum': '35439bc21b17fb2f46d0fc5389c5bd0b', 'path': '4104303/2024-05-21/bf481bb9eced127508788e29f14c98b829128656.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223965%22%2C%22hash%22%3A%2262E64DB9762F26DADFAE545AB23E9A5A05DB880A%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:56:20.708042Z', 'territory_id': '4104303'} 2024-06-17 17:56:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:56:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:56:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D> {'date': '2024-05-22', 'edition_number': '3031', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223967%22%2C%22hash%22%3A%225D97A6EBB98C47304D0EE3FC82CD1F02FA11FC28%22%7D&cidade=padrao'], 'files': [{'checksum': '8f6ab9664db5adc760367c57400ea95f', 'path': '4104303/2024-05-22/df23dba948eb1627ffd7c19ff4588fb109fb4baa.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223967%22%2C%22hash%22%3A%225D97A6EBB98C47304D0EE3FC82CD1F02FA11FC28%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:56:20.704581Z', 'territory_id': '4104303'} 2024-06-17 17:56:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:56:23 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:56:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D> {'date': '2024-05-28', 'edition_number': '3033', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223969%22%2C%22hash%22%3A%2204B969732369E34D3E785242817DC988E39063FA%22%7D&cidade=padrao'], 'files': [{'checksum': '44e6d4d1f1a4304d8f8d3c48788f829e', 'path': '4104303/2024-05-28/6c5c17299b7eac878229f91ab2985eea263a149a.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223969%22%2C%22hash%22%3A%2204B969732369E34D3E785242817DC988E39063FA%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:56:20.701112Z', 'territory_id': '4104303'} 2024-06-17 17:56:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:56:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:56:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:56:24 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:56:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-15', 'edition_number': '3028', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223962%22%2C%22hash%22%3A%2216B28905AF2210E03460A259B39CAD9FA497DA5F%22%7D&cidade=padrao'], 'files': [{'checksum': 'd0764cca31eaac8718fd9b4e812ec226', 'path': '4104303/2024-05-15/5bd12b858fd47daaeda938b164d6e87420d57dc8.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223962%22%2C%22hash%22%3A%2216B28905AF2210E03460A259B39CAD9FA497DA5F%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:56:21.349939Z', 'territory_id': '4104303'} 2024-06-17 17:56:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D> {'date': '2024-05-22', 'edition_number': '3031', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223966%22%2C%22hash%22%3A%224223E5600D2DA1A5D5C7256754126D4F8E44451E%22%7D&cidade=padrao'], 'files': [{'checksum': '0ce6280f47a247e5717f0ba238a4b2c2', 'path': '4104303/2024-05-22/153a695e6356aada81401b9e367cc53df94ed557.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223966%22%2C%22hash%22%3A%224223E5600D2DA1A5D5C7256754126D4F8E44451E%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:56:20.706268Z', 'territory_id': '4104303'} 2024-06-17 17:56:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:56:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:56:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:56:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:56:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:56:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-10', 'edition_number': '3026', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223959%22%2C%22hash%22%3A%22E1C04D5157F146E11693EBF45B0570725873FC39%22%7D&cidade=padrao'], 'files': [{'checksum': '457b7bd6819f63d502c8124d6c2a7991', 'path': '4104303/2024-05-10/02d2ab73f5a4eb9fbe771a83ce95678fc24719eb.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223959%22%2C%22hash%22%3A%22E1C04D5157F146E11693EBF45B0570725873FC39%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:56:21.354672Z', 'territory_id': '4104303'} 2024-06-17 17:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-15', 'edition_number': '3028', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223961%22%2C%22hash%22%3A%222D50DC6BAA0E7F40FB42319B51355612174EDD29%22%7D&cidade=padrao'], 'files': [{'checksum': '867f3fd5868664b524b9d48c06502357', 'path': '4104303/2024-05-15/c937dfad1528591f564d306822eecd646cb21ce2.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223961%22%2C%22hash%22%3A%222D50DC6BAA0E7F40FB42319B51355612174EDD29%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:56:21.351901Z', 'territory_id': '4104303'} 2024-06-17 17:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-21', 'edition_number': '3030', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223964%22%2C%22hash%22%3A%22055C8427C44EFFFCDA654E375CEB22798A1D899E%22%7D&cidade=padrao'], 'files': [{'checksum': 'c0eb7541d4251c9ef2e0323760b0570f', 'path': '4104303/2024-05-21/8ce80f6b614be7207839b3d43ce3a4874d5aff6c.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223964%22%2C%22hash%22%3A%22055C8427C44EFFFCDA654E375CEB22798A1D899E%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:56:21.339353Z', 'territory_id': '4104303'} 2024-06-17 17:56:25 [scrapy.crawler] INFO: Received SIGINT, shutting down gracefully. Send again to force 2024-06-17 17:56:25 [scrapy.core.engine] INFO: Closing spider (shutdown) 2024-06-17 17:56:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:56:25 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:56:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D> {'date': '2024-05-24', 'edition_number': '3032', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223968%22%2C%22hash%22%3A%22C6A264E9229005C3CFE26828E579CFDD4381CB0E%22%7D&cidade=padrao'], 'files': [{'checksum': '5407b9944c77d3453dcbae46106f6ef9', 'path': '4104303/2024-05-24/44a1c357302a2be23856120dace0d2f6c495f074.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223968%22%2C%22hash%22%3A%22C6A264E9229005C3CFE26828E579CFDD4381CB0E%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:56:20.702808Z', 'territory_id': '4104303'} 2024-06-17 17:56:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:56:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-14', 'edition_number': '3027', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223960%22%2C%22hash%22%3A%22A06B03BD4AAAEAB21337CDFC545F6831FA8D5C0F%22%7D&cidade=padrao'], 'files': [{'checksum': '913cc34f9996c6b6c94d4d28c0b475ab', 'path': '4104303/2024-05-14/e79ea9b3e5f6386ef3db0b87ee1f92669a0c151e.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223960%22%2C%22hash%22%3A%22A06B03BD4AAAEAB21337CDFC545F6831FA8D5C0F%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:56:21.353378Z', 'territory_id': '4104303'} 2024-06-17 17:56:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:56:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:56:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:56:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-03', 'edition_number': '3023', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223955%22%2C%22hash%22%3A%22E0B7951CB728D98FA43632099E9F5CC26BEC6F13%22%7D&cidade=padrao'], 'files': [{'checksum': '51e51c4c505532dcb706db1ab5d6e6c0', 'path': '4104303/2024-05-03/1b6706aaeed9deeabb0222a1cbb4ebcb29790bd7.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223955%22%2C%22hash%22%3A%22E0B7951CB728D98FA43632099E9F5CC26BEC6F13%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:56:21.359466Z', 'territory_id': '4104303'} 2024-06-17 17:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-17', 'edition_number': '3029', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223963%22%2C%22hash%22%3A%226D65B1C3A5D7F1C40342405763FDC98BB3C04250%22%7D&cidade=padrao'], 'files': [{'checksum': '49e16ca7d126547221d99e9dcb2fcd00', 'path': '4104303/2024-05-17/2f80b14a5efcf0426b035b9751bca50a89eb1cb0.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223963%22%2C%22hash%22%3A%226D65B1C3A5D7F1C40342405763FDC98BB3C04250%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:56:21.347021Z', 'territory_id': '4104303'} 2024-06-17 17:56:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:56:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:56:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:56:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D> {'date': '2024-05-29', 'edition_number': '3034', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223971%22%2C%22hash%22%3A%223708760D531E42B8E0040B9AE2E5B22A0DCC555F%22%7D&cidade=padrao'], 'files': [{'checksum': 'dfa7158706427c3b4b2d4e0c4f037ded', 'path': '4104303/2024-05-29/322515dcdb5d85045da8cdb03e5cd0f6428824f8.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223971%22%2C%22hash%22%3A%223708760D531E42B8E0040B9AE2E5B22A0DCC555F%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:56:20.697251Z', 'territory_id': '4104303'} 2024-06-17 17:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-08', 'edition_number': '3025', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223957%22%2C%22hash%22%3A%22479A367750123D6BEE7C72C68F2CF7A6AED1757D%22%7D&cidade=padrao'], 'files': [{'checksum': 'd05f6f44fb6719c8cf9d8a6a54c4c4fc', 'path': '4104303/2024-05-08/cd8848908a29f2a81db95e0bf279b1ec81926b4e.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223957%22%2C%22hash%22%3A%22479A367750123D6BEE7C72C68F2CF7A6AED1757D%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:56:21.357165Z', 'territory_id': '4104303'} 2024-06-17 17:56:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:56:26 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-03', 'edition_number': '3023', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223954%22%2C%22hash%22%3A%222C8F14749215DC69994B8284C6300CE25228FC3E%22%7D&cidade=padrao'], 'files': [{'checksum': '1ebecb9ca2ec4d9a8ff677f76106d5e6', 'path': '4104303/2024-05-03/5ab18545ed3ac118d7ddb3f2e0a367b044d650fd.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223954%22%2C%22hash%22%3A%222C8F14749215DC69994B8284C6300CE25228FC3E%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:56:21.360555Z', 'territory_id': '4104303'} 2024-06-17 17:56:27 [scrapy.crawler] INFO: Received SIGINT twice, forcing unclean shutdown 2024-06-17 17:56:27 [scrapy.core.downloader.handlers.http11] WARNING: Got data loss in https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223953%22%2C%22hash%22%3A%2224237C7D2879028D724B14FE1E37118A3068C178%22%7D&cidade=padrao. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests 2024-06-17 17:56:27 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): [, ] 2024-06-17 17:56:27 [scrapy.core.downloader.handlers.http11] WARNING: Got data loss in https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223956%22%2C%22hash%22%3A%22D939B18D29463AF2108725E0FBFC48CA8599AF21%22%7D&cidade=padrao. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests 2024-06-17 17:56:27 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): [, ] 2024-06-17 17:56:27 [scrapy.core.downloader.handlers.http11] WARNING: Got data loss in https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223958%22%2C%22hash%22%3A%22929E2984544B768DC86E12394F5F7BC649792EB0%22%7D&cidade=padrao. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests 2024-06-17 17:56:27 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): [, ] 2024-06-17 17:57:28 [scrapy.utils.log] INFO: Scrapy 2.11.0 started (bot: gazette) 2024-06-17 17:57:28 [scrapy.utils.log] INFO: Versions: lxml 4.9.3.0, libxml2 2.10.3, cssselect 1.2.0, parsel 1.8.1, w3lib 2.1.2, Twisted 22.10.0, Python 3.10.7 (main, May 29 2023, 13:51:48) [GCC 12.2.0], pyOpenSSL 23.2.0 (OpenSSL 3.1.3 19 Sep 2023), cryptography 41.0.4, Platform Linux-5.19.0-46-generic-x86_64-with-glibc2.36 2024-06-17 17:57:28 [pr_campo_mourao] INFO: Collecting data from 2024-05-01 to 2024-05-31. 2024-06-17 17:57:28 [scrapy.addons] INFO: Enabled addons: [] 2024-06-17 17:57:28 [py.warnings] WARNING: /home/marcos/Documentos/querido-diario/venv/lib/python3.10/site-packages/scrapy/utils/request.py:254: ScrapyDeprecationWarning: '2.6' is a deprecated value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. It is also the default value. In other words, it is normal to get this warning if you have not defined a value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. This is so for backward compatibility reasons, but it will change in a future version of Scrapy. See the documentation of the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting for information on how to handle this deprecation. return cls(crawler) 2024-06-17 17:57:28 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.epollreactor.EPollReactor 2024-06-17 17:57:28 [scrapy.extensions.telnet] INFO: Telnet Password: 25495c0ac4faac5b 2024-06-17 17:57:28 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.feedexport.FeedExporter', 'scrapy.extensions.logstats.LogStats', 'spidermon.contrib.scrapy.extensions.Spidermon', 'gazette.extensions.StatsPersist'] 2024-06-17 17:57:28 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'gazette', 'COMMANDS_MODULE': 'gazette.commands', 'DOWNLOAD_TIMEOUT': 360, 'FILES_STORE_S3_ACL': 'public-read', 'LOG_FILE': 'log_pr_campo_mourao_intervalo_maio_24.txt', 'NEWSPIDER_MODULE': 'gazette.spiders', 'SPIDER_MODULES': ['gazette.spiders'], 'TEMPLATES_DIR': 'templates', 'USER_AGENT': 'Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:108.0) ' 'Gecko/20100101 Firefox/108.0'} 2024-06-17 17:57:28 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy_zyte_smartproxy.ZyteSmartProxyMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2024-06-17 17:57:28 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2024-06-17 17:57:28 [scrapy.middleware] INFO: Enabled item pipelines: ['gazette.pipelines.GazetteDateFilteringPipeline', 'gazette.pipelines.DefaultValuesPipeline', 'gazette.pipelines.QueridoDiarioFilesPipeline', 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline', 'gazette.pipelines.SQLDatabasePipeline'] 2024-06-17 17:57:28 [scrapy.core.engine] INFO: Spider opened 2024-06-17 17:57:28 [gazette.database.models] INFO: Populating 'territories' table - Please wait! 2024-06-17 17:57:29 [gazette.database.models] INFO: Populating 'territories' table - Done! 2024-06-17 17:57:29 [gazette.database.models] INFO: Populating 'querido_diario_spider' table - Please wait! 2024-06-17 17:57:29 [gazette.database.models] INFO: Populating 'querido_diario_spider' table - Done! 2024-06-17 17:57:29 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-06-17 17:57:29 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023 2024-06-17 17:57:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:29 [tzlocal] DEBUG: /etc/timezone found, contents: America/Sao_Paulo 2024-06-17 17:57:29 [tzlocal] DEBUG: /etc/localtime found 2024-06-17 17:57:29 [tzlocal] DEBUG: 2 found: {'/etc/timezone': 'America/Sao_Paulo', '/etc/localtime is a symlink to': 'America/Sao_Paulo'} 2024-06-17 17:57:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D) 2024-06-17 17:57:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D> {'date': '2024-05-28', 'edition_number': '3033', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223970%22%2C%22hash%22%3A%221888037D24C799D7156BAE544880683CB8C9E593%22%7D&cidade=padrao'], 'files': [{'checksum': 'dc761dc285b46a804f67c50850608b45', 'path': '4104303/2024-05-28/1955f150add666b77dda2d8edde8b2b8b641f958.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223970%22%2C%22hash%22%3A%221888037D24C799D7156BAE544880683CB8C9E593%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:29.836936Z', 'territory_id': '4104303'} 2024-06-17 17:57:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:31 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D> {'date': '2024-05-21', 'edition_number': '3030', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223965%22%2C%22hash%22%3A%2262E64DB9762F26DADFAE545AB23E9A5A05DB880A%22%7D&cidade=padrao'], 'files': [{'checksum': '35439bc21b17fb2f46d0fc5389c5bd0b', 'path': '4104303/2024-05-21/bf481bb9eced127508788e29f14c98b829128656.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223965%22%2C%22hash%22%3A%2262E64DB9762F26DADFAE545AB23E9A5A05DB880A%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:29.845889Z', 'territory_id': '4104303'} 2024-06-17 17:57:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D> {'date': '2024-05-22', 'edition_number': '3031', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223967%22%2C%22hash%22%3A%225D97A6EBB98C47304D0EE3FC82CD1F02FA11FC28%22%7D&cidade=padrao'], 'files': [{'checksum': '8f6ab9664db5adc760367c57400ea95f', 'path': '4104303/2024-05-22/df23dba948eb1627ffd7c19ff4588fb109fb4baa.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223967%22%2C%22hash%22%3A%225D97A6EBB98C47304D0EE3FC82CD1F02FA11FC28%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:29.842483Z', 'territory_id': '4104303'} 2024-06-17 17:57:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:32 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D> {'date': '2024-05-28', 'edition_number': '3033', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223969%22%2C%22hash%22%3A%2204B969732369E34D3E785242817DC988E39063FA%22%7D&cidade=padrao'], 'files': [{'checksum': '44e6d4d1f1a4304d8f8d3c48788f829e', 'path': '4104303/2024-05-28/6c5c17299b7eac878229f91ab2985eea263a149a.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223969%22%2C%22hash%22%3A%2204B969732369E34D3E785242817DC988E39063FA%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:29.838998Z', 'territory_id': '4104303'} 2024-06-17 17:57:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D> {'date': '2024-05-22', 'edition_number': '3031', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223966%22%2C%22hash%22%3A%224223E5600D2DA1A5D5C7256754126D4F8E44451E%22%7D&cidade=padrao'], 'files': [{'checksum': '0ce6280f47a247e5717f0ba238a4b2c2', 'path': '4104303/2024-05-22/153a695e6356aada81401b9e367cc53df94ed557.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223966%22%2C%22hash%22%3A%224223E5600D2DA1A5D5C7256754126D4F8E44451E%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:29.844160Z', 'territory_id': '4104303'} 2024-06-17 17:57:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:33 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-15', 'edition_number': '3028', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223962%22%2C%22hash%22%3A%2216B28905AF2210E03460A259B39CAD9FA497DA5F%22%7D&cidade=padrao'], 'files': [{'checksum': 'd0764cca31eaac8718fd9b4e812ec226', 'path': '4104303/2024-05-15/5bd12b858fd47daaeda938b164d6e87420d57dc8.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223962%22%2C%22hash%22%3A%2216B28905AF2210E03460A259B39CAD9FA497DA5F%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:30.487411Z', 'territory_id': '4104303'} 2024-06-17 17:57:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-10', 'edition_number': '3026', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223959%22%2C%22hash%22%3A%22E1C04D5157F146E11693EBF45B0570725873FC39%22%7D&cidade=padrao'], 'files': [{'checksum': '457b7bd6819f63d502c8124d6c2a7991', 'path': '4104303/2024-05-10/02d2ab73f5a4eb9fbe771a83ce95678fc24719eb.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223959%22%2C%22hash%22%3A%22E1C04D5157F146E11693EBF45B0570725873FC39%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:30.490935Z', 'territory_id': '4104303'} 2024-06-17 17:57:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:34 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-15', 'edition_number': '3028', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223961%22%2C%22hash%22%3A%222D50DC6BAA0E7F40FB42319B51355612174EDD29%22%7D&cidade=padrao'], 'files': [{'checksum': '867f3fd5868664b524b9d48c06502357', 'path': '4104303/2024-05-15/c937dfad1528591f564d306822eecd646cb21ce2.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223961%22%2C%22hash%22%3A%222D50DC6BAA0E7F40FB42319B51355612174EDD29%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:30.488548Z', 'territory_id': '4104303'} 2024-06-17 17:57:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-21', 'edition_number': '3030', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223964%22%2C%22hash%22%3A%22055C8427C44EFFFCDA654E375CEB22798A1D899E%22%7D&cidade=padrao'], 'files': [{'checksum': 'c0eb7541d4251c9ef2e0323760b0570f', 'path': '4104303/2024-05-21/8ce80f6b614be7207839b3d43ce3a4874d5aff6c.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223964%22%2C%22hash%22%3A%22055C8427C44EFFFCDA654E375CEB22798A1D899E%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:30.484074Z', 'territory_id': '4104303'} 2024-06-17 17:57:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-14', 'edition_number': '3027', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223960%22%2C%22hash%22%3A%22A06B03BD4AAAEAB21337CDFC545F6831FA8D5C0F%22%7D&cidade=padrao'], 'files': [{'checksum': '913cc34f9996c6b6c94d4d28c0b475ab', 'path': '4104303/2024-05-14/e79ea9b3e5f6386ef3db0b87ee1f92669a0c151e.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223960%22%2C%22hash%22%3A%22A06B03BD4AAAEAB21337CDFC545F6831FA8D5C0F%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:30.489789Z', 'territory_id': '4104303'} 2024-06-17 17:57:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D> {'date': '2024-05-24', 'edition_number': '3032', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223968%22%2C%22hash%22%3A%22C6A264E9229005C3CFE26828E579CFDD4381CB0E%22%7D&cidade=padrao'], 'files': [{'checksum': '5407b9944c77d3453dcbae46106f6ef9', 'path': '4104303/2024-05-24/44a1c357302a2be23856120dace0d2f6c495f074.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223968%22%2C%22hash%22%3A%22C6A264E9229005C3CFE26828E579CFDD4381CB0E%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:29.840719Z', 'territory_id': '4104303'} 2024-06-17 17:57:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-03', 'edition_number': '3023', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223955%22%2C%22hash%22%3A%22E0B7951CB728D98FA43632099E9F5CC26BEC6F13%22%7D&cidade=padrao'], 'files': [{'checksum': '51e51c4c505532dcb706db1ab5d6e6c0', 'path': '4104303/2024-05-03/1b6706aaeed9deeabb0222a1cbb4ebcb29790bd7.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223955%22%2C%22hash%22%3A%22E0B7951CB728D98FA43632099E9F5CC26BEC6F13%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:30.495797Z', 'territory_id': '4104303'} 2024-06-17 17:57:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:35 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-08', 'edition_number': '3025', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223957%22%2C%22hash%22%3A%22479A367750123D6BEE7C72C68F2CF7A6AED1757D%22%7D&cidade=padrao'], 'files': [{'checksum': 'd05f6f44fb6719c8cf9d8a6a54c4c4fc', 'path': '4104303/2024-05-08/cd8848908a29f2a81db95e0bf279b1ec81926b4e.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223957%22%2C%22hash%22%3A%22479A367750123D6BEE7C72C68F2CF7A6AED1757D%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:30.493550Z', 'territory_id': '4104303'} 2024-06-17 17:57:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-17', 'edition_number': '3029', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223963%22%2C%22hash%22%3A%226D65B1C3A5D7F1C40342405763FDC98BB3C04250%22%7D&cidade=padrao'], 'files': [{'checksum': '49e16ca7d126547221d99e9dcb2fcd00', 'path': '4104303/2024-05-17/2f80b14a5efcf0426b035b9751bca50a89eb1cb0.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223963%22%2C%22hash%22%3A%226D65B1C3A5D7F1C40342405763FDC98BB3C04250%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:30.486152Z', 'territory_id': '4104303'} 2024-06-17 17:57:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%221%22%7D%7D> {'date': '2024-05-29', 'edition_number': '3034', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223971%22%2C%22hash%22%3A%223708760D531E42B8E0040B9AE2E5B22A0DCC555F%22%7D&cidade=padrao'], 'files': [{'checksum': 'dfa7158706427c3b4b2d4e0c4f037ded', 'path': '4104303/2024-05-29/322515dcdb5d85045da8cdb03e5cd0f6428824f8.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223971%22%2C%22hash%22%3A%223708760D531E42B8E0040B9AE2E5B22A0DCC555F%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:29.834890Z', 'territory_id': '4104303'} 2024-06-17 17:57:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-03', 'edition_number': '3023', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223954%22%2C%22hash%22%3A%222C8F14749215DC69994B8284C6300CE25228FC3E%22%7D&cidade=padrao'], 'files': [{'checksum': '1ebecb9ca2ec4d9a8ff677f76106d5e6', 'path': '4104303/2024-05-03/5ab18545ed3ac118d7ddb3f2e0a367b044d650fd.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223954%22%2C%22hash%22%3A%222C8F14749215DC69994B8284C6300CE25228FC3E%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:30.497683Z', 'territory_id': '4104303'} 2024-06-17 17:57:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-10', 'edition_number': '3026', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223958%22%2C%22hash%22%3A%22929E2984544B768DC86E12394F5F7BC649792EB0%22%7D&cidade=padrao'], 'files': [{'checksum': '30ce53fc2381f809410b1349d4874c1d', 'path': '4104303/2024-05-10/35264c2b15b083cbcb2295f0d5abd6ac023e1491.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223958%22%2C%22hash%22%3A%22929E2984544B768DC86E12394F5F7BC649792EB0%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:30.492054Z', 'territory_id': '4104303'} 2024-06-17 17:57:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-07', 'edition_number': '3024', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223956%22%2C%22hash%22%3A%22D939B18D29463AF2108725E0FBFC48CA8599AF21%22%7D&cidade=padrao'], 'files': [{'checksum': '3e5d3b627a1e164e4e0ea7417cd9c019', 'path': '4104303/2024-05-07/5063d37ab62b8581eda9f2e8c0aaf105920ef033.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223956%22%2C%22hash%22%3A%22D939B18D29463AF2108725E0FBFC48CA8599AF21%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:30.494669Z', 'territory_id': '4104303'} 2024-06-17 17:57:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2024-06-17 17:57:36 [scrapy.pipelines.files] DEBUG: File (downloaded): Downloaded file from referred in 2024-06-17 17:57:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://campomourao.atende.net/diariooficial/edicao/pagina/atende.php?rot=54015&aca=101&ajax=t&processo=loadPluginDiarioOficial¶metro=%7B%22codigoPlugin%22%3A1%2C%22filtroPlugin%22%3A%7B%22pagina%22%3A%222%22%7D%7D> {'date': '2024-05-03', 'edition_number': '3023', 'file_urls': ['https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223953%22%2C%22hash%22%3A%2224237C7D2879028D724B14FE1E37118A3068C178%22%7D&cidade=padrao'], 'files': [{'checksum': 'd896d5493f44f991c95f98846fcca823', 'path': '4104303/2024-05-03/e5752da747e6deeb8005cb63a8c21db1c40d0fed.pdf', 'status': 'downloaded', 'url': 'https://campomourao.atende.net/atende.php?rot=54002&aca=737&processo=download¶metro=%7B%22codigo%22%3A%223953%22%2C%22hash%22%3A%2224237C7D2879028D724B14FE1E37118A3068C178%22%7D&cidade=padrao'}], 'is_extra_edition': False, 'power': 'executive_legislative', 'scraped_at': '2024-06-17T20:57:30.498989Z', 'territory_id': '4104303'} 2024-06-17 17:57:36 [scrapy.core.engine] INFO: Closing spider (finished) 2024-06-17 17:57:36 [scrapy.extensions.feedexport] INFO: Stored csv feed (19 items) in: pr_campo_mourao_intervalo_maio_24.csv 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] ------------------------------ MONITORS ------------------------------ 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] Comparison Between Executions/Days without gazettes... OK 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] Requests/Items Ratio/Ratio of requests over items scraped count... OK 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] Error Count Monitor/test_stat_monitor... SKIPPED (Unable to find 'log_count/ERROR' in job stats.) 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] Finish Reason Monitor/Should have the expected finished reason(s)... OK 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] Item Validation Monitor/test_stat_monitor... SKIPPED (Unable to find 'spidermon/validation/fields/errors' in job stats.) 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] ---------------------------------------------------------------------- 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] 5 monitors in 0.012s 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] OK (skipped=2) 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] -------------------------- FINISHED ACTIONS -------------------------- 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] ---------------------------------------------------------------------- 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] 0 actions in 0.000s 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] OK 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] --------------------------- PASSED ACTIONS --------------------------- 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] ---------------------------------------------------------------------- 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] 0 actions in 0.000s 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] OK 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] --------------------------- FAILED ACTIONS --------------------------- 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] ---------------------------------------------------------------------- 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] 1 action in 0.000s 2024-06-17 17:57:36 [pr_campo_mourao] INFO: [Spidermon] OK (skipped=1) 2024-06-17 17:57:36 [scrapy.statscollectors] INFO: Dumping Scrapy stats: {'downloader/request_bytes': 10525, 'downloader/request_count': 21, 'downloader/request_method_count/GET': 21, 'downloader/response_bytes': 38626031, 'downloader/response_count': 21, 'downloader/response_status_count/200': 21, 'elapsed_time_seconds': 7.550762, 'feedexport/success_count/FileFeedStorage': 1, 'file_count': 19, 'file_status_count/downloaded': 19, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2024, 6, 17, 20, 57, 36, 807223, tzinfo=datetime.timezone.utc), 'httpcompression/response_bytes': 47757, 'httpcompression/response_count': 2, 'item_scraped_count': 19, 'log_count/DEBUG': 63, 'log_count/INFO': 36, 'log_count/WARNING': 1, 'memusage/max': 123064320, 'memusage/startup': 123064320, 'request_depth_max': 1, 'response_received_count': 21, 'scheduler/dequeued': 2, 'scheduler/dequeued/memory': 2, 'scheduler/enqueued': 2, 'scheduler/enqueued/memory': 2, 'spidermon/validation/fields': 152, 'spidermon/validation/items': 19, 'spidermon/validation/validators': 1, 'spidermon/validation/validators/item/jsonschema': True, 'start_time': datetime.datetime(2024, 6, 17, 20, 57, 29, 256461, tzinfo=datetime.timezone.utc)} 2024-06-17 17:57:36 [scrapy.core.engine] INFO: Spider closed (finished)