-
-
Notifications
You must be signed in to change notification settings - Fork 407
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adiciona spider base para o sistema replicável Atende, e spiders derivados para as cidades com D.O.s nesse sistema. #1046
base: main
Are you sure you want to change the base?
Commits on Dec 2, 2023
-
Configuration menu - View commit details
-
Copy full SHA for b178d13 - Browse repository at this point
Copy the full SHA b178d13View commit details -
Configuration menu - View commit details
-
Copy full SHA for efe5f05 - Browse repository at this point
Copy the full SHA efe5f05View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5ebd2ed - Browse repository at this point
Copy the full SHA 5ebd2edView commit details -
Move pr_campo_mourao criado em okfn-brasil#438 para servir de referên…
…cia na criação do spider base do sistema replicável Atende.
Configuration menu - View commit details
-
Copy full SHA for 0b8a210 - Browse repository at this point
Copy the full SHA 0b8a210View commit details -
Adiciona spider base do sistema replicável Atende.
Essa versão implementa a classe 'BaseAtendeT2Spider' para buscar os dirários nas páginas com layout 'Tipo 2', identificadas pelo Mapeador Atende desenvolvido em okfn-brasil#1043.
Configuration menu - View commit details
-
Copy full SHA for 88f036c - Browse repository at this point
Copy the full SHA 88f036cView commit details -
Ajusta o spider 'pr_campo_mourao' criado em okfn-brasil#438
para trabalhar com o spider base do sistema replicável 'Atende'. Resolve okfn-brasil#430 Adiciona spider para Campo Mourão - PR.
Configuration menu - View commit details
-
Copy full SHA for 5158d72 - Browse repository at this point
Copy the full SHA 5158d72View commit details -
Ajusta o spider 'rs_gravatai' para trabalhar com o
spider base do sistema replicável 'Atende'.
Configuration menu - View commit details
-
Copy full SHA for c463564 - Browse repository at this point
Copy the full SHA c463564View commit details
Commits on Dec 3, 2023
-
Adiciona o spider 'pr_araucaria' de Araucária PR.
Sistema replicável 'Atende'.
Configuration menu - View commit details
-
Copy full SHA for 06e517f - Browse repository at this point
Copy the full SHA 06e517fView commit details -
Ajuste no spider base 'atende' para buscar a url
de download na página de 'Detalhes da Edição' quando não encontrar na página padrão (layout Tipo 2). Caso conhecido: Araucária - PR (https://araucaria.atende.net/diariooficial)
Configuration menu - View commit details
-
Copy full SHA for 8aa4867 - Browse repository at this point
Copy the full SHA 8aa4867View commit details
Commits on Dec 4, 2023
-
Adiciona o spider 'pr_apucarana' de Apucarana - PR.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 443b256 - Browse repository at this point
Copy the full SHA 443b256View commit details -
Adiciona o spider 'sc_araquari' de Araquari - SC.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 1e709d9 - Browse repository at this point
Copy the full SHA 1e709d9View commit details -
Adiciona o spider 'rs_bento_goncalves' de Bento Gonçalves - RS.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 79d3e6e - Browse repository at this point
Copy the full SHA 79d3e6eView commit details -
Adiciona o spider 'pr_campo_largo' de Campo Largo - PR.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 9e28719 - Browse repository at this point
Copy the full SHA 9e28719View commit details -
Adiciona o spider 'rs_candelaria' de Candelária - RS.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for b5b88fc - Browse repository at this point
Copy the full SHA b5b88fcView commit details -
Adiciona o spider 'mg_carmopolis_de_minas' de Carmópolis de Minas - MG.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for d5563a2 - Browse repository at this point
Copy the full SHA d5563a2View commit details -
Adiciona o spider 'pr_castro' de Castro - PR.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 7320399 - Browse repository at this point
Copy the full SHA 7320399View commit details -
Adiciona o spider 'pr_clevelandia' de Clevelândia - PR.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 544aaee - Browse repository at this point
Copy the full SHA 544aaeeView commit details -
Adiciona o spider 'pr_corbelia' de Corbélia - PR.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 1cacfd8 - Browse repository at this point
Copy the full SHA 1cacfd8View commit details -
Adiciona o spider 'rs_dois_irmaos' de Dois Irmãos - RS.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 240da15 - Browse repository at this point
Copy the full SHA 240da15View commit details -
Adiciona o spider 'rs_estrela' de Estrela - RS.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for b56b8c3 - Browse repository at this point
Copy the full SHA b56b8c3View commit details -
Adiciona o spider 'pr_guaraniacu' de Guaraniaçu - PR.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for a7c1884 - Browse repository at this point
Copy the full SHA a7c1884View commit details -
Adiciona o spider 'rs_horizontina' de Horizontina - RS.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 31a2cf2 - Browse repository at this point
Copy the full SHA 31a2cf2View commit details -
Adiciona o spider 'pr_juranda' de Juranda - PR.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for f5c3000 - Browse repository at this point
Copy the full SHA f5c3000View commit details -
Adiciona o spider 'sc_laurentino' de Laurentino - SC.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for de9f280 - Browse repository at this point
Copy the full SHA de9f280View commit details -
Adiciona o spider 'pr_mambore' de Mamborê - PR.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 59a3565 - Browse repository at this point
Copy the full SHA 59a3565View commit details -
Adiciona o spider 'mg_oliveira' de Oliveira - MG.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 238dbef - Browse repository at this point
Copy the full SHA 238dbefView commit details -
Adiciona o spider 'pr_ouro_verde_do_oeste' de Ouro Verde do Oeste - PR.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 1b56af0 - Browse repository at this point
Copy the full SHA 1b56af0View commit details -
Adiciona o spider 'rs_panambi' de Panambi - RS.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for b1c76b6 - Browse repository at this point
Copy the full SHA b1c76b6View commit details -
Adiciona o spider 'pr_pinhais' de Pinhais - PR.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for a3f834a - Browse repository at this point
Copy the full SHA a3f834aView commit details -
Adiciona o spider 'pr_rio_branco_do_sul' de Rio Branco do Sul - PR.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 5bedc3c - Browse repository at this point
Copy the full SHA 5bedc3cView commit details -
Adiciona o spider 'rs_santa_rosa' de Santa Rosa - RS.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 7a04b86 - Browse repository at this point
Copy the full SHA 7a04b86View commit details -
Adiciona o spider 'pr_santo_antonio_da_platina' de Santo Antônio da P…
…latina - PR. Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 93a47bc - Browse repository at this point
Copy the full SHA 93a47bcView commit details -
Adiciona o spider 'rs_sao_joao_do_polesine' de São João do Polêsine -…
… RS. Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 2ed19e3 - Browse repository at this point
Copy the full SHA 2ed19e3View commit details -
Adiciona o spider 'rs_sobradinho' de Sobradinho - RS.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 9ad4d0c - Browse repository at this point
Copy the full SHA 9ad4d0cView commit details -
Adiciona o spider 'pr_tupassi' de Tupãssi - PR.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for 8479713 - Browse repository at this point
Copy the full SHA 8479713View commit details -
Adiciona o spider 'pr_pato_bragado' de Pato Bragado - PR.
Sistema replicável 'Atende' (layout Tipo 2).
Configuration menu - View commit details
-
Copy full SHA for cf144d7 - Browse repository at this point
Copy the full SHA cf144d7View commit details
Commits on Dec 6, 2023
-
Adiciona a classe 'BaseAtendeT1Spider' para buscar
os diários nas páginas do sistema replicável 'atende' com layout 'Tipo 1'.
Configuration menu - View commit details
-
Copy full SHA for 9d362ff - Browse repository at this point
Copy the full SHA 9d362ffView commit details -
Adiciona o spider 'rs_cachoeirinha' de Cachoeirinha - RS.
Sistema replicável 'Atende' (layout Tipo 1).
Configuration menu - View commit details
-
Copy full SHA for 6e952ce - Browse repository at this point
Copy the full SHA 6e952ceView commit details -
Adiciona o spider 'rs_camaqua_2023' de Camaquã - RS.
Sistema replicável 'Atende' (layout Tipo 1). Resolve okfn-brasil#1038 Conforme comentado em okfn-brasil#1038 (comment) esse novo spider coleta apenas da edição 333 em diante. Como falta a informação de data para muitas edições na página, a estratégia foi incluir a verificação do número da edição para limitar o download dos arquivos e salvar a data `datetime.date.max` nos metadados para que a etapa de 'data processing' realize a extração dessa informação.
Configuration menu - View commit details
-
Copy full SHA for a944881 - Browse repository at this point
Copy the full SHA a944881View commit details -
Inclui a informação de 'end_date' para o spider
original de Camaquã, para refletir o último dia antes da publicação da edição 333 no novo site atende.net Ajuste associado à issue okfn-brasil#1038
Configuration menu - View commit details
-
Copy full SHA for ded3a1e - Browse repository at this point
Copy the full SHA ded3a1eView commit details