Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

error using remote dataset conf in a directory #274

Closed
brancomat opened this issue Oct 5, 2021 · 2 comments
Closed

error using remote dataset conf in a directory #274

brancomat opened this issue Oct 5, 2021 · 2 comments
Assignees

Comments

@brancomat
Copy link
Member

let's say I put this conf in a cosmo_remote dir:

archive age = 10
description = COSMO 2.2Km Rapid Update Cycle, Italian area (archive)
filter = origin:GRIB1,80,,14; area:GRIB:Ni=576,Nj=701
index = reftime, timerange, level, product
name = cosmo_2I_ruc_arc
path = http://arkimet6.metarpa:8090/dataset/cosmo_2I_ruc_arc
postprocess = singlepoint, subarea
replace = yes
restrict = simc, cosmo
server = http://arkimet6.metarpa:8090
step = daily
type = remote
unique = origin, reftime, timerange, level, product

arki-querying the dataset gives an error

$ arki-query --yaml --summary-short '' cosmo_remote/
WARNING cosmo_remote failed: while Cannot query /autofs/nfshomes/dbranchini/buttami/cosmo_remote/summary: URL using bad/illegal format or missing URL()
SummaryStats:
  Size: 0
  Count: 0
  Reftime: 0000-00-00T00:00:00Z to 0000-00-00T00:00:00Z
Items:

I'm aware that if I add a section (e.g. [cosmo_2I_ruc_arc]) to the file it works when passed to arki-query as a file, but it would be useful if the remote dataset type could work even as a dataset conf.
Should this not be possible, at least the error output could be less obscure.

@brancomat
Copy link
Member Author

I might be missing something, but it doesn't seem to work.

config file:

$ cat cosmo_5M_ita_arc/config 
__logname = CINECA;cosmo_5M_ita
archive age = 20
bksize = week
description = COSMO 5km, Operational suite, Italian area, archive
filter = origin:GRIB1,80,,22; area:GRIB:Ni=386,latfirst=-10575000, lonfirst=-7785000, type=10
index = reftime, timerange, level, product
name = cosmo_5M_ita_arc
path = http://arkimet6.metarpa:8090/dataset/cosmo_5M_ita_arc
postprocess = singlepoint, subarea, seriet, cat
replace = yes
restrict = simc, cima, cosmo, arpaaria
server = http://arkimet6.metarpa:8090
step = daily
type = remote
unique = origin, reftime, timerange, level, product
_category = FOR
_license = CCBY-SA4.0
_attribution = ARPAE-SIMC

query:

arki-query --summary-short --dump '' cosmo_5M_ita_arc
WARNING cosmo_5M_ita_arc failed: while Cannot query /autofs/nfshomes/dbranchini/buttami/cosmo_5M_ita_arc/summary: URL using bad/illegal format or missing URL()
SummaryStats:
  Size: 0
  Count: 0
  Reftime: 0000-00-00T00:00:00Z to 0000-00-00T00:00:00Z
Items:

@brancomat brancomat reopened this Oct 19, 2021
@spanezz
Copy link
Contributor

spanezz commented Oct 19, 2021

It looks like there's another place that I missed where the replacement of path= is still happening

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants