How do you handle multi-layer header CSV file's series index ?

[coolbq]

As titled, how Miller deal with this kind of files to extract series index and series data?

[coolbq]

As titled, how Miller deal with this kind of files to extract series index and series data?

sample.zip

[aborruso]

Can you add an example of the output you would like? Or the process you would like to run?

[coolbq]

I want to seperate the first 6 lines as series index, and the data in rows with no bigger than 6 as the series data. And finally to save them in two seperate files. Than I can visualize the data in tools like Tableau.

[aborruso]

I'm not sure I understand, but I'll try to give you an answer.

Running <sample.tsv tail -n +6 >body.tsv, you save the data.
Running <sample.tsv head -n 5 >header.tsv you save the header.

The body will be in this way

If it is useful for you, you can transpose the header, coupling Miller with qsv.

<header.tsv mlr --csv remove-empty-columns | qsv transpose >transposed_header.tsv

[coolbq]

Thanks ! aborruso, your suggested method solved it. It's really a great idea to split before processing. It help alot.