639 allow the user to define input and output file names #734

mmutic · 2024-08-05T13:49:25Z

Description

This feature allows users to input two YAML files, input_settings.yml, and results_settings.yml. The file input_settings.yml allows users to specify the name of their input files as well as the paths and names of the input folders. A function called configure_input_settings has been added that adds a dictionary of these names, merged with default names, to the setup dictionary.

The function load_dataframe(), which is called to open all files in GenX, has been altered to use DuckDB (per Greg's suggestion). DuckDB can open files of type CSV, Parquet, and JSON, all of which can also be compressed (i.e. .gz), so users can now have input files of any of those types.

The file results_settings.yml can contain the desired names of the results file. Names in the YAML file can be entered with or without a file extension. In genx_settings.yml, two new keys can be added: ResultsFileType and ResultsCompressionType, whose defaults are both "auto_detect". Both of those keys are used in the function "write_output_files()".

The function write_output_files() has been added to write_outputs.jl. It uses DuckDB to save files according to a specified file type, which can be .csv, .csv.gz, .parquet, .json, or .json.gz. If filetype is set to "auto_detect", it will detect if the file name contains an extension (if no extension is present, .csv is used). If a filetype is set to something (eg .parquet) but that extension is not present in the filename, the extension is added. A compression type can also be specified, these are .gz for CSV and JSON files, and -snappy and -zstd for Parquet files. The compression type can also be auto_detected.

The goal is for write_output_files to replace all instances in which CSV.write is currently used. This is a work in progress and is only present in some places in GenX at the moment.

An example file, 10_three_zones_define_input, contains the aforementioned YAML files.

Edit 9/11/24: Multistage inputs can now also be defined using input_settings.yml. The structure is a bit different (uses indentation to make a separate subdictionary for each input stage), see 6_three_zones_w_multistage for an example YAML file. Results multistage file names can also be changed using results_settings.yml, but the file structure is the same as in single stage. I deleted 10_three_zones_define_input as it's the exact same as 1_three_zones, but added input_settings.yml and results_settings.yml to 1_three_zones. The function write_output_files now replaces CSV.write() in almost all instances. Documentation has also been updated to reflect new capabilities.

Notes from GenX Meeting 9/12

The function write_output_file() could potentially be split into smaller functions as it is very long.
The headers in NSE and PowerBalance are currently incompatible with DuckDB as they have repeated column names.
Being able to read and output databases using DuckDB could be added (I think this can be done relatively easily).
The structure of input_settings.yml for multistage could be altered to have global files. The last two commits on this PR (done on 9/11 and 9/12) are the ones involving multistage, so this PR can be split into single and multistage PRs.

Side note, not brought up in the meeting: the results files specific to multistage (capacities_multi_stage etc) have not been tested with write_output_file(), but the code is present and commented out.

What type of PR is this? (check all applicable)

Feature

Related Tickets & Documents

Issue #639

Checklist

Code changes are sufficiently documented; i.e. new functions contain docstrings and .md files under /docs/src have been updated if necessary.
The latest changes on the target branch have been incorporated, so that any conflicts are taken care of before merging. This can be accomplished either by merging in the target branch (e.g. 'git merge develop') or by rebasing on top of the target branch (e.g. 'git rebase develop'). Please do not hesitate to reach out to the GenX development team if you need help with this.
Code has been tested to ensure all functionality works as intended.
CHANGELOG.md has been updated (if this is a 'notable' change).
I consent to the release of this PR's code under the GNU General Public license.

How this can be tested

Working on writing test functions. For now, testing can be done by altering the input and results YAML files in example 10 and ensuring the expected results follow.

Post-approval checklist for GenX core developers

After the PR is approved

Check that the latest changes on the target branch are incorporated, either via merge or rebase
Remember to squash and merge if incorporating into develop

cfe316 · 2024-08-13T15:21:19Z

src/configure_settings/configure_settings.jl

+    "demand_name" => "Demand_data.csv",
+    "fuel_name" => "Fuels_data.csv",
+    "generators_name" => "Generators_variability.csv",
+    "network_name" => "Network.csv",
+    "resources_location" => joinpath(case, "resources"),
+    "storage_name" => "Storage.csv",
+    "thermal_name" => "Thermal.csv",
+    "vre_name" => "Vre.csv",
+    "vre_stor_name" => "Vre_stor.csv",
+    "vre_stor_solar_name" => "Vre_and_stor_solar_variability.csv",
+    "vre_stor_wind_name" => "Vre_and_stor_wind_variability.csv",
+    "hydro_name" => "Hydro.csv",
+    "flex_demand_name" => "Flex_demand.csv",
+    "must_run_name" => "Must_run.csv",
+    "electrolyzer_name" => "Electrolyzer.csv",
+    "resource_cap_name" => "Resource_capacity_reserve_margin.csv",
+    "resource_energy_share_requirement" => "Resource_energy_share_requirement.csv",
+    "resource_min_name" => "Resource_minimum_capacity_requirement.csv",
+    "resource_max_name" => "Resource_maximum_capacity_requirement.csv",
+    "policies_location" => joinpath(case, "policies"),
+    "capacity_name" => "Capacity_reserve_margin.csv",
+    "CRM_slack_name" => "Capacity_reserve_margin_slack.csv",
+    "co2_cap_name" => "CO2_cap.csv",
+    "co2_cap_slack_name" => "CO2_cap_slack.csv",
+    "esr_name" => "Energy_share_requirement.csv",
+    "esr_slack_name" => "Energy_share_requirement_slack.csv",
+    "min_cap_name" => "Minimum_capacity_requirement.csv",
+    "max_cap_name" => "Maximum_capacity_requirement.csv",
+    "operational_reserves_name" => "Operational_reserves.csv")


All of these are _names. Since we're working with an input_names Dict here that should be clear enough from context. Consider just calling them "demand", "fuel" etc.

cfe316 · 2024-08-13T15:25:11Z

src/configure_settings/configure_settings.jl

+function default_results_names()
+   Dict{Any, Any}("capacity_name" => "capacity",
+    "capacity_factor_name" => "capacityfactor",
+    "captured_emissions_plant_name" => "captured_emissions_plant",
+    "charge_name" => "charge.csv",
+    "charging_cost_name" => "ChargingCost",
+    "co2_prices_name" => "CO2_prices_and_penalties",
+    "commit_name" => "commit",
+    "costs_name" => "costs",
+    "curtail_name" => "curtail",
+    "emissions_plant_name" => "emissions_plant",
+    "emissions_name" => "emissions",
+    "energy_revenue_name" => "EnergyRevenue",
+    "flow_name" => "flow",
+    "fuel_cost_plant_name" => "Fuel_cost_plant",
+    "fuel_consumption_plant_name" => "FuelConsumption_plant_MMBTU",
+    "fuel_consumption_total_name" => "FuelConsumtion_total_MMBTU",
+    "mincap_name" => "MinCapReq_prices_and_penalties",
+    "revenue_name" => "NetRevenue",
+    "network_expansion_name" => "network_expansion",
+    "nse_name" => "nse",
+    "power_balance_name" => "power_balance",
+    "power_name" => "power",
+    "prices_name" => "prices",
+    "reg_subsidy_revenue_name" => "RegSubsidyRevenue",
+    "reg_name" => "reg",
+    "reg_dn_name" => "reg_dn",
+    "reliability_name" => "reliability",
+    "shutdown_name" => "shutdown",
+    "start_name" => "start",
+    "status_name" => "status",
+    "storage_name" => "storage",
+    "subsidy_revenue_name" => "SubsidyRevenue",
+    "time_weights_name" => "time_weights",
+    "tlosses_name" => "tlosses",
+    "virtual_discharge_name" => "virtual_discharge",
+    "vre_stor_dc_charge_name" => "vre_stor_dc_charge",
+    "vre_stor_ac_charge_name" => "vre_stor_ac_charge",
+    "vre_stor_dc_discharge_name" => "vre_stor_dc_discharge",
+    "vre_stor_ac_discharge_name" => "vre_stor_ac_discharge",
+    "vre_stor_wind_power_name" => "vre_stor_wind_power",
+    "vre_stor_solar_power_name" => "vre_stor_solar_power")
+end


All of these are _names. Since we're working with an results_names Dict here that should be clear enough from context. Consider just calling them "capacity_factor" and so on. There's nothing wrong with having the same entry as key and value, like "storage" => "storage".

As an alternate suggestion you might want to make this a Dict of Symbol => AbstractString.
Strings are preferred when they need to be manipulated in some way, but especially in the keys these are just symbolic signifiers.

cfe316 · 2024-08-13T15:26:49Z

src/configure_settings/configure_settings.jl

@@ -61,6 +64,12 @@ function configure_settings(settings_path::String, output_settings_path::String)
    output_settings = configure_writeoutput(output_settings_path, settings)
    settings["WriteOutputsSettingsDict"] = output_settings

+    input_settings = configure_input_names(case)
+    settings["WriteInputNamesDict"] = input_settings


Shouldn't this be "ReadInputNamesDict" rather than "Write..."?

cfe316 · 2024-08-13T15:28:26Z

src/load_inputs/load_resources_data.jl

+    #esr_filenames = ["Resource_energy_share_requirement.csv"]
+    #cap_res_filenames = ["Resource_capacity_reserve_margin.csv"]
+    #min_cap_filenames = ["Resource_minimum_capacity_requirement.csv"]
+    #max_cap_filenames = ["Resource_maximum_capacity_requirement.csv"]
+


Please delete old code rather than commenting it out.

cfe316 · 2024-08-13T15:31:35Z

src/write_outputs/write_outputs.jl

+            path = path * ".parquet"
+        elseif compression == "snappy" || compression == "-snappy"
+            path = path * "-snappy.parqet"
+        elseif compression == "zstd" || compressoin == "-zstd"


typo! compressoin

cfe316 · 2024-08-13T15:32:52Z

src/write_outputs/write_outputs.jl

+        path = path * ".csv"
+    elseif filetype == ".csv" # If no extension is present, but filetype is set to .csv, .csv will be appended to the path name.
+       if compression == "none" 
+            path = path * ".csv"
+       elseif compression == "gzip" || compression == ".gz" || compression == "gz"# If no extension is present, and compression is set to gzip, add .gz to the end of the file name.
+            path = path * ".csv.gz"
+       elseif compression == "auto_detect" # If no extension is present, but compression is set to auto_detect, no compression is added
+            path = path * ".csv"
+       else
+            @warn("Compression type '$compression' not supported with .csv. Saving as uncompressed csv.")
+            path = path * ".csv"
+       end


All the path = path * "..." can be expressed as path *= "...".

cfe316 · 2024-08-13T15:43:41Z

src/write_outputs/write_outputs.jl

+                @warn("Filetype '$filetype' is incompatible with extension specified in results_settings.yml. Saving as '$newfiletype' instead.")
+                filetype = splitext(path)[2]
+            end
+            if splitext(path)[2] == ".csv" && (compression == ".gz" || compression == "gz" || compression == "gzip") 


This comparison
(compression == ".gz" || compression == "gz" || compression == "gzip")
gets made a bunch of times. Consider

a) normalize compression internally so that if the function is called with ".gz" or "gz" or "gzip" it's always "gzip", or something.
b) save the result to a boolean is_gzip or something.

gschivley · 2024-08-30T15:02:12Z

src/load_inputs/load_dataframe.jl

@@ -127,9 +127,13 @@ function check_for_duplicate_keys(path::AbstractString)
    end
 end

-function load_dataframe_from_file(path)::DataFrame
+function load_dataframe_from_file(path::AbstractString)
    check_for_duplicate_keys(path)


@mmutic and @cfe316 the check_for_duplicate_keys function assumes a csv file. Maybe use DuckDB's DESCRIBE function to get column names.

Here's a potential usage. The con object could also be passed in from load_dataframe_from_file -- not sure if it makes much difference.

function check_for_duplicate_keys(path::AbstractString) con = DBInterface.connect(DuckDB.DB, ":memory:") tbl_schema = DBInterface.execute(con, "DESCRIBE TABLE '$path'") |> DataFrames.DataFrame keys = tbl_schema[:, :column_name] uniques = unique(keys) if length(keys) > length(uniques) dupes = keep_duplicated_entries!(keys, uniques) @error """Some duplicate column names detected in the header of $path: $dupes. Duplicate column names may cause errors, as only the first is used. """ end end

github-actions

Remaining comments which cannot be posted as a review comment to avoid GitHub Rate Limit

JuliaFormatter

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/load_inputs/load_inputs.jl

Line 38 in a760a44

    
           if isfile(joinpath(system_path,setup["WriteInputNamesDict"][string("inputs_p", stage)]["network"]))

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/load_inputs/load_inputs.jl

Lines 46 to 54 in a760a44

    
           # Read temporal-resolved load data, and clustering information if relevant 
        
           load_demand_data!(setup, system_path, inputs) 
        
           # Read fuel cost data, including time-varying fuel costs 
        
           load_fuels_data!(setup, system_path, inputs) 
        
           # Read in generator/resource related inputs 
        
           load_resources_data!(inputs, setup, path, resources_path) 
        
           # Read in generator/resource availability profiles 
        
           load_generators_variability!(setup,system_path, inputs)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/load_inputs/load_inputs.jl

Line 146 in a760a44

    
           if setup["TimeDomainReduction"] == 1 && time_domain_reduced_files_exist(TDR_directory, setup["WriteInputNamesDict"][string("inputs_p",stage)])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/load_inputs/load_inputs.jl

Line 153 in a760a44

    
           if setup["TimeDomainReduction"] == 1 && time_domain_reduced_files_exist(TDR_directory, setup)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/load_inputs/load_network_data.jl

Line 11 in a760a44

filename = setup["WriteInputNamesDict"][string("inputs_p",stage)]["network"]

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/load_inputs/load_resources_data.jl

Line 557 in a760a44

input_names = setup["WriteInputNamesDict"][string("inputs_p",stage)]

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/load_inputs/load_resources_data.jl

Line 586 in a760a44

input_names = setup["WriteInputNamesDict"][string("inputs_p",stage)]

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/load_inputs/load_resources_data.jl

Line 727 in a760a44

resource_policy_path::AbstractString,input_names::Dict)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/load_inputs/load_resources_data.jl

Line 781 in a760a44

    
           filename = joinpath(resources_path, setup["WriteInputNamesDict"][string("inputs_p",stage)]["resource_multistage_data"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/load_inputs/load_resources_data.jl

Line 1414 in a760a44

    
           add_policies_to_resources!(resources, resource_policies_path, setup["WriteInputNamesDict"][string("inputs_p",stage)])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/load_inputs/load_resources_data.jl

Line 1416 in a760a44

    
           add_policies_to_resources!(resources, resource_policies_path, setup["WriteInputNamesDict"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/load_inputs/load_vre_stor_variability.jl

Line 24 in a760a44

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/multi_stage/write_multi_stage_capacities_charge.jl

Line 32 in a760a44

    
           CSV.write(joinpath(outpath, setup["WriteResultsNamesDict"]["capacities_charge_multi_stage"]), df_cap)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/multi_stage/write_multi_stage_capacities_discharge.jl

Line 32 in a760a44

    
           CSV.write(joinpath(outpath, setup["WriteResultsNamesDict"]["capacities_multi_stage"]), df_cap)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/multi_stage/write_multi_stage_capacities_energy.jl

Line 32 in a760a44

    
           CSV.write(joinpath(outpath, setup["WriteResultsNamesDict"]["capacities_energy_multi_stage"]), df_cap)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/multi_stage/write_multi_stage_network_expansion.jl

Line 30 in a760a44

    
           CSV.write(joinpath(outpath, setup["WriteResultsNamesDict"]["network_expansion_multi_stage"]), df_trans_cap)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/full_time_series_reconstruction.jl

Line 27 in a760a44

    
           Period_map = CSV.read(joinpath(TDRpath, setup["WriteResultsNamesDict"]["period_map"]), DataFrame)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/precluster.jl

Line 33 in a760a44

    
           mysetup["MultiStageSettingsDict"] = configure_settings_multistage(case,multistage_settings)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 679 to 683 in a760a44

    
           Demand_Outfile = joinpath(TimeDomainReductionFolder, mysetup["WriteInputNamesDict"][string("inputs_p",stage)]["demand"]) 
        
           GVar_Outfile = joinpath(TimeDomainReductionFolder, mysetup["WriteInputNamesDict"][string("inputs_p",stage)]["generators"]) 
        
           Fuel_Outfile = joinpath(TimeDomainReductionFolder, mysetup["WriteInputNamesDict"][string("inputs_p",stage)]["fuel"]) 
        
           PMap_Outfile = joinpath(TimeDomainReductionFolder, mysetup["WriteInputNamesDict"][string("inputs_p",stage)]["period_map"]) 
        
           YAML_Outfile = joinpath(TimeDomainReductionFolder, "time_domain_reduction_settings.yml")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 685 to 689 in a760a44

    
           Demand_Outfile = joinpath(TimeDomainReductionFolder, mysetup["WriteInputNamesDict"]["demand"]) 
        
           GVar_Outfile = joinpath(TimeDomainReductionFolder, mysetup["WriteInputNamesDict"]["generators"]) 
        
           Fuel_Outfile = joinpath(TimeDomainReductionFolder, mysetup["WriteInputNamesDict"]["fuel"]) 
        
           PMap_Outfile = joinpath(TimeDomainReductionFolder, mysetup["WriteInputNamesDict"]["period_map"]) 
        
           YAML_Outfile = joinpath(TimeDomainReductionFolder, "time_domain_reduction_settings.yml")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 715 in a760a44

    
           prevent_doubled_timedomainreduction(joinpath(inpath,mysetup["WriteInputNamesDict"][string("inputs_p",t)]["system_location"]),mysetup["WriteInputNamesDict"][string("inputs_p",t)])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1224 in a760a44

mysetup["WriteInputNamesDict"]["vre_stor_solar_variability"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1226 in a760a44

mysetup["WriteInputNamesDict"]["vre_stor_wind_variability"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1261 in a760a44

)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 1285 to 1286 in a760a44

    
           write_output_file(joinpath(inpath, "inputs", Stage_Outfiles[per]["Demand"]), demand_in)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 1299 to 1300 in a760a44

    
           write_output_file(joinpath(inpath, "inputs", Stage_Outfiles[per]["GVar"]),GVOutputData)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 1334 to 1337 in a760a44

    
           write_output_file(joinpath(inpath, "inputs", Stage_Outfiles[per]["GSolar"]), solar_var) 
        
           write_output_file(joinpath(inpath, "inputs", Stage_Outfiles[per]["GWind"]), wind_var)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1339 in a760a44

end

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1348 in a760a44

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 1358 to 1359 in a760a44

    
           write_output_file(joinpath(inpath, "inputs", Stage_Outfiles[per]["Fuel"]), NewFuelOutput)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1365 in a760a44

    
           write_output_file(joinpath(inpath, "inputs", Stage_Outfiles[per]["PMap"]),Stage_PeriodMaps[per])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 1389 to 1394 in a760a44

    
           demand_in = get_demand_dataframe(joinpath(inpath, 
        
               "inputs", 
        
               input_stage_directory, 
        
               mysetup["SystemFolder"]), 
        
               mysetup["WriteInputNamesDict"][string("inputs_p",stage_id)] 
        
               )

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 1417 to 1418 in a760a44

    
           write_output_file(joinpath(inpath, "inputs", input_stage_directory, Demand_Outfile),demand_in)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1420 in a760a44

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 1434 to 1435 in a760a44

    
           write_output_file(joinpath(inpath, "inputs", input_stage_directory, GVar_Outfile),GVOutputData)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1473 in a760a44

mysetup["WriteInputNamesDict"]["vre_stor_solar_variability"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 1475 to 1480 in a760a44

    
           mysetup["WriteInputNamesDict"]["vre_stor_wind_variability"]) 
        
           write_output_file(joinpath(inpath, "inputs", input_stage_directory, SolarVar_Outfile),solar_var) 
        
           write_output_file(joinpath(inpath, "inputs", input_stage_directory, WindVar_Outfile),wind_var)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1489 in a760a44

mysetup["WriteInputNamesDict"][string("inputs_p",stage_id)]["fuel"]))

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1491 in a760a44

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 1501 to 1502 in a760a44

    
           write_output_file(joinpath(inpath, "inputs", input_stage_directory, Fuel_Outfile),NewFuelOutput)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1508 in a760a44

    
           write_output_file(joinpath(inpath, "inputs", input_stage_directory, PMap_Outfile),PeriodMap)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1526 in a760a44

demand_in = get_demand_dataframe(system_path,mysetup)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 1548 to 1549 in a760a44

	write_output_file(joinpath(inpath, Demand_Outfile),demand_in)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1599 in a760a44

mysetup["WriteInputNamesDict"]["vre_stor_solar_variability"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1601 in a760a44

mysetup["WriteInputNamesDict"]["vre_stor_wind_variability"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1604 in a760a44

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1609 in a760a44

    
           fuel_in = load_dataframe(joinpath(system_path, mysetup["WriteInputNamesDict"]["fuel"]))

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/capacity_reserve_margin/write_capacity_value.jl

Lines 151 to 153 in a760a44

    
           dfCapValue, 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/capacity_reserve_margin/write_reserve_margin.jl

Lines 8 to 10 in a760a44

    
           dftranspose(dfResMar,false), 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/capacity_reserve_margin/write_reserve_margin_revenue.jl

Lines 106 to 109 in a760a44

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["reserve_margin_revenue"]), 
        
                   dfResRevenue, 
        
                   filetype = setup["ResultsFileType"], 
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/capacity_reserve_margin/write_reserve_margin_slack.jl

Line 17 in a760a44

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["reserve_margin_prices_and_penalties"]),

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/capacity_reserve_margin/write_reserve_margin_slack.jl

Line 28 in a760a44

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["reserve_margin_prices_and_penalties"]),

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/capacity_reserve_margin/write_reserve_margin_w.jl

Lines 15 to 17 in a760a44

    
           dfResMar_w, 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/co2_cap/write_co2_cap.jl

Lines 25 to 27 in a760a44

    
           dfCO2Price, 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/dftranspose.jl

Line 21 in a760a44

df_new = df[:,2:end]

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/energy_share_requirement/write_esr_prices.jl

Lines 15 to 19 in a760a44

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["esr_prices_and_penalties"]), 
        
                   dfESR, 
        
                   filetype = setup["ResultsFileType"], 
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/energy_share_requirement/write_esr_revenue.jl

Lines 85 to 87 in a760a44

    
           dfESRRev, 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/hydrogen/write_hourly_matching_prices.jl

Line 19 in a760a44

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["hourly_matching_prices"]),

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/min_max_capacity_requirement/write_maximum_capacity_requirement.jl

Line 22 in a760a44

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/min_max_capacity_requirement/write_minimum_capacity_requirement.jl

Line 22 in a760a44

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/reserves/write_operating_reserve_price_revenue.jl

Lines 49 to 55 in a760a44

    
                   dfOpRsvRevenue, 
        
                   filetype = setup["ResultsFileType"], 
        
                   compression = setup["ResultsCompressionType"]) 
        
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["op_regulation_revenue"]), 
        
                   dfOpRegRevenue, 
        
                   filetype = setup["ResultsFileType"], 
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/reserves/write_reg.jl

Line 13 in a760a44

filepath = joinpath(path,setup["WriteResultsNamesDict"]["reg"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/transmission/write_nw_expansion.jl

Lines 23 to 25 in a760a44

    
           dfTransCap, 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/transmission/write_transmission_flows.jl

Line 35 in a760a44

    
           write_full_time_series_reconstruction(path, setup,  dftranspose(dfFlow, true), setup["WriteResultsNamesDict"]["flow"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/transmission/write_transmission_losses.jl

Lines 22 to 24 in a760a44

    
           dfTLosses, 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/transmission/write_transmission_losses.jl

Line 33 in a760a44

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/transmission/write_transmission_losses.jl

Line 40 in a760a44

    
           write_full_time_series_reconstruction(path, setup, dftranspose(dfTLosses, true), setup["WriteResultsNamesDict"]["tlosses"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_commit.jl

Line 8 in a760a44

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_commit.jl

Line 15 in a760a44

dfCommit = dftranspose(dfCommit,true)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_commit.jl

Lines 17 to 21 in a760a44

    
           write_output_file(joinpath(path,  
        
                   setup["WriteResultsNamesDict"]["commit"]),  
        
                   dfCommit,  
        
                   filetype = setup["ResultsFileType"],  
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_commit.jl

Line 24 in a760a44

    
           write_full_time_series_reconstruction(path, setup, dfCommit, setup["WriteResultsNamesDict"]["commit"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_shutdown.jl

Line 5 in a760a44

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_shutdown.jl

Line 13 in a760a44

filepath = joinpath(path,setup["WriteResultsNamesDict"]["shutdown"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_shutdown.jl

Line 19 in a760a44

    
           write_full_time_series_reconstruction(path, setup, df_Shutdown, setup["WriteResultsNamesDict"]["shutdown"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_start.jl

Line 6 in a760a44

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_start.jl

Line 18 in a760a44

    
           write_full_time_series_reconstruction(path, setup, df_Start, setup["WriteResultsNamesDict"]["start"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_angles.jl

Lines 18 to 20 in a760a44

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["angles"]),  
        
               dftranspose(dfAngles, false),  
        
               filetype = setup["ResultsFileType"],

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_capacity.jl

Line 130 in a760a44

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["capacity_name"]), dfCap, filetype = setup["ResultsFileType"], compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_charge.jl

Line 10 in a760a44

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_charging_cost.jl

Lines 48 to 51 in a760a44

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["charging_cost"]),  
        
                       dfChargingcost,  
        
                       filetype = setup["ResultsFileType"],  
        
                       compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_co2.jl

Line 20 in a760a44

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_co2.jl

Line 35 in a760a44

    
           write_temporal_data(df, emissions_plant, path, setup, setup["WriteResultsNamesDict"]["emissions"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_co2.jl

Lines 58 to 59 in a760a44

    
           df, emissions_captured_plant, path, setup, setup["WriteResultsNamesDict"]["captured_emissions_plant"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_costs.jl

Lines 327 to 328 in a760a44

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["costs"]), dfCost, filetype = setup["ResultsFileType"], compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_curtailment.jl

Line 11 in a760a44

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_curtailment.jl

Line 60 in a760a44

    
           write_temporal_data(df, curtailment, path, setup, setup["WriteResultsNamesDict"]["curtail"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_emissions.jl

Line 38 in a760a44

dfEmissions[!,1] = convert.(Float64,dfEmissions[!,1])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_emissions.jl

Lines 59 to 62 in a760a44

    
           write_output_file(joinpath(path,  
        
                   setup["WriteResultsNamesDict"]["emissions"]),  
        
                   dfEmissions, filetype = setup["ResultsFileType"],  
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_emissions.jl

Lines 99 to 101 in a760a44

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["emissions"]),  
        
               dfEmissions,  
        
               filetype = setup["ResultsFileType"],

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_emissions.jl

Line 103 in a760a44

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_emissions.jl

Lines 119 to 122 in a760a44

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["emissions"]),  
        
                   dfEmissions,  
        
                   filetype = setup["ResultsFileType"],  
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_emissions.jl

Lines 141 to 143 in a760a44

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["emissions"]),  
        
               dfEmissions,  
        
               filetype = setup["ResultsFileType"],

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_emissions.jl

Line 146 in a760a44

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_emissions.jl

Line 148 in a760a44

    
           write_full_time_series_reconstruction(path, setup, dfEmissions, setup["WriteResultsNamesDict"]["emissions"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_energy_revenue.jl

Lines 33 to 35 in a760a44

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["energy_revenue"]),  
        
               dfEnergyRevenue,  
        
               filetype = setup["ResultsFileType"],

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_energy_revenue.jl

Line 37 in a760a44

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_fuel_consumption.jl

Lines 68 to 69 in a760a44

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["fuel_cost_plant"]), dfPlantFuel, filetype = setup["ResultsFileType"], compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_fuel_consumption.jl

Line 88 in a760a44

write_output_file(joinpath(path,

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_fuel_consumption.jl

Lines 90 to 91 in a760a44

    
           dftranspose(dfPlantFuel_TS, true), filetype = setup["ResultsFileType"],  
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_fuel_consumption.jl

Line 95 in a760a44

    
           path, setup, dftranspose(dfPlantFuel_TS, true),setup["WriteResultsNamesDict"]["fuel_consumption_plant"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_fuel_consumption.jl

Lines 114 to 115 in a760a44

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["fuel_consumption_total"]),dfFuel, filetype = setup["ResultsFileType"], compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_maintenance.jl

Line 19 in a760a44

    
           write_output_file(filename,df,filetype = setup["ResultsFileType"],compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_maintenance.jl

Line 27 in a760a44

    
           write_timeseries_variables(EP, downvars, joinpath(path, setup["WriteResultsNamesDict"]["maint_down"]))

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_net_revenue.jl

Lines 288 to 289 in a760a44

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["revenue"]),dfNetRevenue, filetype = setup["ResultsFileType"], compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_nse.jl

Lines 27 to 29 in a760a44

    
           dfNse,  
        
           filetype = setup["ResultsFileType"],  
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_nse.jl

Line 51 in a760a44

    
           CSV.write(joinpath(path, setup["WriteResultsNamesDict"]["nse"]), dftranspose(dfNse, false), writeheader = false)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_nse.jl

Lines 57 to 60 in a760a44

    
                  #= if setup["OutputFullTimeSeries"] == 1 && setup["TimeDomainReduction"] == 1 
        
                       write_full_time_series_reconstruction(path, setup, dfNse, "nse") 
        
                       @info("Writing Full Time Series for NSE") 
        
                   end=#

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 488 in a760a44

    
           write_output_file(fullpath, dfOut, filetype = setup["ResultsFileType"], compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Lines 513 to 515 in a760a44

    
           write_output_file(fullpath, dfOut,  
        
                   filetype = setup["ResultsFileType"],  
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Lines 613 to 616 in a760a44

    
           write_output_file(joinpath(output_path, "$name"),  
        
                   dfOut_full,  
        
                   filetype = setup["ResultsFileType"], 
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 644 in a760a44

    
           function write_output_file(path::AbstractString, file::DataFrame; filetype::String = "auto_detect", compression::String = "auto_detect")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 666 in a760a44

end

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 671 in a760a44

if compression == "none"

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 673 in a760a44

    
           elseif isgzip(compression) # If no extension is present, and compression is set to gzip, add .gz to the end of the file name.

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 675 in a760a44

    
           elseif compression == "auto_detect" # If no extension is present, but compression is set to auto_detect, no compression is added

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 677 in a760a44

else

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 680 in a760a44

end

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 712 in a760a44

    
           save_with_duckdb(file,path,"csv","none") # DuckDB will automatically detect if the file should be compressed or not

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 718 in a760a44

save_with_duckdb(file,path,"parquet","snappy")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 720 in a760a44

save_with_duckdb(file,path,"parquet","zstd")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 722 in a760a44

save_with_duckdb(file,path,"parquet","uncompressed")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 725 in a760a44

save_with_duckdb(file,path,"parquet","uncompressed")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 728 in a760a44

    
           save_with_duckdb(file,path,"parquet","uncompressed") # If no "-" is present, file is saved uncompressed.

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 731 in a760a44

save_with_duckdb(file,path,"json","none")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 734 in a760a44

end

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 738 in a760a44

save_with_duckdb(file,path,"csv","gzip")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 741 in a760a44

save_with_duckdb(file,path,"csv","gzip")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 745 in a760a44

save_with_duckdb(file,path,"json","auto_detect")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 748 in a760a44

save_with_duckdb(file,path,"json","auto_detect")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 752 in a760a44

save_with_duckdb(file,path,"parquet","uncompressed")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 758 in a760a44

save_with_duckdb(file,path,"parquet","snappy")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 761 in a760a44

save_with_duckdb(file,path,"csv","none")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 764 in a760a44

save_with_duckdb(file,path,"json","auto_detect")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 768 in a760a44

save_with_duckdb(file,path,"parquet","zstd")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 771 in a760a44

save_with_duckdb(file,path,"csv","none")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 773 in a760a44

save_with_duckdb(file,path,"json","zstd")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Lines 781 to 782 in a760a44

    
           if filetype == ".csv"  
        
               save_with_duckdb(file,path,"csv","none")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 784 in a760a44

save_with_duckdb(file,path,"csv","gzip")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 786 in a760a44

save_with_duckdb(file,path,"parquet","uncompressed")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 788 in a760a44

save_with_duckdb(file,path,"json","none")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 790 in a760a44

save_with_duckdb(file,path,"json","gzip")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 822 in a760a44

    
           function save_with_duckdb(file::DataFrame,path::AbstractString,filetype::String,compression::String)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 828 in a760a44

    
           DBInterface.execute(con, "COPY temp_df TO '$path' (FORMAT 'parquet', CODEC '$compression');")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 831 in a760a44

    
           DBInterface.execute(con, "COPY temp_df TO '$path' (FORMAT JSON, AUTO_DETECT true);")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 833 in a760a44

    
           DBInterface.execute(con, "COPY temp_df TO '$path' (FORMAT JSON, COMPRESSION '$compression');")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 837 in a760a44

end

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_power.jl

Line 10 in a760a44

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_power_balance.jl

Line 88 in a760a44

    
           CSV.write(joinpath(path, setup["WriteResultsNamesDict"]["power_balance"]), dfPowerBalance)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_power_balance.jl

Lines 97 to 98 in a760a44


	dfPowerBalance[!,:Zone] = convert.(Float64,dfPowerBalance[!,:Zone])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_power_balance.jl

Line 105 in a760a44

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_price.jl

Lines 22 to 23 in a760a44

    
           dftranspose(dfPrice, true),  
        
           filetype = setup["ResultsFileType"],

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_price.jl

Line 27 in a760a44

    
           write_full_time_series_reconstruction(path, setup, dftranspose(dfPrice, true), setup["WriteResultsNamesDict"]["prices"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_reliability.jl

Lines 21 to 24 in a760a44

    
           dftranspose(dfReliability, true), 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_reliability.jl

Line 27 in a760a44

    
           write_full_time_series_reconstruction(path, setup, dftranspose(dfReliability, true), setup["WriteResultsNamesDict"]["reliability"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_status.jl

Lines 22 to 25 in a760a44

    
           dfStatus,  
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_storage.jl

Line 10 in a760a44

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_storagedual.jl

Line 9 in a760a44

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_storagedual.jl

Lines 80 to 82 in a760a44

    
           dftranspose(dfStorageDual, true),  
        
           filetype = setup["ResultsFileType"],  
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_storagedual.jl

Line 86 in a760a44

    
           path, setup, dftranspose(dfStorageDual, true), setup["WriteResultsNamesDict"]["storagebal_duals"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_subsidy_revenue.jl

Lines 122 to 128 in a760a44

    
                   dfSubRevenue, 
        
                   filetype = setup["ResultsFileType"], 
        
                   compression = setup["ResultsCompressionType"]) 
        
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["reg_subsidy_revenue"]), 
        
                   dfRegSubRevenue, 
        
                   filetype = setup["ResultsFileType"], 
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_time_weights.jl

Lines 7 to 10 in a760a44

    
           dfTimeWeights, 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_vre_stor.jl

Lines 336 to 338 in a760a44

    
           dfCap, 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_vre_stor.jl

Line 481 in a760a44

    
           filepath = joinpath(path, setup["WriteResultsNamesDict"]["vre_stor_elec_power_consumption"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_vre_stor.jl

Line 483 in a760a44

write_annual(filepath, dfVP_VRE_STOR,setup)

github-actions · 2024-09-11T19:12:32Z

src/additional_tools/method_of_morris.jl

+            Morris_range,filetype = setup["ResultsFileType"],
+            compression = setup["ResultsCompressionType"])


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

Morris_range,filetype = setup["ResultsFileType"],

compression = setup["ResultsCompressionType"])

Morris_range, filetype = setup["ResultsFileType"],

compression = setup["ResultsCompressionType"])

github-actions · 2024-09-11T19:12:32Z

src/case_runners/case_runner.jl

@@ -108,7 +107,7 @@ function run_genx_case_multistage!(case::AbstractString, mysetup::Dict, optimize
    settings_path = get_settings_path(case)
    multistage_settings = get_settings_path(case, "multi_stage_settings.yml") # Multi stage settings YAML file path
    # merge default settings with those specified in the YAML file
-    mysetup["MultiStageSettingsDict"] = configure_settings_multistage(multistage_settings)
+    mysetup["MultiStageSettingsDict"] = configure_settings_multistage(case,multistage_settings)


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

mysetup["MultiStageSettingsDict"] = configure_settings_multistage(case,multistage_settings)

mysetup["MultiStageSettingsDict"] = configure_settings_multistage(

case, multistage_settings)

github-actions · 2024-09-11T19:12:33Z

src/case_runners/case_runner.jl

@@ -118,8 +117,11 @@
        first_stage_path = joinpath(case, "inputs", "inputs_p1")
        TDRpath = joinpath(first_stage_path, mysetup["TimeDomainReductionFolder"])
        system_path = joinpath(first_stage_path, mysetup["SystemFolder"])
-        prevent_doubled_timedomainreduction(system_path)
-        if !time_domain_reduced_files_exist(TDRpath)
+


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

github-actions · 2024-09-11T19:12:33Z

src/case_runners/case_runner.jl

+        prevent_doubled_timedomainreduction(system_path, mysetup["WriteInputNamesDict"]["inputs_p1"])
+        if !time_domain_reduced_files_exist(TDRpath, mysetup["WriteInputNamesDict"]["inputs_p1"])


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

prevent_doubled_timedomainreduction(system_path, mysetup["WriteInputNamesDict"]["inputs_p1"])

if !time_domain_reduced_files_exist(TDRpath, mysetup["WriteInputNamesDict"]["inputs_p1"])

prevent_doubled_timedomainreduction(

system_path, mysetup["WriteInputNamesDict"]["inputs_p1"])

if !time_domain_reduced_files_exist(

TDRpath, mysetup["WriteInputNamesDict"]["inputs_p1"])

github-actions · 2024-09-11T19:12:33Z

src/configure_settings/configure_settings.jl


 # Returns
 - `settings::Dict`: The settings dictionary.
 """
-function configure_settings(settings_path::String, output_settings_path::String)
+function configure_settings(settings_path::String, output_settings_path::String, case::AbstractString)


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

function configure_settings(settings_path::String, output_settings_path::String, case::AbstractString)

function configure_settings(

settings_path::String, output_settings_path::String, case::AbstractString)

github-actions · 2024-09-11T19:12:37Z

src/load_inputs/load_fuels_data.jl

+        my_dir = get_systemfiles_path(setup, TDR_directory, path)
+        filename = setup["WriteInputNamesDict"]["fuel"]
+    end
+


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

github-actions · 2024-09-11T19:12:37Z

src/load_inputs/load_generators_variability.jl

-    my_dir = get_systemfiles_path(setup, TDR_directory, path)
+    if setup["MultiStage"] == 1
+        stage = setup["MultiStageSettingsDict"]["CurStage"]
+        filename = setup["WriteInputNamesDict"][string("inputs_p",stage)]["generators"]


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

filename = setup["WriteInputNamesDict"][string("inputs_p",stage)]["generators"]

filename = setup["WriteInputNamesDict"][string("inputs_p", stage)]["generators"]

github-actions · 2024-09-11T19:12:37Z

src/load_inputs/load_generators_variability.jl

+        stage = setup["MultiStageSettingsDict"]["CurStage"]
+        filename = setup["WriteInputNamesDict"][string("inputs_p",stage)]["generators"]
+    else
+


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

github-actions · 2024-09-11T19:12:37Z

src/load_inputs/load_inputs.jl

+        policies_path = setup["WriteInputNamesDict"]["policies_location"]
+
+        # Read input data about power network topology, operating and expansion attributes
+        if isfile(joinpath(system_path,setup["WriteInputNamesDict"]["network"]))


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

if isfile(joinpath(system_path,setup["WriteInputNamesDict"]["network"]))

if isfile(joinpath(system_path, setup["WriteInputNamesDict"]["network"]))

github-actions · 2024-09-11T19:12:37Z

src/load_inputs/load_inputs.jl

+        system_path = joinpath(path,setup["WriteInputNamesDict"][string("inputs_p", stage)]["system_location"])
+        resources_path = joinpath(path,setup["WriteInputNamesDict"][string("inputs_p", stage)]["resources_location"])
+        policies_path = joinpath(path,setup["WriteInputNamesDict"][string("inputs_p", stage)]["policies_location"])


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

system_path = joinpath(path,setup["WriteInputNamesDict"][string("inputs_p", stage)]["system_location"])

resources_path = joinpath(path,setup["WriteInputNamesDict"][string("inputs_p", stage)]["resources_location"])

policies_path = joinpath(path,setup["WriteInputNamesDict"][string("inputs_p", stage)]["policies_location"])

system_path = joinpath(path,

setup["WriteInputNamesDict"][string("inputs_p", stage)]["system_location"])

resources_path = joinpath(path,

setup["WriteInputNamesDict"][string("inputs_p", stage)]["resources_location"])

policies_path = joinpath(path,

setup["WriteInputNamesDict"][string("inputs_p", stage)]["policies_location"])

github-actions

Remaining comments which cannot be posted as a review comment to avoid GitHub Rate Limit

JuliaFormatter

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1348 in 77ca16f

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 1358 to 1359 in 77ca16f

    
           write_output_file(joinpath(inpath, "inputs", Stage_Outfiles[per]["Fuel"]), NewFuelOutput)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1365 in 77ca16f

    
           write_output_file(joinpath(inpath, "inputs", Stage_Outfiles[per]["PMap"]),Stage_PeriodMaps[per])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 1389 to 1394 in 77ca16f

    
           demand_in = get_demand_dataframe(joinpath(inpath, 
        
               "inputs", 
        
               input_stage_directory, 
        
               mysetup["SystemFolder"]), 
        
               mysetup["WriteInputNamesDict"][string("inputs_p",stage_id)] 
        
               )

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 1417 to 1418 in 77ca16f

    
           write_output_file(joinpath(inpath, "inputs", input_stage_directory, Demand_Outfile),demand_in)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1420 in 77ca16f

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 1434 to 1435 in 77ca16f

    
           write_output_file(joinpath(inpath, "inputs", input_stage_directory, GVar_Outfile),GVOutputData)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1473 in 77ca16f

mysetup["WriteInputNamesDict"]["vre_stor_solar_variability"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 1475 to 1480 in 77ca16f

    
           mysetup["WriteInputNamesDict"]["vre_stor_wind_variability"]) 
        
           write_output_file(joinpath(inpath, "inputs", input_stage_directory, SolarVar_Outfile),solar_var) 
        
           write_output_file(joinpath(inpath, "inputs", input_stage_directory, WindVar_Outfile),wind_var)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1489 in 77ca16f

mysetup["WriteInputNamesDict"][string("inputs_p",stage_id)]["fuel"]))

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1491 in 77ca16f

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 1501 to 1502 in 77ca16f

    
           write_output_file(joinpath(inpath, "inputs", input_stage_directory, Fuel_Outfile),NewFuelOutput)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1508 in 77ca16f

    
           write_output_file(joinpath(inpath, "inputs", input_stage_directory, PMap_Outfile),PeriodMap)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1526 in 77ca16f

demand_in = get_demand_dataframe(system_path,mysetup)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Lines 1548 to 1549 in 77ca16f

	write_output_file(joinpath(inpath, Demand_Outfile),demand_in)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1599 in 77ca16f

mysetup["WriteInputNamesDict"]["vre_stor_solar_variability"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1601 in 77ca16f

mysetup["WriteInputNamesDict"]["vre_stor_wind_variability"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1604 in 77ca16f

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/time_domain_reduction/time_domain_reduction.jl

Line 1609 in 77ca16f

    
           fuel_in = load_dataframe(joinpath(system_path, mysetup["WriteInputNamesDict"]["fuel"]))

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/capacity_reserve_margin/write_capacity_value.jl

Lines 151 to 153 in 77ca16f

    
           dfCapValue, 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/capacity_reserve_margin/write_reserve_margin.jl

Lines 8 to 10 in 77ca16f

    
           dftranspose(dfResMar,false), 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/capacity_reserve_margin/write_reserve_margin_revenue.jl

Lines 106 to 109 in 77ca16f

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["reserve_margin_revenue"]), 
        
                   dfResRevenue, 
        
                   filetype = setup["ResultsFileType"], 
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/capacity_reserve_margin/write_reserve_margin_slack.jl

Line 17 in 77ca16f

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["reserve_margin_prices_and_penalties"]),

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/capacity_reserve_margin/write_reserve_margin_slack.jl

Line 28 in 77ca16f

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["reserve_margin_prices_and_penalties"]),

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/capacity_reserve_margin/write_reserve_margin_w.jl

Lines 15 to 17 in 77ca16f

    
           dfResMar_w, 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/co2_cap/write_co2_cap.jl

Lines 25 to 27 in 77ca16f

    
           dfCO2Price, 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/dftranspose.jl

Line 21 in 77ca16f

df_new = df[:,2:end]

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/energy_share_requirement/write_esr_prices.jl

Lines 15 to 19 in 77ca16f

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["esr_prices_and_penalties"]), 
        
                   dfESR, 
        
                   filetype = setup["ResultsFileType"], 
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/energy_share_requirement/write_esr_revenue.jl

Lines 85 to 87 in 77ca16f

    
           dfESRRev, 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/hydrogen/write_hourly_matching_prices.jl

Line 19 in 77ca16f

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["hourly_matching_prices"]),

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/min_max_capacity_requirement/write_maximum_capacity_requirement.jl

Line 22 in 77ca16f

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/min_max_capacity_requirement/write_minimum_capacity_requirement.jl

Line 22 in 77ca16f

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/reserves/write_operating_reserve_price_revenue.jl

Lines 49 to 55 in 77ca16f

    
                   dfOpRsvRevenue, 
        
                   filetype = setup["ResultsFileType"], 
        
                   compression = setup["ResultsCompressionType"]) 
        
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["op_regulation_revenue"]), 
        
                   dfOpRegRevenue, 
        
                   filetype = setup["ResultsFileType"], 
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/reserves/write_reg.jl

Line 13 in 77ca16f

filepath = joinpath(path,setup["WriteResultsNamesDict"]["reg"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/transmission/write_nw_expansion.jl

Lines 23 to 25 in 77ca16f

    
           dfTransCap, 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/transmission/write_transmission_flows.jl

Line 35 in 77ca16f

    
           write_full_time_series_reconstruction(path, setup,  dftranspose(dfFlow, true), setup["WriteResultsNamesDict"]["flow"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/transmission/write_transmission_losses.jl

Lines 22 to 24 in 77ca16f

    
           dfTLosses, 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/transmission/write_transmission_losses.jl

Line 33 in 77ca16f

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/transmission/write_transmission_losses.jl

Line 40 in 77ca16f

    
           write_full_time_series_reconstruction(path, setup, dftranspose(dfTLosses, true), setup["WriteResultsNamesDict"]["tlosses"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_commit.jl

Line 8 in 77ca16f

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_commit.jl

Line 15 in 77ca16f

dfCommit = dftranspose(dfCommit,true)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_commit.jl

Lines 17 to 21 in 77ca16f

    
           write_output_file(joinpath(path,  
        
                   setup["WriteResultsNamesDict"]["commit"]),  
        
                   dfCommit,  
        
                   filetype = setup["ResultsFileType"],  
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_commit.jl

Line 24 in 77ca16f

    
           write_full_time_series_reconstruction(path, setup, dfCommit, setup["WriteResultsNamesDict"]["commit"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_shutdown.jl

Line 5 in 77ca16f

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_shutdown.jl

Line 13 in 77ca16f

filepath = joinpath(path,setup["WriteResultsNamesDict"]["shutdown"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_shutdown.jl

Line 19 in 77ca16f

    
           write_full_time_series_reconstruction(path, setup, df_Shutdown, setup["WriteResultsNamesDict"]["shutdown"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_start.jl

Line 6 in 77ca16f

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/ucommit/write_start.jl

Line 18 in 77ca16f

    
           write_full_time_series_reconstruction(path, setup, df_Start, setup["WriteResultsNamesDict"]["start"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_angles.jl

Lines 18 to 20 in 77ca16f

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["angles"]),  
        
               dftranspose(dfAngles, false),  
        
               filetype = setup["ResultsFileType"],

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_capacity.jl

Line 130 in 77ca16f

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["capacity"]), dfCap, filetype = setup["ResultsFileType"], compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_charge.jl

Line 10 in 77ca16f

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_charging_cost.jl

Lines 48 to 51 in 77ca16f

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["charging_cost"]),  
        
                       dfChargingcost,  
        
                       filetype = setup["ResultsFileType"],  
        
                       compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_co2.jl

Line 20 in 77ca16f

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_co2.jl

Line 35 in 77ca16f

    
           write_temporal_data(df, emissions_plant, path, setup, setup["WriteResultsNamesDict"]["emissions"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_co2.jl

Lines 58 to 59 in 77ca16f

    
           df, emissions_captured_plant, path, setup, setup["WriteResultsNamesDict"]["captured_emissions_plant"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_costs.jl

Lines 327 to 328 in 77ca16f

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["costs"]), dfCost, filetype = setup["ResultsFileType"], compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_curtailment.jl

Line 11 in 77ca16f

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_curtailment.jl

Line 60 in 77ca16f

    
           write_temporal_data(df, curtailment, path, setup, setup["WriteResultsNamesDict"]["curtail"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_emissions.jl

Line 38 in 77ca16f

dfEmissions[!,1] = convert.(Float64,dfEmissions[!,1])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_emissions.jl

Lines 59 to 62 in 77ca16f

    
           write_output_file(joinpath(path,  
        
                   setup["WriteResultsNamesDict"]["emissions"]),  
        
                   dfEmissions, filetype = setup["ResultsFileType"],  
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_emissions.jl

Lines 99 to 101 in 77ca16f

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["emissions"]),  
        
               dfEmissions,  
        
               filetype = setup["ResultsFileType"],

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_emissions.jl

Line 103 in 77ca16f

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_emissions.jl

Lines 119 to 122 in 77ca16f

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["emissions"]),  
        
                   dfEmissions,  
        
                   filetype = setup["ResultsFileType"],  
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_emissions.jl

Lines 141 to 143 in 77ca16f

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["emissions"]),  
        
               dfEmissions,  
        
               filetype = setup["ResultsFileType"],

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_emissions.jl

Line 146 in 77ca16f

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_emissions.jl

Line 148 in 77ca16f

    
           write_full_time_series_reconstruction(path, setup, dfEmissions, setup["WriteResultsNamesDict"]["emissions"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_energy_revenue.jl

Lines 33 to 35 in 77ca16f

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["energy_revenue"]),  
        
               dfEnergyRevenue,  
        
               filetype = setup["ResultsFileType"],

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_energy_revenue.jl

Line 37 in 77ca16f

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_fuel_consumption.jl

Lines 68 to 69 in 77ca16f

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["fuel_cost_plant"]), dfPlantFuel, filetype = setup["ResultsFileType"], compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_fuel_consumption.jl

Line 88 in 77ca16f

write_output_file(joinpath(path,

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_fuel_consumption.jl

Lines 90 to 91 in 77ca16f

    
           dftranspose(dfPlantFuel_TS, true), filetype = setup["ResultsFileType"],  
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_fuel_consumption.jl

Line 95 in 77ca16f

    
           path, setup, dftranspose(dfPlantFuel_TS, true),setup["WriteResultsNamesDict"]["fuel_consumption_plant"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_fuel_consumption.jl

Lines 114 to 115 in 77ca16f

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["fuel_consumption_total"]),dfFuel, filetype = setup["ResultsFileType"], compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_maintenance.jl

Line 19 in 77ca16f

    
           write_output_file(filename,df,filetype = setup["ResultsFileType"],compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_maintenance.jl

Line 27 in 77ca16f

    
           write_timeseries_variables(EP, downvars, joinpath(path, setup["WriteResultsNamesDict"]["maint_down"]))

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_net_revenue.jl

Lines 288 to 289 in 77ca16f

    
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["revenue"]),dfNetRevenue, filetype = setup["ResultsFileType"], compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_nse.jl

Lines 27 to 29 in 77ca16f

    
           dfNse,  
        
           filetype = setup["ResultsFileType"],  
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_nse.jl

Line 51 in 77ca16f

    
           CSV.write(joinpath(path, setup["WriteResultsNamesDict"]["nse"]), dftranspose(dfNse, false), writeheader = false)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_nse.jl

Lines 57 to 60 in 77ca16f

    
                  #= if setup["OutputFullTimeSeries"] == 1 && setup["TimeDomainReduction"] == 1 
        
                       write_full_time_series_reconstruction(path, setup, dfNse, "nse") 
        
                       @info("Writing Full Time Series for NSE") 
        
                   end=#

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 488 in 77ca16f

    
           write_output_file(fullpath, dfOut, filetype = setup["ResultsFileType"], compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Lines 513 to 515 in 77ca16f

    
           write_output_file(fullpath, dfOut,  
        
                   filetype = setup["ResultsFileType"],  
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Lines 613 to 616 in 77ca16f

    
           write_output_file(joinpath(output_path, "$name"),  
        
                   dfOut_full,  
        
                   filetype = setup["ResultsFileType"], 
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 644 in 77ca16f

    
           function write_output_file(path::AbstractString, file::DataFrame; filetype::String = "auto_detect", compression::String = "auto_detect")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 666 in 77ca16f

end

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 671 in 77ca16f

if compression == "none"

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 673 in 77ca16f

    
           elseif isgzip(compression) # If no extension is present, and compression is set to gzip, add .gz to the end of the file name.

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 675 in 77ca16f

    
           elseif compression == "auto_detect" # If no extension is present, but compression is set to auto_detect, no compression is added

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 677 in 77ca16f

else

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 680 in 77ca16f

end

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 712 in 77ca16f

    
           save_with_duckdb(file,path,"csv","none") # DuckDB will automatically detect if the file should be compressed or not

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 718 in 77ca16f

save_with_duckdb(file,path,"parquet","snappy")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 720 in 77ca16f

save_with_duckdb(file,path,"parquet","zstd")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 722 in 77ca16f

save_with_duckdb(file,path,"parquet","uncompressed")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 725 in 77ca16f

save_with_duckdb(file,path,"parquet","uncompressed")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 728 in 77ca16f

    
           save_with_duckdb(file,path,"parquet","uncompressed") # If no "-" is present, file is saved uncompressed.

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 731 in 77ca16f

save_with_duckdb(file,path,"json","none")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 734 in 77ca16f

end

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 738 in 77ca16f

save_with_duckdb(file,path,"csv","gzip")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 741 in 77ca16f

save_with_duckdb(file,path,"csv","gzip")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 745 in 77ca16f

save_with_duckdb(file,path,"json","auto_detect")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 748 in 77ca16f

save_with_duckdb(file,path,"json","auto_detect")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 752 in 77ca16f

save_with_duckdb(file,path,"parquet","uncompressed")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 758 in 77ca16f

save_with_duckdb(file,path,"parquet","snappy")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 761 in 77ca16f

save_with_duckdb(file,path,"csv","none")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 764 in 77ca16f

save_with_duckdb(file,path,"json","auto_detect")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 768 in 77ca16f

save_with_duckdb(file,path,"parquet","zstd")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 771 in 77ca16f

save_with_duckdb(file,path,"csv","none")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 773 in 77ca16f

save_with_duckdb(file,path,"json","zstd")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Lines 781 to 782 in 77ca16f

    
           if filetype == ".csv"  
        
               save_with_duckdb(file,path,"csv","none")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 785 in 77ca16f

save_with_duckdb(file,path,"csv","gzip")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 787 in 77ca16f

save_with_duckdb(file,path,"parquet","uncompressed")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 789 in 77ca16f

save_with_duckdb(file,path,"json","none")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 792 in 77ca16f

save_with_duckdb(file,path,"json","gzip")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 809 in 77ca16f

    
           if compression == "gzip" || compression == ".gz" || compression == "gz" || compression == ".gzip"

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 824 in 77ca16f

    
           function save_with_duckdb(file::DataFrame,path::AbstractString,filetype::String,compression::String)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 830 in 77ca16f

    
           DBInterface.execute(con, "COPY temp_df TO '$path' (FORMAT 'parquet', CODEC '$compression');")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 833 in 77ca16f

    
           DBInterface.execute(con, "COPY temp_df TO '$path' (FORMAT JSON, AUTO_DETECT true);")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 835 in 77ca16f

    
           DBInterface.execute(con, "COPY temp_df TO '$path' (FORMAT JSON, COMPRESSION '$compression');")

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_outputs.jl

Line 839 in 77ca16f

end

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_power.jl

Line 10 in 77ca16f

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_power_balance.jl

Line 88 in 77ca16f

    
           CSV.write(joinpath(path, setup["WriteResultsNamesDict"]["power_balance"]), dfPowerBalance)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_power_balance.jl

Lines 97 to 98 in 77ca16f


	dfPowerBalance[!,:Zone] = convert.(Float64,dfPowerBalance[!,:Zone])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_power_balance.jl

Line 105 in 77ca16f

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_price.jl

Lines 22 to 23 in 77ca16f

    
           dftranspose(dfPrice, true),  
        
           filetype = setup["ResultsFileType"],

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_price.jl

Line 27 in 77ca16f

    
           write_full_time_series_reconstruction(path, setup, dftranspose(dfPrice, true), setup["WriteResultsNamesDict"]["prices"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_reliability.jl

Lines 21 to 24 in 77ca16f

    
           dftranspose(dfReliability, true), 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_reliability.jl

Line 27 in 77ca16f

    
           write_full_time_series_reconstruction(path, setup, dftranspose(dfReliability, true), setup["WriteResultsNamesDict"]["reliability"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_status.jl

Lines 22 to 25 in 77ca16f

    
           dfStatus,  
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_storage.jl

Line 10 in 77ca16f

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_storagedual.jl

Line 9 in 77ca16f

zones = convert.(Float64,zones)

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_storagedual.jl

Lines 80 to 82 in 77ca16f

    
           dftranspose(dfStorageDual, true),  
        
           filetype = setup["ResultsFileType"],  
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_storagedual.jl

Line 86 in 77ca16f

    
           path, setup, dftranspose(dfStorageDual, true), setup["WriteResultsNamesDict"]["storagebal_duals"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_subsidy_revenue.jl

Lines 122 to 128 in 77ca16f

    
                   dfSubRevenue, 
        
                   filetype = setup["ResultsFileType"], 
        
                   compression = setup["ResultsCompressionType"]) 
        
           write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["reg_subsidy_revenue"]), 
        
                   dfRegSubRevenue, 
        
                   filetype = setup["ResultsFileType"], 
        
                   compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_time_weights.jl

Lines 7 to 10 in 77ca16f

    
           dfTimeWeights, 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_vre_stor.jl

Lines 336 to 338 in 77ca16f

    
           dfCap, 
        
           filetype = setup["ResultsFileType"], 
        
           compression = setup["ResultsCompressionType"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_vre_stor.jl

Line 481 in 77ca16f

    
           filepath = joinpath(path, setup["WriteResultsNamesDict"]["vre_stor_elec_power_consumption"])

[JuliaFormatter] _{reported by reviewdog 🐶}

GenX.jl/src/write_outputs/write_vre_stor.jl

Line 483 in 77ca16f

write_annual(filepath, dfVP_VRE_STOR,setup)

github-actions · 2024-09-12T15:32:22Z

src/configure_settings/configure_settings.jl

@@ -36,32 +36,55 @@ function default_settings()
        "ResourcePoliciesFolder" => "policy_assignments",
        "SystemFolder" => "system",
        "PoliciesFolder" => "policies",
-        "ObjScale" => 1)
+        "ObjScale" => 1,
+        "ResultsFileType" => "auto_detect", 


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

"ResultsFileType" => "auto_detect",

"ResultsFileType" => "auto_detect",

github-actions · 2024-09-12T15:32:23Z

src/configure_settings/configure_settings.jl

+   Dict{Any, Any}("angles" => "angles",
+    "capacity" => "capacity",
+    "capacity_factor" => "capacityfactor",
+    "capacity_vaue" => "CapacityValue",
+    "capacities_charge_multi_stage" => "capacities_charge_multi_stage",
+    "capacities_multi_stage" => "capacities_multi_stage",
+    "capacities_energy_multi_stage" => "capacities_energy_multi_stage",
+    "captured_emissions_plant" => "captured_emissions_plant",
+    "charge" => "charge.csv",
+    "charging_cost" => "ChargingCost",
+    "co2_prices" => "CO2_prices_and_penalties",
+    "commit" => "commit",
+    "costs" => "costs",
+    "costs_multi_stage" => "costs_multi_stage",
+    "curtail" => "curtail",
+    "dStorage" => "dStorage",
+    "emissions_plant" => "emissions_plant",
+    "emissions" => "emissions",
+    "energy_revenue" => "EnergyRevenue",
+    "esr_prices_and_penalties" => "ESR_prices_and_penalties",
+    "esr_revenue" => "ESR_Revenue",
+    "flow" => "flow",
+    "fuel_cost_plant" => "Fuel_cost_plant",
+    "fuel_consumption_plant" => "FuelConsumption_plant_MMBTU",
+    "fuel_consumption_total" => "FuelConsumtion_total_MMBTU",
+    "hourly_matching_prices" => "hourly_matching_prices",
+    "hydrogen_prices" => "hydrogen_prices",
+    "mincap" => "MinCapReq_prices_and_penalties",
+    "maxcap" => "MaxCapReq_prices_and_penalties",
+    "maint_down" => "maint_down",
+    "morris" => "morris",
+    "revenue" => "NetRevenue",
+    "network_expansion" => "network_expansion",
+    "network_expansion_multi_stage" => "network_expansion_multi_stage",
+    "nse" => "nse",
+    "power_balance" => "power_balance",
+    "power" => "power",
+    "prices" => "prices",
+    "reg_subsidy_revenue" => "RegSubsidyRevenue",
+    "reserve_margin" => "ReserveMargin",
+    "reserve_margin_revenue" => "ReserveMarginRevenue",
+    "reserve_margin_prices_and_penalties" => "ReserveMargin_prices_and_penalties",
+    "reserve_margin_w" => "ReserveMargin_w.csv",
+    "reg" => "reg",
+    "reg_dn" => "reg_dn",
+    "reliability" => "reliability",
+    "shutdown" => "shutdown",
+    "start" => "start",
+    "status" => "status",
+    "storage" => "storage",
+    "storagebal_duals" => "storagebal_duals",
+    "storage_init" => "StorageInit",
+    "subsidy_revenue" => "SubsidyRevenue",
+    "time_weights" => "time_weights",
+    "tlosses" => "tlosses",
+    "virtual_discharge" => "virtual_discharge",
+    "vre_stor_dc_charge" => "vre_stor_dc_charge",
+    "vre_stor_ac_charge" => "vre_stor_ac_charge",
+    "vre_stor_dc_discharge" => "vre_stor_dc_discharge",
+    "vre_stor_ac_discharge" => "vre_stor_ac_discharge",
+    "vre_stor_elec_power_consumption" => "vre_stor_elec_power_consumption",
+    "vre_stor_wind_power" => "vre_stor_wind_power",
+    "vre_stor_solar_power" => "vre_stor_solar_power",
+    "vre_stor_capacity" => "vre_stor_capacity")


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

Dict{Any, Any}("angles" => "angles",

"capacity" => "capacity",

"capacity_factor" => "capacityfactor",

"capacity_vaue" => "CapacityValue",

"capacities_charge_multi_stage" => "capacities_charge_multi_stage",

"capacities_multi_stage" => "capacities_multi_stage",

"capacities_energy_multi_stage" => "capacities_energy_multi_stage",

"captured_emissions_plant" => "captured_emissions_plant",

"charge" => "charge.csv",

"charging_cost" => "ChargingCost",

"co2_prices" => "CO2_prices_and_penalties",

"commit" => "commit",

"costs" => "costs",

"costs_multi_stage" => "costs_multi_stage",

"curtail" => "curtail",

"dStorage" => "dStorage",

"emissions_plant" => "emissions_plant",

"emissions" => "emissions",

"energy_revenue" => "EnergyRevenue",

"esr_prices_and_penalties" => "ESR_prices_and_penalties",

"esr_revenue" => "ESR_Revenue",

"flow" => "flow",

"fuel_cost_plant" => "Fuel_cost_plant",

"fuel_consumption_plant" => "FuelConsumption_plant_MMBTU",

"fuel_consumption_total" => "FuelConsumtion_total_MMBTU",

"hourly_matching_prices" => "hourly_matching_prices",

"hydrogen_prices" => "hydrogen_prices",

"mincap" => "MinCapReq_prices_and_penalties",

"maxcap" => "MaxCapReq_prices_and_penalties",

"maint_down" => "maint_down",

"morris" => "morris",

"revenue" => "NetRevenue",

"network_expansion" => "network_expansion",

"network_expansion_multi_stage" => "network_expansion_multi_stage",

"nse" => "nse",

"power_balance" => "power_balance",

"power" => "power",

"prices" => "prices",

"reg_subsidy_revenue" => "RegSubsidyRevenue",

"reserve_margin" => "ReserveMargin",

"reserve_margin_revenue" => "ReserveMarginRevenue",

"reserve_margin_prices_and_penalties" => "ReserveMargin_prices_and_penalties",

"reserve_margin_w" => "ReserveMargin_w.csv",

"reg" => "reg",

"reg_dn" => "reg_dn",

"reliability" => "reliability",

"shutdown" => "shutdown",

"start" => "start",

"status" => "status",

"storage" => "storage",

"storagebal_duals" => "storagebal_duals",

"storage_init" => "StorageInit",

"subsidy_revenue" => "SubsidyRevenue",

"time_weights" => "time_weights",

"tlosses" => "tlosses",

"virtual_discharge" => "virtual_discharge",

"vre_stor_dc_charge" => "vre_stor_dc_charge",

"vre_stor_ac_charge" => "vre_stor_ac_charge",

"vre_stor_dc_discharge" => "vre_stor_dc_discharge",

"vre_stor_ac_discharge" => "vre_stor_ac_discharge",

"vre_stor_elec_power_consumption" => "vre_stor_elec_power_consumption",

"vre_stor_wind_power" => "vre_stor_wind_power",

"vre_stor_solar_power" => "vre_stor_solar_power",

"vre_stor_capacity" => "vre_stor_capacity")

Dict{Any, Any}("angles" => "angles",

"capacity" => "capacity",

"capacity_factor" => "capacityfactor",

"capacity_vaue" => "CapacityValue",

"capacities_charge_multi_stage" => "capacities_charge_multi_stage",

"capacities_multi_stage" => "capacities_multi_stage",

"capacities_energy_multi_stage" => "capacities_energy_multi_stage",

"captured_emissions_plant" => "captured_emissions_plant",

"charge" => "charge.csv",

"charging_cost" => "ChargingCost",

"co2_prices" => "CO2_prices_and_penalties",

"commit" => "commit",

"costs" => "costs",

"costs_multi_stage" => "costs_multi_stage",

"curtail" => "curtail",

"dStorage" => "dStorage",

"emissions_plant" => "emissions_plant",

"emissions" => "emissions",

"energy_revenue" => "EnergyRevenue",

"esr_prices_and_penalties" => "ESR_prices_and_penalties",

"esr_revenue" => "ESR_Revenue",

"flow" => "flow",

"fuel_cost_plant" => "Fuel_cost_plant",

"fuel_consumption_plant" => "FuelConsumption_plant_MMBTU",

"fuel_consumption_total" => "FuelConsumtion_total_MMBTU",

"hourly_matching_prices" => "hourly_matching_prices",

"hydrogen_prices" => "hydrogen_prices",

"mincap" => "MinCapReq_prices_and_penalties",

"maxcap" => "MaxCapReq_prices_and_penalties",

"maint_down" => "maint_down",

"morris" => "morris",

"revenue" => "NetRevenue",

"network_expansion" => "network_expansion",

"network_expansion_multi_stage" => "network_expansion_multi_stage",

"nse" => "nse",

"power_balance" => "power_balance",

"power" => "power",

"prices" => "prices",

"reg_subsidy_revenue" => "RegSubsidyRevenue",

"reserve_margin" => "ReserveMargin",

"reserve_margin_revenue" => "ReserveMarginRevenue",

"reserve_margin_prices_and_penalties" => "ReserveMargin_prices_and_penalties",

"reserve_margin_w" => "ReserveMargin_w.csv",

"reg" => "reg",

"reg_dn" => "reg_dn",

"reliability" => "reliability",

"shutdown" => "shutdown",

"start" => "start",

"status" => "status",

"storage" => "storage",

"storagebal_duals" => "storagebal_duals",

"storage_init" => "StorageInit",

"subsidy_revenue" => "SubsidyRevenue",

"time_weights" => "time_weights",

"tlosses" => "tlosses",

"virtual_discharge" => "virtual_discharge",

"vre_stor_dc_charge" => "vre_stor_dc_charge",

"vre_stor_ac_charge" => "vre_stor_ac_charge",

"vre_stor_dc_discharge" => "vre_stor_dc_discharge",

"vre_stor_ac_discharge" => "vre_stor_ac_discharge",

"vre_stor_elec_power_consumption" => "vre_stor_elec_power_consumption",

"vre_stor_wind_power" => "vre_stor_wind_power",

"vre_stor_solar_power" => "vre_stor_solar_power",

"vre_stor_capacity" => "vre_stor_capacity")

github-actions · 2024-09-12T15:32:23Z

src/load_inputs/load_inputs.jl

+        resources_path = joinpath(path,setup["WriteInputNamesDict"][string("inputs_p", stage)]["resources_location"])
+        policies_path = joinpath(path,setup["WriteInputNamesDict"][string("inputs_p", stage)]["policies_location"])
+        # Read input data about power network topology, operating and expansion attributes
+        if isfile(joinpath(system_path,setup["WriteInputNamesDict"][string("inputs_p", stage)]["network"]))


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

if isfile(joinpath(system_path,setup["WriteInputNamesDict"][string("inputs_p", stage)]["network"]))

if isfile(joinpath(system_path,

setup["WriteInputNamesDict"][string("inputs_p", stage)]["network"]))

github-actions · 2024-09-12T15:32:23Z

src/load_inputs/load_inputs.jl

+     # Read temporal-resolved load data, and clustering information if relevant
+     load_demand_data!(setup, system_path, inputs)
+     # Read fuel cost data, including time-varying fuel costs
+     load_fuels_data!(setup, system_path, inputs)
+     # Read in generator/resource related inputs
+     load_resources_data!(inputs, setup, path, resources_path)
+     # Read in generator/resource availability profiles
+     load_generators_variability!(setup,system_path, inputs)
+


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

# Read temporal-resolved load data, and clustering information if relevant

load_demand_data!(setup, system_path, inputs)

# Read fuel cost data, including time-varying fuel costs

load_fuels_data!(setup, system_path, inputs)

# Read in generator/resource related inputs

load_resources_data!(inputs, setup, path, resources_path)

# Read in generator/resource availability profiles

load_generators_variability!(setup,system_path, inputs)

# Read temporal-resolved load data, and clustering information if relevant

load_demand_data!(setup, system_path, inputs)

# Read fuel cost data, including time-varying fuel costs

load_fuels_data!(setup, system_path, inputs)

# Read in generator/resource related inputs

load_resources_data!(inputs, setup, path, resources_path)

# Read in generator/resource availability profiles

load_generators_variability!(setup, system_path, inputs)

github-actions · 2024-09-12T15:32:23Z

src/load_inputs/load_inputs.jl

-        return TDR_directory
+    if setup["MultiStage"] == 1
+        stage = setup["MultiStageSettingsDict"]["CurStage"]
+        if setup["TimeDomainReduction"] == 1 && time_domain_reduced_files_exist(TDR_directory, setup["WriteInputNamesDict"][string("inputs_p",stage)])


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

if setup["TimeDomainReduction"] == 1 && time_domain_reduced_files_exist(TDR_directory, setup["WriteInputNamesDict"][string("inputs_p",stage)])

if setup["TimeDomainReduction"] == 1 && time_domain_reduced_files_exist(

TDR_directory, setup["WriteInputNamesDict"][string("inputs_p", stage)])

github-actions · 2024-09-12T15:32:25Z

src/time_domain_reduction/time_domain_reduction.jl

@@ -1253,7 +1257,8 @@
                ### TDR_Results/Demand_data_clustered.csv
                demand_in = get_demand_dataframe(
                    joinpath(inpath, "inputs", "inputs_p$per"),
-                    mysetup["SystemFolder"])
+                    mysetup["SystemFolder"]
+                    )


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

)

)

github-actions · 2024-09-12T15:32:25Z

src/time_domain_reduction/time_domain_reduction.jl

+                write_output_file(joinpath(inpath, "inputs", Stage_Outfiles[per]["Demand"]), demand_in)
+


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

write_output_file(joinpath(inpath, "inputs", Stage_Outfiles[per]["Demand"]), demand_in)

write_output_file(

joinpath(inpath, "inputs", Stage_Outfiles[per]["Demand"]), demand_in)

github-actions · 2024-09-12T15:32:26Z

src/time_domain_reduction/time_domain_reduction.jl

+                write_output_file(joinpath(inpath, "inputs", Stage_Outfiles[per]["GVar"]),GVOutputData)
+


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

write_output_file(joinpath(inpath, "inputs", Stage_Outfiles[per]["GVar"]),GVOutputData)

write_output_file(

joinpath(inpath, "inputs", Stage_Outfiles[per]["GVar"]), GVOutputData)

github-actions · 2024-09-12T15:32:26Z

src/time_domain_reduction/time_domain_reduction.jl

+
+                    write_output_file(joinpath(inpath, "inputs", Stage_Outfiles[per]["GSolar"]), solar_var)
+                    write_output_file(joinpath(inpath, "inputs", Stage_Outfiles[per]["GWind"]), wind_var)
+


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

write_output_file(joinpath(inpath, "inputs", Stage_Outfiles[per]["GSolar"]), solar_var)

write_output_file(joinpath(inpath, "inputs", Stage_Outfiles[per]["GWind"]), wind_var)

github-actions · 2024-09-12T15:32:26Z

src/time_domain_reduction/time_domain_reduction.jl

-                    CSV.write(joinpath(inpath, "inputs", Stage_Outfiles[per]["GSolar"]),
-                        solar_var)
-                    CSV.write(joinpath(inpath, "inputs", Stage_Outfiles[per]["GWind"]),
-                        wind_var)
                end


[JuliaFormatter] _{reported by reviewdog 🐶}

Suggested change

end

write_output_file(

joinpath(inpath, "inputs", Stage_Outfiles[per]["GSolar"]),

solar_var)

write_output_file(

joinpath(inpath, "inputs", Stage_Outfiles[per]["GWind"]), wind_var)

end

cfe316 · 2024-09-27T13:35:16Z

src/configure_settings/configure_settings.jl

+function default_input_names(case::AbstractString)
+    Dict{Any, Any}("system_location" => joinpath(case, "system"),
+    "demand" => "Demand_data.csv",
+    "fuel" => "Fuels_data.csv",
+    "generators" => "Generators_variability.csv",
+    "network" => "Network.csv",
+    "resources_location" => joinpath(case, "resources"),
+    "storage" => "Storage.csv",
+    "thermal" => "Thermal.csv",
+    "vre" => "Vre.csv",
+    "vre_stor" => "Vre_stor.csv",
+    "vre_stor_solar_variability" => "Vre_and_stor_solar_variability.csv",
+    "vre_stor_wind_variability" => "Vre_and_stor_wind_variability.csv",
+    "hydro" => "Hydro.csv",
+    "flex_demand" => "Flex_demand.csv",
+    "must_run" => "Must_run.csv",
+    "electrolyzer" => "Electrolyzer.csv",
+    "resource_cap" => "Resource_capacity_reserve_margin.csv",
+    "resource_energy_share_requirement" => "Resource_energy_share_requirement.csv",
+    "resource_min" => "Resource_minimum_capacity_requirement.csv",
+    "resource_max" => "Resource_maximum_capacity_requirement.csv",
+    "resource_hydrogen_demand" => "Resource_hydrogen_demand.csv",
+    "resource_hourly_matching" => "Resource_hourly_matching.csv",
+    "resource_multistage_data" => "Resource_multistage_data.csv",
+    "policies_location" => joinpath(case, "policies"),
+    "period_map" => "Period_map.csv",
+    "capacity" => "Capacity_reserve_margin.csv",
+    "CRM_slack" => "Capacity_reserve_margin_slack.csv",
+    "co2_cap" => "CO2_cap.csv",
+    "co2_cap_slack" => "CO2_cap_slack.csv",
+    "esr" => "Energy_share_requirement.csv",
+    "esr_slack" => "Energy_share_requirement_slack.csv",
+    "min_cap" => "Minimum_capacity_requirement.csv",
+    "max_cap" => "Maximum_capacity_requirement.csv",
+    "operational_reserves" => "Operational_reserves.csv")


It might make sense to have this be a dict{Symbol, String} or dict{Symbol, Any}. i.e. the keys of the dict should be Symbols, not strings. In general symbols are nicer as identifiers where you don't need to decompose the strings into characters or concatenate them into longer strings.

cfe316 reviewed Aug 13, 2024

View reviewed changes

gschivley reviewed Aug 30, 2024

View reviewed changes

Maya Mutic and others added 8 commits August 31, 2024 14:22

Users can now add filenames in input_settings.yml

6b6c0e7

Added additional example file

1b0319c

Added DuckDB to load_data_from_file()

f420779

Added write_output_file to take in parquet and json filetypes

d2f85c2

Added write_output_file to all results

606d747

Code cleanup

e404b46

Minor changes

0dfc096

Added error message to configure_settings

2c1a803

mmutic force-pushed the 639-allow-the-user-to-define-input-and-output-file-names branch from d489262 to 2c1a803 Compare August 31, 2024 13:46

Maya Mutic added 2 commits September 8, 2024 13:31

rebasing

8377794

Added multistage input file names

a760a44

github-actions bot reviewed Sep 11, 2024

View reviewed changes

mmutic requested a review from lbonaldo September 11, 2024 19:12

Minor edits, file cleanup

77ca16f

github-actions bot reviewed Sep 12, 2024

View reviewed changes

mmutic marked this pull request as ready for review September 12, 2024 15:38

cfe316 reviewed Sep 27, 2024

View reviewed changes

lbonaldo added the enhancement New feature or request label Dec 3, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

639 allow the user to define input and output file names #734

639 allow the user to define input and output file names #734

mmutic commented Aug 5, 2024 •

edited

Loading

cfe316 Aug 13, 2024

cfe316 Aug 13, 2024

cfe316 Aug 13, 2024

cfe316 Aug 13, 2024

cfe316 Aug 13, 2024

cfe316 Aug 13, 2024

cfe316 Aug 13, 2024

gschivley Aug 30, 2024

github-actions bot left a comment

github-actions bot Sep 11, 2024

github-actions bot Sep 11, 2024

github-actions bot Sep 11, 2024

github-actions bot Sep 11, 2024

github-actions bot Sep 11, 2024

github-actions bot Sep 11, 2024

github-actions bot Sep 11, 2024

github-actions bot Sep 11, 2024

github-actions bot Sep 11, 2024

github-actions bot Sep 11, 2024

github-actions bot left a comment

github-actions bot Sep 12, 2024

github-actions bot Sep 12, 2024

github-actions bot Sep 12, 2024

github-actions bot Sep 12, 2024

github-actions bot Sep 12, 2024

github-actions bot Sep 12, 2024

github-actions bot Sep 12, 2024

github-actions bot Sep 12, 2024

github-actions bot Sep 12, 2024

github-actions bot Sep 12, 2024

cfe316 Sep 27, 2024

	# Read temporal-resolved load data, and clustering information if relevant
	load_demand_data!(setup, system_path, inputs)
	# Read fuel cost data, including time-varying fuel costs
	load_fuels_data!(setup, system_path, inputs)
	# Read in generator/resource related inputs
	load_resources_data!(inputs, setup, path, resources_path)
	# Read in generator/resource availability profiles
	load_generators_variability!(setup,system_path, inputs)

	Demand_Outfile = joinpath(TimeDomainReductionFolder, mysetup["WriteInputNamesDict"][string("inputs_p",stage)]["demand"])
	GVar_Outfile = joinpath(TimeDomainReductionFolder, mysetup["WriteInputNamesDict"][string("inputs_p",stage)]["generators"])
	Fuel_Outfile = joinpath(TimeDomainReductionFolder, mysetup["WriteInputNamesDict"][string("inputs_p",stage)]["fuel"])
	PMap_Outfile = joinpath(TimeDomainReductionFolder, mysetup["WriteInputNamesDict"][string("inputs_p",stage)]["period_map"])
	YAML_Outfile = joinpath(TimeDomainReductionFolder, "time_domain_reduction_settings.yml")

	write_output_file(joinpath(inpath, "inputs", Stage_Outfiles[per]["Demand"]), demand_in)

	demand_in = get_demand_dataframe(joinpath(inpath,
	"inputs",
	input_stage_directory,
	mysetup["SystemFolder"]),
	mysetup["WriteInputNamesDict"][string("inputs_p",stage_id)]
	)

	dfCapValue,
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])

	dftranspose(dfResMar,false),
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])

	write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["reserve_margin_revenue"]),
	dfResRevenue,
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])

	dfResMar_w,
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])

	dfCO2Price,
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])


	write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["esr_prices_and_penalties"]),
	dfESR,
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])

	dfESRRev,
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])

	dfOpRsvRevenue,
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])
	write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["op_regulation_revenue"]),
	dfOpRegRevenue,
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])

	dfTransCap,
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])

	dfTLosses,
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])

	write_output_file(joinpath(path,
	setup["WriteResultsNamesDict"]["commit"]),
	dfCommit,
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])

	write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["angles"]),
	dftranspose(dfAngles, false),
	filetype = setup["ResultsFileType"],

	write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["charging_cost"]),
	dfChargingcost,
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])

	df, emissions_captured_plant, path, setup, setup["WriteResultsNamesDict"]["captured_emissions_plant"])

	write_output_file(joinpath(path,
	setup["WriteResultsNamesDict"]["emissions"]),
	dfEmissions, filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])

	write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["emissions"]),
	dfEmissions,
	filetype = setup["ResultsFileType"],

639 allow the user to define input and output file names #734

Are you sure you want to change the base?

639 allow the user to define input and output file names #734

Conversation

mmutic commented Aug 5, 2024 • edited Loading

Description

What type of PR is this? (check all applicable)

Related Tickets & Documents

Checklist

How this can be tested

Post-approval checklist for GenX core developers

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

github-actions bot left a comment

Choose a reason for hiding this comment

github-actions bot Sep 11, 2024

Choose a reason for hiding this comment

github-actions bot Sep 11, 2024

Choose a reason for hiding this comment

github-actions bot Sep 11, 2024

Choose a reason for hiding this comment

github-actions bot Sep 11, 2024

Choose a reason for hiding this comment

github-actions bot Sep 11, 2024

Choose a reason for hiding this comment

github-actions bot Sep 11, 2024

Choose a reason for hiding this comment

github-actions bot Sep 11, 2024

Choose a reason for hiding this comment

github-actions bot Sep 11, 2024

Choose a reason for hiding this comment

github-actions bot Sep 11, 2024

Choose a reason for hiding this comment

github-actions bot Sep 11, 2024

Choose a reason for hiding this comment

github-actions bot left a comment

Choose a reason for hiding this comment

github-actions bot Sep 12, 2024

Choose a reason for hiding this comment

github-actions bot Sep 12, 2024

Choose a reason for hiding this comment

github-actions bot Sep 12, 2024

Choose a reason for hiding this comment

github-actions bot Sep 12, 2024

Choose a reason for hiding this comment

github-actions bot Sep 12, 2024

Choose a reason for hiding this comment

github-actions bot Sep 12, 2024

Choose a reason for hiding this comment

github-actions bot Sep 12, 2024

Choose a reason for hiding this comment

github-actions bot Sep 12, 2024

Choose a reason for hiding this comment

github-actions bot Sep 12, 2024

Choose a reason for hiding this comment

github-actions bot Sep 12, 2024

Choose a reason for hiding this comment

Choose a reason for hiding this comment

mmutic commented Aug 5, 2024 •

edited

Loading

	write_output_file(joinpath(path, setup["WriteResultsNamesDict"]["energy_revenue"]),
	dfEnergyRevenue,
	filetype = setup["ResultsFileType"],

	dftranspose(dfPlantFuel_TS, true), filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])

	dfNse,
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])

	#= if setup["OutputFullTimeSeries"] == 1 && setup["TimeDomainReduction"] == 1
	write_full_time_series_reconstruction(path, setup, dfNse, "nse")
	@info("Writing Full Time Series for NSE")
	end=#

	write_output_file(fullpath, dfOut,
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])

	write_output_file(joinpath(output_path, "$name"),
	dfOut_full,
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])

	if filetype == ".csv"
	save_with_duckdb(file,path,"csv","none")

	dftranspose(dfPrice, true),
	filetype = setup["ResultsFileType"],

	dftranspose(dfReliability, true),
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])

	dfStatus,
	filetype = setup["ResultsFileType"],
	compression = setup["ResultsCompressionType"])