nwm_eval.fetch_data

Module for fetching forecast and observation data based on the provided configuration.

Functions:

• get_fcst_info: Get the forecast window size, time step, and reference time for a given NWM configuration.

• check_existing_obs_data: Check existing parquet files of USGS observations and get the dates for previously downloaded data.

• check_missing_obs_data: Check for missing observation data in the specified directory.

• safe_fetch_usgs: Fetch USGS streamflow data for a list of gage IDs and a date range, and save to parquet files.

• get_txdot_gage_list: Get the list of gage IDs for retrieving TxDOT streamflow observations.

• process_txdot_data: Process raw TxDOT streamflow data for a specific gage ID.

• fetch_txdot_gage_data: Fetch streamflow data for a list of TxDOT gage IDs and a date range, and resample temporally as needed.

• retrieve_usgs_obs: Retrieve USGS streamflow observations given configuration and a list of gage IDs.

• get_fcst_files: Get the list of forecast files for a given dataset.

• retrieve_fcsts_ngencerf: Retrieve NWM forecasts given the configurations and list of locations from the ngenCERF data source.

• retrieve_fcsts_gcs: Retrieve NWM forecasts from Google Cloud Storage based on the provided configuration and list of locations.

• retrieve_fcsts: Retrieve NWM forecast data for the specified locations and configuration.

• get_obs_files: Get the list of existing observation files.

• read_obs_data: Read observation data from a list of file paths (in csv or parquet format) and concatenate them into a single DataFrame.

Functions

check_existing_obs_data	Check existing parquet files of usgs obs and get the dates for previously downloaded data.
check_missing_obs_data	Check for missing observation data in the specified directory.
extract_flow_for_gages	Extract time and flow for specific gages from a NetCDF file.
fetch_txdot_gage_data	Fetch streamflow data for a list of TxDOT gage IDs and a date range, and resample temporally as needed.
get_fcst_files	Get the list of forecast files for a given dataset.
get_fcst_info	Get the forecast window size, time step, and reference time for a given NWM configuration.
get_gage_agency	Get the agency for each gage ID based on the crosswalk file.
get_obs_files	Get the list of existing observation files.
get_txdot_gage_list	Get the list of gage IDs for retrieving TxDOT streamflow observations.
process_txdot_data	Process raw TxDOT streamflow data for a specific gage ID.
read_obs_data	Read observation data from a list of file paths (in csv or parquet format) and concatenate them into a single DataFrame.
retrieve_fcsts	Retrieve NWM forecast data for the specified locations and configuration.
retrieve_fcsts_gcs	Retrieve NWM forecasts given the configurations and list of locations from Google Cloud Storage.
retrieve_fcsts_ngencerf	Retrieve NWM forecasts given the configurations and list of locations from the ngenCERF data source.
retrieve_ngen_simulation	Retrieve NGEN simulation data for the specified configuration.
retrieve_usgs_obs	Retrieve USGS streamflow observations given configuration and a list of gage IDs.
safe_fetch_usgs	Fetch USGS streamflow data for a list of gage IDs and a date range, and save to parquet files.