- JOSS review changes
- Reduce stringency of dependencies
- Update dependencies
- Ensure datetime parsing can handle seconds
- Support Python 3.11 and add to CI testing
- Update dependencies
- Relicense
nemseer
under GPL3 and documentation under CC BY
- Version bump for Zenodo DOI
- Fix
attrs
dependency version
Minor fixes:
- Fix logging to use
nemseer
logger, not root logger - Suppress pandas Future Warning
- Where they exist, drop intervention periods when converting to xarray and provide user with warning
- Links to examples in all functions in Core Functionality of documentation
- Detailed example of P5MIN demand forecast errors for 2021
- Various bug fixes from beta testing
- Selective conversion of CSV to parquet
- Correctly implement intervening date generation for filename generation
- Example tidied up
- Seconds can now be supplied in datetime inputs (as long as they are
00
)
- Implement `processed_cache
- Update documentation
- Compile data to xarray Dataset
- Smarter
download_raw_data
function
- Additional downcasting in conversion to parquet to reduce memory/file size
- Update glossary with PD/STPASA run types
- Additional info in quick start
- Fix bug where data was mapped to enumerated table name
- Remove duplicate rows when compiling
- Implement data compilation to pandas DataFrame
- Add forecast-specific datetime validation to DataCompiler
- Handle invalid/corrupted files during compilation
- Add runtime generators
- Expand testing for new functionality
- Move constants to data module
- Expand glossary and update README, API and quick start pages in docs
- Improve docs, including addition of glossary
- Implement invalid/corrupt file handler for raw data downloading
- Expand testing, including testing all to check zip content exits for all possible URLs
- Add hidden file handler for corrupted CSV/zips from NEMWeb
- Improve doc referencing
- Rename
forecast_start/end
torun_start/end
- Add forecast-type datetime validation and corresponding testing
- Patch for functionality in v0.3.0
- Refactor
downloader
to reduce redundant code
- Handle PREDISP_ALL_DATA (complete pre dispatch data for each month)
- Associated testing
- Update to docs
- Bug fix for Windows (PermissionError)
- Switch date format to
yyyy/mm/dd HH:MM
for consistency with NEMOSIS and AEMO date format - Rename
Loader
toQuery
- Lazy parquet conversion
- More testing, including doctesting of examples in Quick Start section of docs
- More sophisticated handling of raw data in
raw_cache
:- Check whether query data exists in
raw_cache
prior to downloading data - Progress bar for downloads
- Cache data as parquet, with select columns parsed as datetime or category
- Check whether query data exists in
- Code base reorganised to facilitate function reuse
- First release of
nemseer
!- User feedback regarding available tables
- Basic user input validation
- Download and unzip files based on query