|
| 1 | +# Changelog for Data Transloader |
| 2 | + |
| 3 | +## Version 0.5.0 (2019-07-26) |
| 4 | + |
| 5 | +The "HTTP and Ontology" Refactoring Release |
| 6 | + |
| 7 | +* Create HTTP wrapper to abstract away `net/http` from all the other classes |
| 8 | +* Add Vagrantfile for starting a VM with FROST for testing |
| 9 | +* Improve compatibility with HTTPS connections |
| 10 | +* Add a User-Agent for the crawler |
| 11 | +* Replace command line interface with better option parser-based command line interface |
| 12 | +* Add validation checks for command line options |
| 13 | +* Support uploading observations for a time interval instead of a single timestamp |
| 14 | +* RENAME command line options to be closer to their usage in the station classes |
| 15 | +* Use `time` instead of `date`/`datetime` in Ruby |
| 16 | +* Add RDF Ontology file for clearly mapping observed properties from data providers to a standard vocabulary that can be re-used in SensorThings API |
| 17 | +* Import known properties from the providers into the Ontology. Some properties that have not been downloaded in testing may be missing. |
| 18 | +* Add Ontology mappings for Units of Measurement |
| 19 | +* Add Ontology mappings for observation types |
| 20 | +* Move provider-specific classes to subdirectories to clean up parent directory |
| 21 | +* Add allow/block feature for controlling what data/metadata is uploaded to SensorThings API |
| 22 | + |
| 23 | +## Version 0.4.0 (2019-07-12) |
| 24 | + |
| 25 | +The "RSpec" Refactoring Release |
| 26 | + |
| 27 | +* Clean up how station classes are instantiated with `get_station` and `new_station` |
| 28 | +* Refactor the provider class interface to use `get` and `new` terms |
| 29 | +* Improve usage of Ruby named keyword parameters for methods |
| 30 | +* Add some documentation for metadata mapping procedure |
| 31 | +* Fix broken Environment Canada integration due to new station list format (their change) |
| 32 | +* Fix URL used for Data Garrison metadata to prevent bug where metadata was missed |
| 33 | +* Add support for PUT requests to SensorThings API (usage only needed for some STA implementations) |
| 34 | +* Fix wrong URL being cached due to body/header mismatch coming back from STA (GOST) |
| 35 | +* Switch from testing with GOST to SensorUp Scratchpad for better STA support |
| 36 | +* Use RSpec and VCR for integration testing station download/upload |
| 37 | +* Standardize on symbolized keys in station classes to prevent bug where JSON deserialization would create string keys instead |
| 38 | +* Add `semantic_logger` gem for improved logging output |
| 39 | +* Switch from SensorUp Scratchpad to local FROST server for easier resets of testing data |
| 40 | +* Issue another GET request for entity's true selfLink as some STA implementations (FROST) do not include a created entity in the response body |
| 41 | +* Replace calls to `exit` with `raise` to not cause mysterious RSpec failures |
| 42 | +* Fix for `$filter` usage where dates should not be quoted (FROST) |
| 43 | +* Improve reliability of Campbell Scientific download/upload |
| 44 | +* Standardize date format used for specifying uploads |
| 45 | +* Change Campbell Scientific classes to only upload latest observation like the other providers instead of uploading all observations |
| 46 | + |
| 47 | +## Version 0.3.0 (2019-03-07) |
| 48 | + |
| 49 | +The "Campbell Scientific" Support Release |
| 50 | + |
| 51 | +* Move the SensorThings API library to its own directory |
| 52 | +* Support download for Campbell Scientific data |
| 53 | +* Support downloading from specified CSV files for Campbell Scientific |
| 54 | +* Automatically merge downloaded Campbell Scientific data into local cache |
| 55 | +* Support HTTP partial downloads for Campbell Scientific CSV files |
| 56 | +* Increase upload timeouts for long uploads to SensorThings API |
| 57 | +* Support STA upload for Campbell Scientific |
| 58 | +* Fix timezone storage in local cache files |
| 59 | + |
| 60 | +## Version 0.2.0 (2019-02-28) |
| 61 | + |
| 62 | +The "Data Garrison" Support Release |
| 63 | + |
| 64 | +* Support download from Data Garrison data |
| 65 | +* Add warnings for manual data correction requirement |
| 66 | +* Support STA upload for Data Garrison |
| 67 | + |
| 68 | +## Version 0.1.0 (2018-05-09) |
| 69 | + |
| 70 | +The Initial "Environment Canada" Support Release |
| 71 | + |
| 72 | +* Download Environment Canada weather data to cache files |
| 73 | +* Create script to parse command line arguments |
| 74 | +* Download Environment Canada station metadata to cache file |
| 75 | +* Create sub-directories for data, metadata cache |
| 76 | +* Create STA entities from metadata, upload to STA |
| 77 | +* Re-use existing STA entities, if possible |
| 78 | +* Build internal SensorThings API Ruby library |
0 commit comments