ChangeLog for greater-pre-processing module - usf branch 2009-04-09 Nina Hueffmeyer * The table 'stretch_tab' has two new attributes: 'agriculture' and 'natural_soil' which can be used to calculate diffuse input into rivers via surface runoff. 2009-03-09 Nina Hueffmeyer * The table 'disch_class_tab' is no longer required for the WWTP module. All entries refering to the table are removed. 2009-03-01 Nina Hueffmeyer * Added the industrial roof area as a field to the discharges and the session discharges. 2009-02-11 Nina Hueffmeyer * The new diffuse emission source 'groundwater infiltration' requires the new stretch attribute 'baseflow'. 2009-02-10 Nina Hueffmeyer * The following new parameters were added to the WWTPs: srt, mlss, vol_vk, vol_bb, type The following parameters were removed from disch and the sess_disch: dwf, flow_dom, flow_nondom, flow_runoff, r_wwtp 2009-02-09 Nina Hueffmeyer * Added the WWTP parameter 'vol_sewer' for the sewer mode 2. 2009-01-26 Nina Hueffmeyer * The WWTP parameter 'treated' has been renamed to 'f_mix' for better understanding. 2009-01-16 Nina Hueffmeyer * The WWTP parameter 'PAVED_SURFACE' can be replaced in the session discharge data. 2009-01-16 Nina Hueffmeyer * The substance parameter 'DEFAULT_SURFACEPOTENTIAL' can be replaced in the market data by the parameter 'SURFACE_POTENTIAL'. 2009-01-16 Nina Hueffmeyer * For the new emission mode 2, the WWTPs now require the parameter 'paved_surface'. In the substance's parameter set, 'DEFAULT_SURFACEPOTENTIAL' has been added. 2006-04-12 Nina Hüffmeyer Zinc project: Added emission pathways for roof and street runoff * dagreater/apispec.py: added fields 'roof', 'roof_roofrunoff' and 'street', 'street_runoff' to be queried from the db for discharge objects * impl/postgresql/dagreater_pg.h: insert new fiels in all the structs * impl/postgresql/datypes_pg.h: insert new fiels in all the structs * impl/postgresql/gdagreater_pg.pgc: insert new fields in queries 2005-08-16 Frank Koormann Update of USF GREAT-ER-DB Interface to HEAD branch progress * dagreater/apispec.py: Added DBInsertFunctions for da_insert_disch and da_insert_stretch * impl/postgresql/gdagreater_pg.pgc: Code cleanup: File covered a bunch of "unused" variables. Commented out where possible, v_module references wrapped with pre-processor clauses. (gda_insert_disch, gda_insert_stretch): Explicit host variables in INSERT statements. The former implicit statement (e.g. " VALUES (:h_stretch)") caused an error 201: Too many parameters (returned by the server). * impl/postgresql/dagreater_pg.pgc: Code cleanup: File covered a bunch of "unused" variables. Commented out where possible, v_module references wrapped with pre-processor clauses. * README: Fixed option: --wrapper-with-debug-output 2005-07-10 Frank Koormann Add (lake) volume to the preprocessing * greater-pre-processing.py (do_run): Add volume columns (txt2dbf cmd). (do_check): .lks-file must have three columns now. * awk/generateAttTables.awk (writeRiverAtt): Add volume for mode 2 (main): Enhance .lks-file to three columns * add-downsegments.py (add_downsegments): Add volume columns. * upload-catchment.py (do_upload): Added vol_val and vol_dist, including conversion from 5-Percentile to stdDev-Representation. * insert-stretch_att.py (do_insert): Added vol_val and vol_dist, including conversion from 5-Percentile to stdDev-Representation. * doc/theory.tex, doc/flow.final.att.fig: Added .lks file (was missed so far). * doc/sourcefiles.tex, doc/resultfiles.tex: Added volume columns to format description. * doc/greater-preprocessing-manual.tex: Emphasize USF version of GREAT-ER. 2005-07-10 Frank Koormann * branched for usf 2005-07-10 Frank Koormann * greater-pre-processing.py: General improvements: - Correct handling of empty lines (to be ignored) - Drop dependency on env var $(GREATER_PRE_PROC). The path to the the preprocessing an the AWK scripts is estimated from sys.argv[0]. 2005-07-10 Frank Koormann * insert-stretch_att.py: Fixed version string 2005-06-02 Frank Koormann * upload-catchment.py: Include insert-disch and insert-stretch into the tool. 2005-03-23 Jan-Oliver Wagner * doc/greater-preprocessing-manual.tex: Added CVSId and fixed python version requirement (2.2.1 instead of 2.0). 2005-02-21 Frank Koormann * upload-catchment.py: Added catchment ID handling 2004-10-28 Frank Koormann * insert-disch_att.py (do_insert): Fixed dbinfo handling * insert-stretch_att.py (do_insert): Fixed dbinfo handling, bug in type processing 2004-12-21 Frank Koormann * greater-pre-processing.py (do_run()): Topology analysis: For large catchments the join must be called explicitly with "data sorted numerically"-flag Use GREATER_PRE_PROC-path for add-downsegments command 2004-03-22 Frank Koormann * insert-disch_att.py insert-stretch_att.py: Insert data directly using GREAT-ER DB API. 2003-12-12 Frank Koormann * upload-catchment.py: Get catchment id from database. 2003-12-02 Frank Koormann * greater-pre-processing.py (do_run(), attribute file generation): Fix bug in topology analysis: From/To relations have to be sorted numerical. * insert-disch_att.py, insert-stretch_att.py: Added database backend as a new command line option. * upload-catchment.py: New, tool for catchment processors to upload data. 2003-11-03 Jan-Oliver Wagner * catchment.thuban: Updated to use DTD of Thuban 0.9. Also added joined tables for discharge and river attributes. 2003-10-09 Jan-Oliver Wagner * greater-pre-processing.py (do_check): Added semantic check for consistent occurance of StretchID in .rna and .drn. 2003-10-06 Frank Koormann * doc/Makefile: Added extended image pre-processing for pdf. 2003-09-29 Jan-Oliver Wagner * doc/sourcefiles.tex: Pictures: clarified that only jpg-format is supported. * Howto.txt, doc/howto.tex: required Python version changed from 2.0 to 2.2.1. 2003-07-18 Thomas Koester * doc/greater-preprocessing-manual.tex: Use twoside printing with binding correction of 19mm. Added fancy headers/footers for even pages. 2003-07-17 Jan-Oliver Wagner * greater-pre-processing.py: upped version to 1.2.0. Now backgroundlst.dbf is only created for OUT-VERSION == 1.0. 2003-07-17 Jan-Oliver Wagner Final rework of the documentation for release 1.2.0. * doc/greater-preprocessing-manual.tex: updated to 1.2.0, changed titlepage and other minor stuff. Use lastpage package. * doc/howto.tex: small fixes, updated to 1.2.0. * doc/gnufdl.tex: updated to V1.2 of the license. Removed lastpage label. Added documentID. * doc/theory.tex: Added documentID. * doc/resultfiles.tex: Added documentID. Filled empty tables. Some more hints regarding GREAT-ER versions. * doc/sourcefiles.tex: Added documentID. Hint for background data. * doc/images/intevation-logo.eps: New. * doc/Makefile: Added very_clean. 2003-06-23 Jan-Oliver Wagner Added a sample catchment. New command line option 'clean' to remove all temporary and result files. * samples/: New. * samples/itter/: New. * samples/itter/ itter.bgd,itter.drn,itter.lks,itter.rna,itter.cbp, itter.dsd,itter.pic,catchment.desc: Itter catchment source files. * greater-pre-processing.py (usage_str, usage): added clean (do_run): added hint that circle-analysis can only be done for OUT-VERSION >= 2.0 (do_clean): New. 2003-05-20 Jan-Oliver Wagner Added check for circles in the topology. Added a unit test framework for the source code. * test/README, test/runtests.py, test/test_support.py: New. Environment for unit tests. * support.py: New. Support functions for pre-processing. * greater-pre-processing.py (do_run): Added check for circles in the rivernet topology. 2003-05-20 Frank Koormann * insert-disch_att.py: Fixed handling of single quotation marks in names. * insert-stretch_att.py: Fixed handling of single quotation marks in names. 2003-05-20 Jan-Oliver Wagner * Changes.txt: Added a sample command to perform the change easily 2003-05-02 Frank Koormann * insert-stretch_att.py: Fixed typo in INSERT statement * doc/howto.tex: Extended section on GREAT-ER II upload. 2003-05-02 Frank Koormann Added scripts to convert GREAT-ER I tables (disch.att, river.att) into SQL insert statements for GREAT-ER II * insert-disch_att.py: New, convert disch.att into SQL insert statements for GREAT-ER II. It is assumed that no distribution information is available for the flow, i.e flow_dist = 0. * insert-stretch_att.py: New, convert stretch.att into SQL insert statements for GREAT-ER II. The script also performs the conversion from the (mean, 5-percentile) lognormal representation used in GREAT-ER I to the standard (mean, stddev). 2003-04-14 Jan-Oliver Wagner Added a treatment for Lakes for GREAT-ER 2.0. Basically the Stretch-Type is increased by 8 in case the segment is a lake. This resolves https://intevation.de/rt/webrt?serial_num=1779. * doc/Makefile: Added resultfiles to the dependencies of the manual. * doc/theory.tex (table on Segment Types): Added hint on Lake-Types. * doc/resultfiles.tex: Added initial description of all tables. * doc/sourcefiles.tex (\section{River Network Attributes, File 'ID.rna'}): Added hint on interpretation of RealLength for Lakes (-> Volume). * doc/howto.tex: Started section on data integration into GREAT-ER 1.0 and GREAT-ER 2.0. * awk/generateAttTables.awk (writeRiverAtt): Use LAKE_CLASS instead of fixed value 2. Move determination whether it is a lake early in the procedure. Increase stretch_type by 8 in case it is a lake and OUTVERSION == 2.0. (writeRiverClassTab): Use LAKE_CLASS instead of fixed value 2. (BEGIN): Introduce LAKE_CLASS. * greater-pre-processing.py (version_str): upped version to cvs. (version_str): added option run-without-cleanup. (catchment_desc): turned comment into doc-string. (do_run): pass value of OUT-VERSION to awk-skript as OUTVERSION. Print usage when no catchment description file is found, resolves https://intevation.de/rt/webrt?serial_num=1791. 2003-02-11 Jan-Oliver Wagner * doc/theory.tex: fixed various references. 2003-02-11 Jan-Oliver Wagner * doc/sourcefiles.tex: removed a wrong sentence. 2003-02-05 Jan-Oliver Wagner * add-downsegments.py: New. * greater-pre-processing.py: Added OUT-VERSION 2.0: this adds downstream segments to the result file river.dbf Upped version to 1.1.0. * doc/howto.tex: updated version. * doc/resultfiles.tex: New. * doc/greater-preprocessing-manual.tex: Added resultsfiles.tex, upped version. 2003-02-05 Jan-Oliver Wagner * greater-pre-processing.py: Changed indenting from tab to spaces. Introduces IN-VERSION to substitute VERSION and added OUT-VERSION. * doc/sourcefiles.tex: add IN-/OUT-VERSION, add hint on IN-VERSION = 1.0 for all source files * doc/howto.tex: updated according to new catchment.desc. * doc/greater-preprocessing-manual.tex: upped version. 2002-09-26 Jan-Oliver Wagner * awk/topology.awk: replaced numeric comparison by string comparison to avoid rounding errors * greater-pre-processing.py: Add "PS" as allowed WWTP Type * awk/generateAttTables.awk: Added handling of "PS" WWTP Type (mapped to ID=10 in the wwtp.dbf) 2002-09-24 Jan-Oliver Wagner * greater-pre-processing.py: upped version to 1.0.3cvs * doc/Makefile: added .bak to the clean-up files 2002-09-24 Jan-Oliver Wagner * greater-pre-processing.py: Added option run-without-cleanup which leaves all temporary files in place. (do_run): Fixed an ugly bug for issuing the command sort. sort failed when LC_COLLATE was not set to "C". On non-english installations the processing failed. set version to 1.0.3. * Howto.txt: refined dependencies * doc/howto.tex: refined dependencies * doc/flow.final.geo.fig: removed catchment boundary name processing * doc/flow.final.att.fig: added catchment boundary name processing * doc/theory.tex: removed ArcView reference 2002-09-18 Jan-Oliver Wagner * doc: Added a full manual that describes the pre-processing. 2002-07-22 Jan-Oliver Wagner * greater-pre-processing.py: Version now 1.0.2 * greater-pre-processing.py (do_run): Added creation of file backgroundlst.dbf * started ChangeLog