ChangeLog for greater-pre-processing module - usf branch

2006-10-02  Frank Koormann     <frank.koormann@intevation.de>

	* awk/generateAttTables.awk (scanBifurcations): Bugfix for #5180:
	Index count error on bifurcations array fixed.

2006-04-05  Frank Koormann     <frank.koormann@intevation.de>

	* upload-catchment.py (do_upload): Bugfix stretch upload, name field 
	was filled with vol_val instead of name.

2006-03-20  Frank Koormann     <frank.koormann@intevation.de>

	Improved upload

	* upload-catchment.py (catchment_desc): Improved robustness for blank
	lines in catchment.desc.

	* samples/itter/catchment.desc: Added entries for upload.

	* samples/itter/upload.list: New, sample file for upload.

2005-07-10  Frank Koormann     <frank.koormann@intevation.de>

	Add (lake) volume to the preprocessing

	* greater-pre-processing.py (do_run): Add volume columns (txt2dbf cmd).
	(do_check): .lks-file must have three columns now.

	* awk/generateAttTables.awk (writeRiverAtt): Add volume for mode 2
	(main): Enhance .lks-file to three columns

	* add-downsegments.py (add_downsegments): Add volume columns.

	* upload-catchment.py (do_upload): Added vol_val and vol_dist,
	including conversion from 5-Percentile to stdDev-Representation.

	* insert-stretch_att.py (do_insert): Added vol_val and vol_dist,
	including conversion from 5-Percentile to stdDev-Representation.

	* doc/theory.tex, doc/flow.final.att.fig: Added .lks file
	(was missed so far).

	* doc/sourcefiles.tex, doc/resultfiles.tex: Added volume columns
	to format description.

	* doc/greater-preprocessing-manual.tex: 
	Emphasize USF version of GREAT-ER.
 

2005-07-10  Frank Koormann     <frank.koormann@intevation.de>

	* branched for usf

2005-07-10  Frank Koormann     <frank.koormann@intevation.de>

	* greater-pre-processing.py: General improvements:
	- Correct handling of empty lines (to be ignored)
	- Drop dependency on env var $(GREATER_PRE_PROC). The 
	  path to the the preprocessing an the AWK scripts is 
	  estimated from sys.argv[0]. 

2005-07-10  Frank Koormann     <frank.koormann@intevation.de>

	* insert-stretch_att.py: Fixed version string

2005-06-02  Frank Koormann     <frank.koormann@intevation.de>

	* upload-catchment.py: Include insert-disch and insert-stretch 
	into the tool.

2005-03-23  Jan-Oliver Wagner     <jan@intevation.de>

	* doc/greater-preprocessing-manual.tex: Added CVSId and
	fixed python version requirement (2.2.1 instead of 2.0).

2005-02-21  Frank Koormann     <frank.koormann@intevation.de>

	* upload-catchment.py: Added catchment ID handling
	
	* insert-disch_att.py (do_insert): Fixed dbinfo handling

	* insert-stretch_att.py (do_insert): Fixed dbinfo handling,
	bug in type processing

2004-12-21  Frank Koormann     <frank.koormann@intevation.de>

	* greater-pre-processing.py (do_run()):
	Topology analysis: For large catchments the join must be called
	explicitly with "data sorted numerically"-flag
	Use GREATER_PRE_PROC-path for add-downsegments command
 
2004-03-22  Frank Koormann     <frank.koormann@intevation.de>

	* insert-disch_att.py insert-stretch_att.py: 
	Insert data directly using GREAT-ER DB API. 

2003-12-12  Frank Koormann     <frank.koormann@intevation.de>

	* upload-catchment.py: Get catchment id from database.

2003-12-02  Frank Koormann     <frank.koormann@intevation.de>

	* greater-pre-processing.py (do_run(), attribute file generation):
	Fix bug in topology analysis: From/To relations have to be sorted
	numerical.

	* insert-disch_att.py, insert-stretch_att.py: 
	Added database backend as a new command line option.

	* upload-catchment.py: New, tool for catchment processors to upload
	data.

2003-11-03  Jan-Oliver Wagner  <jan@intevation.de>

	* catchment.thuban: Updated to use DTD of Thuban 0.9. Also added
	joined tables for discharge and river attributes.

2003-10-09  Jan-Oliver Wagner  <jan@intevation.de>

	* greater-pre-processing.py (do_check): Added semantic check
	for consistent occurance of StretchID in .rna and .drn.

2003-10-06  Frank Koormann     <frank.koormann@intevation.de>

	* doc/Makefile: Added extended image pre-processing for pdf.

2003-09-29  Jan-Oliver Wagner  <jan@intevation.de>

	* doc/sourcefiles.tex: Pictures: clarified that only jpg-format
	is supported.

	* Howto.txt, doc/howto.tex: required Python version changed
	from 2.0 to 2.2.1.

2003-07-18  Thomas Koester  <tkoester@intevation.de>

	* doc/greater-preprocessing-manual.tex: Use twoside printing with
	binding correction of 19mm. Added fancy headers/footers for even pages.

2003-07-17  Jan-Oliver Wagner  <jan@intevation.de>

	* greater-pre-processing.py: upped version to 1.2.0.
	Now backgroundlst.dbf is only created for OUT-VERSION == 1.0.

2003-07-17  Jan-Oliver Wagner  <jan@intevation.de>

	Final rework of the documentation for release 1.2.0.

	* doc/greater-preprocessing-manual.tex: updated to 1.2.0, changed
	titlepage and other minor stuff. Use lastpage package.

	* doc/howto.tex: small fixes, updated to 1.2.0.

	* doc/gnufdl.tex: updated to V1.2 of the license. Removed
	lastpage label. Added documentID.

	* doc/theory.tex: Added documentID.

	* doc/resultfiles.tex: Added documentID. Filled empty tables.
	Some more hints regarding GREAT-ER versions.

	* doc/sourcefiles.tex: Added documentID. Hint for background data. 

	* doc/images/intevation-logo.eps: New.

	* doc/Makefile: Added very_clean.

2003-06-23  Jan-Oliver Wagner  <jan@intevation.de>

	Added a sample catchment.
	New command line option 'clean' to remove all temporary and
	result files.

	* samples/: New.

	* samples/itter/: New.

	* samples/itter/ itter.bgd,itter.drn,itter.lks,itter.rna,itter.cbp,
	  itter.dsd,itter.pic,catchment.desc: Itter catchment source files.

	* greater-pre-processing.py (usage_str, usage): added clean
	(do_run): added hint that circle-analysis can only be done for
	OUT-VERSION >= 2.0
	(do_clean): New.
	
2003-05-20  Jan-Oliver Wagner  <jan@intevation.de>

	Added check for circles in the topology.
	Added a unit test framework for the source code.

	* test/README, test/runtests.py, test/test_support.py: New.
	Environment for unit tests.

	* support.py: New. Support functions for pre-processing.

	* greater-pre-processing.py (do_run): Added check for circles
	in the rivernet topology.

2003-05-20  Frank Koormann <frank.koormann@intevation.de>

	* insert-disch_att.py: 
	Fixed handling of single quotation marks in names.

	* insert-stretch_att.py:
	Fixed handling of single quotation marks in names.

2003-05-20  Jan-Oliver Wagner  <jan@intevation.de>

	* Changes.txt: Added a sample command to perform the change easily

2003-05-02  Frank Koormann <frank.koormann@intevation.de>

	* insert-stretch_att.py: Fixed typo in INSERT statement

	* doc/howto.tex: Extended section on GREAT-ER II upload.

2003-05-02  Frank Koormann <frank.koormann@intevation.de>

	Added scripts to convert GREAT-ER I tables (disch.att, river.att)
	into SQL insert statements for GREAT-ER II

	* insert-disch_att.py: New, convert disch.att into SQL 
	insert statements for GREAT-ER II. It is assumed that no distribution 
	information is available for the flow, i.e flow_dist = 0.

	* insert-stretch_att.py: New, convert stretch.att into SQL 
	insert statements for GREAT-ER II. The script also performs the
	conversion from the (mean, 5-percentile) lognormal representation
	used in GREAT-ER I to the standard (mean, stddev).
 
2003-04-14  Jan-Oliver Wagner  <jan@intevation.de>

	Added a treatment for Lakes for GREAT-ER 2.0. Basically
	the Stretch-Type is increased by 8 in case the segment is a lake.
	This resolves https://intevation.de/rt/webrt?serial_num=1779.

	* doc/Makefile: Added resultfiles to the dependencies of the manual.

	* doc/theory.tex (table on Segment Types): Added hint on
	Lake-Types.

	* doc/resultfiles.tex: Added initial description of all tables.

	* doc/sourcefiles.tex (\section{River Network Attributes, File 'ID.rna'}): 
	Added hint on interpretation of RealLength for Lakes (-> Volume).

	* doc/howto.tex: Started section on data integration into GREAT-ER 1.0
	and GREAT-ER 2.0.

	* awk/generateAttTables.awk (writeRiverAtt): Use LAKE_CLASS instead
	of fixed value 2. Move determination whether it is a lake
	early in the procedure. Increase stretch_type by 8 in case
	it is a lake and OUTVERSION == 2.0.
	(writeRiverClassTab): Use LAKE_CLASS instead of fixed value 2.
	(BEGIN): Introduce LAKE_CLASS.

	* greater-pre-processing.py (version_str): upped version to cvs.
	(version_str): added option run-without-cleanup.
	(catchment_desc): turned comment into doc-string.
	(do_run): pass value of OUT-VERSION to awk-skript as OUTVERSION.
	Print usage when no catchment description file is found,
	resolves https://intevation.de/rt/webrt?serial_num=1791.

2003-02-11  Jan-Oliver Wagner  <jan@intevation.de>

	* doc/theory.tex: fixed various references.

2003-02-11  Jan-Oliver Wagner  <jan@intevation.de>

	* doc/sourcefiles.tex: removed a wrong sentence.

2003-02-05  Jan-Oliver Wagner  <jan@intevation.de>

	* add-downsegments.py: New.

	* greater-pre-processing.py: Added OUT-VERSION 2.0: this adds
	downstream segments to the result file river.dbf
	Upped version to 1.1.0.

	* doc/howto.tex: updated version.

	* doc/resultfiles.tex: New.

	* doc/greater-preprocessing-manual.tex: Added resultsfiles.tex,
	upped version.

2003-02-05  Jan-Oliver Wagner  <jan@intevation.de>

	* greater-pre-processing.py: Changed indenting
	from tab to spaces. Introduces IN-VERSION to substitute VERSION and
	added OUT-VERSION.

	* doc/sourcefiles.tex: add IN-/OUT-VERSION,
	add hint on IN-VERSION = 1.0 for all source files

	* doc/howto.tex: updated according to new
	catchment.desc.

	* doc/greater-preprocessing-manual.tex: upped version.

2002-09-26  Jan-Oliver Wagner  <jan@intevation.de>

	* awk/topology.awk: replaced numeric comparison by
	string comparison to avoid rounding errors

	* greater-pre-processing.py: Add "PS" as allowed WWTP Type

	* awk/generateAttTables.awk: Added handling of "PS" WWTP Type
	(mapped to ID=10 in the wwtp.dbf)

2002-09-24  Jan-Oliver Wagner  <jan@intevation.de>

	* greater-pre-processing.py: upped version to 1.0.3cvs

	* doc/Makefile: added .bak to the clean-up files

2002-09-24  Jan-Oliver Wagner  <jan@intevation.de>

	* greater-pre-processing.py: Added option run-without-cleanup
	which leaves all temporary files in place.
	(do_run): Fixed an ugly bug for issuing the command sort.
	sort failed when LC_COLLATE was not set to "C". On non-english
	installations the processing failed.
	set version to 1.0.3.

	* Howto.txt: refined dependencies

	* doc/howto.tex: refined dependencies

	* doc/flow.final.geo.fig: removed catchment boundary name processing

	* doc/flow.final.att.fig: added catchment boundary name processing

	* doc/theory.tex: removed ArcView reference

2002-09-18  Jan-Oliver Wagner  <jan@intevation.de>

	* doc: Added a full manual that describes the pre-processing.

2002-07-22  Jan-Oliver Wagner  <jan@intevation.de>

	* greater-pre-processing.py: Version now 1.0.2
	* greater-pre-processing.py (do_run): Added creation of file
	backgroundlst.dbf
	* started ChangeLog