Skip to content
Snippets Groups Projects
  • am0ebe's avatar
    77474fd9
    vv: Ecotrack: Add time_of_day col. Change data structure. Recalc all. See below (vv) for details! · 77474fd9
    am0ebe authored
    Change data structure:
    
    ecotrack
    	|_ in
    	|_ out
    ecolux
    	|_ in
    	|_ out
    
    > Only ever calc all blox. More finegrained analysis can be done using the block column on this table.
    > change conf.json
    > extract function temp_add_means_and_time_of_day from initTempData
    > print number of filtered temp lines
    > print number of removed tags
    > [edgecase] add NA to temp cols if close to end of configuration time window
    > typo: rm tag_info and unknown_tag files
    77474fd9
    History
    vv: Ecotrack: Add time_of_day col. Change data structure. Recalc all. See below (vv) for details!
    am0ebe authored
    Change data structure:
    
    ecotrack
    	|_ in
    	|_ out
    ecolux
    	|_ in
    	|_ out
    
    > Only ever calc all blox. More finegrained analysis can be done using the block column on this table.
    > change conf.json
    > extract function temp_add_means_and_time_of_day from initTempData
    > print number of filtered temp lines
    > print number of removed tags
    > [edgecase] add NA to temp cols if close to end of configuration time window
    > typo: rm tag_info and unknown_tag files
Code owners
Assign users and groups as approvers for specific file changes. Learn more.
readme 1.02 KiB
1. run dataSync.py
2. Choose block-configuration [or press other key for information how to modify block-configuration!]

	> looks for ".tgz" to extract [optional]
	> merges all "unit-X" files
	> merges with light, track, temperature and species data
	> writes one huge cleaned table + compressed tgz
	> runs dataFilter.py
	> writes filtered table + compressed tgz
	> runs updateGitIgnore.sh

You can also filter data independently, if you don't want to process everything again [takes quite long] or tweak some filter parameters.
Run dataFilter.py for Usage instructions. 


Optional:

get time of last tracking-event per unit:
	source getLastDates.sh
	cd block-I/01-raw
	getLastDateAllUnits

print information about known and unknown tags and detections
	unknowntags.sh ecolux/all/02-inspect

write number of unkown tags along with their occurrences to file:
	unknowntags.sh ecotrack/II/02-inspect list

print tags in tagfile which length deviate:
	checkTagLengths.sh block-II/tags2

configure repo to ignore large files:
	updateGitIgnore.sh