Collect server logs from:
- v4 (Apache) at /var/log/apache2 (access.log*)
- v5 (OC4D) at /var/log/oc4d (oc4d-.log, capecoastcastle-.log, *.gz; excludes *exceptions*)
- v3 (D-Hub) at /var/log/dhub (*.log)
- v6 (Server v6) at /var/log/oc4d (v6-_.log; excludes *exceptions*)
Outputs
- Creates a run folder in 00_DATA named LOCATION_logs_YYYY_MM_DD and copies relevant files there
- Decompresses any .gz files in-place
- Skips exception logs (e.g., oc4d-exceptions-*.log) to avoid noise
Usage
- Run the menu: scripts/data/collection/main.sh
- To collect directly: scripts/data/collection/all.sh
Inner workings
- The script prompts for server type (v4, v5, v3, or v6) and device location (used in the folder name)
- v4 copies files matching access.log* from /var/log/apache2
- v5 copies:
- oc4d-.log (excluding oc4d-exceptions-.log)
- capecoastcastle-.log (excluding capecoastcastle-exceptions-.log)
- any *.gz files
- v3 copies *.log files from /var/log/dhub
- v6 copies v6-.log files (excluding v6-exceptions-.log) from /var/log/oc4d
- After copying, .gz files are decompressed so processors can read plain text
- The resulting folder is moved into 00_DATA for the processing stage