ginnoir/homelabstack
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat(romhacks): arm downloads (DRY_RUN=false) + fix dry-run state burn

Browse Source 
process_file now marks messages processed only after a real crawljob write, so
DRY_RUN no longer poisons the state and link-less posts get re-checked after the
host filter widens. State file reset alongside this so the arm cycle re-enqueues
all threads.
This commit is contained in:
ginnoir
2026-06-07 19:55:00 -05:00
parent 4fda9a3b3e
commit 328b5df776
2 changed files with 11 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files
stacks/romhacks/stack.env
+1 -1
View File
@@ -16,7 +16,7 @@ GUILD_ID=1474050123347525652
# DRY_RUN=true => export, parse, and stage metadata, but DO NOT enqueue any
# downloads. Inspect /storage1/labdata/romhacks/metadata first.
# DRY_RUN=false => write .crawljob files so JDownloader starts fetching.
DRY_RUN=true
DRY_RUN=false
# Seconds between harvest cycles (21600 = 6h).
POLL_INTERVAL=21600
# JDownloader in-container download root (maps to /storage1/labdata/romhacks/incoming).