Leonardo Crauss Daronco
af87bc2d3f
Merge remote-tracking branch 'upstream/master' into v1.1.0-rap-on-resque
2017-10-09 16:37:28 -03:00
Leonardo Crauss Daronco
0b662c5342
Fix call to resque's "prune_dead_workers" on rap workers
2017-08-15 12:10:34 -03:00
Leonardo Crauss Daronco
aa8a7818a9
Remove stale workers when starting a rap worker
...
A simple but effective way of garbage collection.
See:
http://www.rubydoc.info/github/resque/resque/Resque%2FWorker:prune_dead_workers
2017-08-11 17:32:42 -03:00
Leonardo Crauss Daronco
2a253cf3bd
Schedule the next rec step in the base worker
2017-08-09 11:52:52 -03:00
Leonardo Crauss Daronco
50e02ad7dc
Specify the sequence of rec steps in the props file
...
Removed from the code, now it can be specified in the properties file.
Makes it easier to include new processing scripts and control dependencies
between them.
2017-08-07 18:08:17 -03:00
Leonardo Crauss Daronco
076da25a7b
Let exceptions be raised on rap resque workers
...
Let the exceptions be raised so that the job will be put in a "failed"
queue with all information needed.
2017-07-13 14:36:46 -03:00
Leonardo Crauss Daronco
0252604b16
Add systemd scripts for rap workers on redis
2017-07-13 14:36:45 -03:00
Leonardo Crauss Daronco
13623e96fa
Use a hash to pass options to rap workers, makes it easier to extend
...
With a hash it's easier for customizations to pass new parameters and
even create new types of workers.
2017-07-13 14:36:45 -03:00
Leonardo Crauss Daronco
5488cba3dd
Run a different worker for each rap processing format available
...
Was running all formats inside a single worker, now there is a worker for
each processing script. Each will trigger its own publish worker when
done.
2017-07-13 14:36:44 -03:00
Leonardo Crauss Daronco
27cadca49a
Use recording status files for info only, not as triggers
...
With resque workers we don't need to use status files to trigger each
step of the recording process. So instead of using status files as triggers
they are not used only for information, so that the workers can know if
a e.g. processing script failed or succeeded.
2017-07-13 14:36:44 -03:00
Leonardo Crauss Daronco
1320fcb900
Move common rap functionality to a base class
...
Moved all workers to a common directory, inheriting from a common base
class that has all common methods used by all workers.
2017-07-13 14:36:44 -03:00
