Daniel García Aubert
784b6dd1d0
Ignore jshint
2019-04-09 18:30:29 +02:00
Daniel García Aubert
af9303b577
Implemented script to remove old batch-api jobs
2019-04-09 18:16:01 +02:00
Daniel García Aubert
5a0e3810d4
Typo
2019-04-04 17:18:45 +02:00
Daniel García Aubert
b01ac63ed7
Do not pass callback to method close
2019-04-04 17:13:04 +02:00
Daniel García Aubert
3ed4b142c0
Improve shutdown
2019-04-04 16:44:54 +02:00
Daniel García Aubert
1905a2bd28
Please, jshint
2019-04-04 15:16:44 +02:00
Daniel García Aubert
2e2e233b68
Use 'bunyan' logger instead of 'debug' to log debug messages
2019-04-04 14:31:41 +02:00
Daniel García Aubert
87eefb9cb7
Typo
2019-04-03 18:53:58 +02:00
Daniel García Aubert
544d85310f
Typo
2019-04-03 18:50:05 +02:00
Daniel García Aubert
7f6f91fc15
Clear job from WIP while draining
2019-04-03 18:49:11 +02:00
Simon Martín
32dca8dfdb
reopenFileStreams to parent class
2018-06-18 18:47:12 +02:00
Simon Martín
1174499dcf
Merge branch 'master' into pgcopy-stream
2018-06-11 14:38:52 +02:00
Simon Martín
2bcea0484a
rename BunyanLogger to Logger
2018-06-08 10:59:34 +02:00
Eneko Lakasta
340e55ea46
reduce error info
2018-06-06 15:23:53 +02:00
Eneko Lakasta
62df0a387a
remove functionality from parseMetadataToDatabase. DB user and pass not longer needed
2018-06-05 17:58:55 +02:00
Eneko Lakasta
4993f8a956
use job configuration instead of user metadata service in test
2018-06-05 17:56:29 +02:00
Eneko Lakasta
eab3d289b6
refactor authenticated to authorizationLevel
2018-06-05 13:21:56 +02:00
Eneko Lakasta
46e3a87f41
add some auth TODOs
2018-05-30 18:15:35 +02:00
Eneko Lakasta
71de7248ba
get DB configuration from job instead from metadata in Job Canceller (again)
2018-05-30 17:38:06 +02:00
Eneko Lakasta
cf8bf6e5e6
get DB configuration from job instead from metadata in Job Canceller
2018-05-30 17:36:55 +02:00
Simon Martín
7d32ae293f
rename buyan_logger file name
2018-05-28 11:18:30 +02:00
Eneko Lakasta
681b60c27d
return error if batch job has no proper DB configuration
2018-05-25 17:25:38 +02:00
Simon Martín
fdc542f7b5
BunyanLogger
2018-05-23 17:24:48 +02:00
Daniel García Aubert
f01bfbbfd6
Fix property names to not expose user's credential info
2018-02-15 13:12:40 +01:00
Daniel García Aubert
e2b8fa9e22
Retrieve database credentials from jobs stored in redis
2018-02-15 12:31:08 +01:00
Daniel García Aubert
b81df11a56
Pass user's database credentiasl to query runner
2018-02-15 12:26:36 +01:00
Daniel García Aubert
7a3ad2b5e0
Fallback: if the jod doesn't have databse credentials then get them from users' metadata
2018-02-15 12:25:55 +01:00
Daniel García Aubert
77b33032e3
Do not expose sensible info about users (database credentials)
2018-02-15 12:24:26 +01:00
Simon Martín
617b83463d
jshint happy
2018-02-12 11:15:00 +01:00
Simon Martín
c351360085
ensuring job_id on jobBackend.create and updating test
2018-02-12 10:39:58 +01:00
Raul Ochoa
3e536b822e
Remove unnecessary destroyOnError option
2017-08-08 18:21:10 +02:00
Daniel García Aubert
7d24ce671b
Update queue index while enqueueing jobs to the top of queue
2017-04-05 11:43:29 +02:00
Daniel García Aubert
c1dff1e395
Improve naming
2017-04-04 10:34:07 +02:00
Daniel García Aubert
36d5dc1719
Queue seeker refactor:
...
- Extract from job subcriber everything related to queue dicovering
- Job Queue is responsible of queue dicovering and exposes functions to scan user queues.
- Batch creates an interval to consume queues
- Now Batch.start() does:
* Finds existing queues from metadata, adding to queue index the ones that are not indexed yet
* Binds callback to process jobs for every queue found.
* Inits queue consumer interval
* Subscribes to PUB/SUB channel
2017-04-03 19:26:21 +02:00
Daniel García Aubert
24ff1cf808
Discover and add to index queues of users with jobs on batch service startup
2017-04-03 12:34:30 +02:00
Daniel García Aubert
8f35e1d1af
Fix typo
2017-04-03 11:38:20 +02:00
Daniel García Aubert
dd7cb73337
Remove unused dependency
2017-03-31 14:34:24 +02:00
Daniel García Aubert
8012fe26aa
Avoid scan behaviour to discover active queues of user's jobs, now keeps an index to know which queues are available
2017-03-31 14:30:33 +02:00
Daniel García Aubert
6592435e87
Use COUNT option for scan command
2017-03-29 20:40:40 +02:00
Daniel García Aubert
09d5a14ade
Check data from redis scan is an array
2017-03-29 20:04:19 +02:00
Daniel García Aubert
56429ffebf
Use traditional for loop instead of .forEach()
2017-03-29 19:54:08 +02:00
Daniel García Aubert
2edfd1fad5
Compare interger instead of strings
2017-03-29 19:51:19 +02:00
Daniel García Aubert
34b352a0a6
Use max number of attempts to scan user queues
2017-03-29 19:38:36 +02:00
Raul Ochoa
9ae62014bd
Include query status in log entries
2016-11-30 16:07:14 +01:00
Daniel García Aubert
4a2b7258be
Do not return error if job could not added to work-in-progress list
2016-11-07 12:04:47 +01:00
Daniel García Aubert
78f5706726
Avoid to use scan command to search work in progress queues
2016-11-03 14:22:43 +01:00
Daniel García Aubert
cfeabf94c7
Fix jshint typo
2016-11-02 11:33:26 +01:00
Daniel García Aubert
92b01f1163
Hide add/clear job from work in progress list
2016-10-28 17:45:13 +02:00
Daniel García Aubert
e007b1c22a
Fix jshint typo
2016-10-28 17:09:31 +02:00
Daniel García Aubert
aa1527b371
Use clear work-in-progress after finishing jobs
2016-10-28 15:58:41 +02:00
