Daniel García Aubert
2e8382eeff
Fixed issues in batch tests:
...
- Wait for batch is ready before testing it
- Remove batch keys in redis after testing every suit
- Fixed issue creating jobs with same id in job service integration test
2016-07-22 14:30:55 +02:00
Daniel García Aubert
5eaad4d5d9
Uses redis-mpool for pubsub in Batch API
2016-07-07 14:14:46 +02:00
Daniel García Aubert
a1f31df92e
Now Batch API broadcast to other APIs everytime that re-enqueues a multiple-query job
2016-06-29 18:29:53 +02:00
Daniel García Aubert
d2d3ba8159
Passed tests
2016-05-16 01:22:47 +02:00
dgaubert
fd9bfe277e
Implemented multiquery jobs for Batch API
2016-03-31 12:39:03 +02:00
Daniel García Aubert
a32fa7b108
Implemented new test for multiquery jobs
2016-03-18 18:12:01 +01:00
Daniel García Aubert
056f22b156
Implemented multi-jobs, user is able to send an array of jobs and batch service will run them in series
2016-03-18 14:57:18 +01:00
Daniel García Aubert
c8dc2b3dc0
Removed possible reenqueued jobs in tests because of draining.
2016-01-26 12:29:04 +01:00
Daniel García Aubert
bd2ec0e77f
Set pg_sleep to 3 seconds in test.
2016-01-26 12:13:04 +01:00
Daniel García Aubert
a960bd18f1
Dranied jobs in hook 'after'
2016-01-25 17:30:07 +01:00
Daniel García Aubert
20fd536659
Now batch stop is synchronous, changed signature in test.
...
Fixed minor issue when draining the last job, queue is got before cancel the job.
2016-01-25 14:51:37 +01:00
Daniel García Aubert
e6f714a51b
Implemented some new unit test
2016-01-22 19:31:25 +01:00
Daniel García Aubert
c308551d05
Implemented drain to stop batch service gracefully.
...
Split job acceptance test
2016-01-13 16:25:25 +01:00
Daniel García Aubert
078eb7706b
Now SQL API is able to disable Batch Service using argv param --no-batch
2016-01-08 18:29:36 +01:00
Daniel García Aubert
20f00d58d9
Refactored batch service to avoid event noise, doing in callback way
2016-01-08 15:47:59 +01:00
Daniel García Aubert
f9f52d2bd1
Improved object creation in batch service
2016-01-08 11:32:01 +01:00
Daniel García Aubert
681772bf37
Implemented test for Job Controller and implemented batch stop service
2016-01-05 17:42:28 +01:00
Daniel García Aubert
8c42019641
Improved namespace in redis for batch's stuff
2015-12-29 15:46:04 +01:00
Daniel García Aubert
851c393f75
Refactored batch manager avoiding concurrence issues
2015-12-29 10:19:10 +01:00
Daniel García Aubert
c4f96b4a59
Implemented support for listing jobs for one user
2015-12-24 17:42:49 +01:00
Daniel García Aubert
ecb76ca1de
Improved batch API being consistent with naming, humam readability for job dates, hide redis key details for jobs.
2015-12-23 17:29:11 +01:00
Daniel García Aubert
c54f274bd4
Fixed callback called multiple times in tests
2015-12-23 14:54:54 +01:00
Daniel García Aubert
b16c0983c6
Implemented tests for batch API
2015-12-22 23:13:33 +01:00
Daniel García Aubert
3c23bf12e7
Fixed bug whether a job consumer is empty. And refactored batch module, now is a common object intead of module function
2015-12-22 20:12:10 +01:00
Daniel García Aubert
f41c43aa38
Disabled statement timeout bypassing pgbouncer connection
2015-12-22 15:43:00 +01:00
Daniel García Aubert
ef59a1d942
Fixed typo in batch test
2015-12-22 11:06:46 +01:00
Daniel García Aubert
328d4c6bfe
Fixed bad assertion in batch acceptance test
2015-12-22 11:02:16 +01:00
Daniel García Aubert
3762ad7a39
Now jobs are stored in redis instead of user's database
2015-12-21 19:57:10 +01:00
Daniel García Aubert
fb8feeb964
Now Job is an event emitter instance and we are able to know what happen wwith any job. Implemented test without a silly timeout
2015-12-16 18:13:48 +01:00
Daniel García Aubert
43f759e96a
Refactored Batch API using streams instead a interval to consume the job queue. Limited one job running at the same time per queue instead of using a job's counter to limit it.
2015-12-16 15:57:58 +01:00
Daniel García Aubert
d0787d03f7
Reused matadata backend instance for batch service
2015-12-14 10:36:16 +01:00
Daniel García Aubert
6cc48bf9dd
Implemented batch service
2015-12-09 20:17:45 +01:00
Daniel García Aubert
da66703ce3
Skipped undone test
2015-12-09 12:23:49 +01:00
Daniel García Aubert
56cc5b439a
Removed test filter for runner
2015-12-09 12:22:00 +01:00
Daniel García Aubert
0c6edc573a
Used cartodb-redis instead redis-mpool
2015-12-09 12:18:33 +01:00
Daniel García Aubert
00721bcd02
Implementing batch service
2015-12-09 00:02:08 +01:00
