Raul Ochoa
431f72873a
250 queued jobs as default limit
2016-10-17 13:00:23 +02:00
Raul Ochoa
c62fe29160
Load config on object creation
2016-10-17 10:51:50 +02:00
Raul Ochoa
1e442b37ab
Allow to set a max number of queued jobs per user
2016-10-12 22:40:35 +02:00
Raul Ochoa
1f038ac1f4
Moves from host queues to user queues
...
- Existing jobs are moved before start processing them.
- Uses a new queue prefix to avoid collisions.
- Pub/Sub also changes communication channel.
- Job subscriber emits user+host on new jobs.
- Batch processor is faulty. See TODO in batch.js.
2016-10-12 21:32:29 +02:00
Raul Ochoa
deb1ccf876
DRY job final statuses
2016-10-10 12:09:13 +02:00
Raul Ochoa
d33fe5ac21
Stop indexing jobs per user
...
Removes .list() from job backend
2016-08-30 19:01:23 +02:00
Daniel García Aubert
9f50475ad1
Merge branch 'master' of github.com:CartoDB/CartoDB-SQL-API
2016-08-30 13:50:03 +02:00
Daniel García Aubert
2932227e8b
Improved naming for jobs TTL constant
2016-08-30 13:49:16 +02:00
Daniel García Aubert
02a252940a
Improved naming for jobs TTL constant
2016-08-30 10:11:49 +02:00
Daniel García Aubert
89c3681be0
Fix bug when checking if a job is found
2016-07-19 12:34:06 +02:00
Daniel García Aubert
a1f31df92e
Now Batch API broadcast to other APIs everytime that re-enqueues a multiple-query job
2016-06-29 18:29:53 +02:00
Daniel García Aubert
3caa1373bf
Removed useless condition
2016-05-23 18:47:45 +02:00
Daniel García Aubert
2d86fc2ce3
In fallback jobs, used fallback_status property instead of an array of statuses
2016-05-23 15:05:14 +02:00
Daniel García Aubert
b94a9c7c0a
Fixed conflicts
2016-05-18 11:48:39 +02:00
Daniel García Aubert
8b7d481b9a
Avoided console usage, favor debug
2016-05-18 11:06:49 +02:00
Daniel García Aubert
26cd778583
Improved param name
2016-05-17 19:55:33 +02:00
Daniel García Aubert
b06eaae5e6
Use REDIS_DB as constant
2016-05-17 19:48:55 +02:00
Daniel García Aubert
672b8ef537
Made pure functions
2016-05-17 19:44:45 +02:00
Daniel García Aubert
40d82112a8
Used REDIS_PREFIX as constant
2016-05-17 19:41:31 +02:00
Daniel García Aubert
3bac26cf2f
Used JOB_PREFIX as constant
2016-05-17 19:27:05 +02:00
Daniel García Aubert
b2eac6b880
Implemented test for fallback jobs
2016-05-17 01:00:27 +02:00
Daniel García Aubert
050f077e8c
Avoid null values
2016-05-16 11:56:44 +02:00
Daniel García Aubert
d2d3ba8159
Passed tests
2016-05-16 01:22:47 +02:00
Daniel García Aubert
cc7dd7a0d2
Job model refactor
2016-05-13 18:50:55 +02:00
Daniel García Aubert
4a83de09af
Added job status enumerable to avoid hardcodes strings
2016-04-05 18:50:04 +02:00
dgaubert
e2cc09f1dd
Allowed modification to multiquery-jobs if its status is pending
2016-04-01 11:33:27 +02:00
dgaubert
c886e05b87
Improved condition in job backend
2016-03-31 19:14:38 +02:00
dgaubert
5c5c151237
Added failed_reason to query in multiquery jobs
2016-03-31 19:03:38 +02:00
dgaubert
fd9bfe277e
Implemented multiquery jobs for Batch API
2016-03-31 12:39:03 +02:00
dgaubert
ef65350771
Returns job from redis after change any job status
2016-03-30 16:44:55 +02:00
Daniel García Aubert
c220b157b4
Removed extra empty lines
2016-03-21 19:47:07 +01:00
Daniel García Aubert
efca278bec
Fixed error updating multiquery job
2016-03-21 19:43:28 +01:00
Daniel García Aubert
056f22b156
Implemented multi-jobs, user is able to send an array of jobs and batch service will run them in series
2016-03-18 14:57:18 +01:00
Daniel García Aubert
fbaebfe8f2
Fixed weird message in Batch SQL API
2016-03-02 10:31:14 +01:00
Daniel García Aubert
da16f32789
Added uknown status to jobs when drain fails
2016-01-25 20:07:41 +01:00
Daniel García Aubert
5c4d239467
Fixed unit test for job queue and moved isJobFound function as private method in job backend
2016-01-22 12:43:41 +01:00
Daniel García Aubert
31ac48ef1a
Changed job's ttl to be configurable
2016-01-21 15:33:42 +01:00
Daniel García Aubert
c308551d05
Implemented drain to stop batch service gracefully.
...
Split job acceptance test
2016-01-13 16:25:25 +01:00
Daniel García Aubert
8d29e6b45c
Improved log messages
2016-01-08 16:24:53 +01:00
Daniel García Aubert
20f00d58d9
Refactored batch service to avoid event noise, doing in callback way
2016-01-08 15:47:59 +01:00
Daniel García Aubert
e6a4e0f7eb
Returned 201 HTTP code in job creation
...
Fixed bug listing jobs, now user job index is cleaned before respond to client
2016-01-07 12:07:30 +01:00
Daniel García Aubert
246655de94
Changed redis data structure for users jobs
2016-01-04 19:08:13 +01:00
Daniel García Aubert
13ffaab0d5
Resolved minor bug when user tries to cancel a job and included a ttl to jobs after its resolution
2016-01-04 15:20:06 +01:00
Daniel García Aubert
35650985db
Implemented job modification whether job is pending
2015-12-31 15:42:31 +01:00
Daniel García Aubert
ada39d84b8
Implemented job cancelation in Batch API
2015-12-30 20:16:18 +01:00
Daniel García Aubert
8c42019641
Improved namespace in redis for batch's stuff
2015-12-29 15:46:04 +01:00
Daniel García Aubert
c4f96b4a59
Implemented support for listing jobs for one user
2015-12-24 17:42:49 +01:00
Daniel García Aubert
ecb76ca1de
Improved batch API being consistent with naming, humam readability for job dates, hide redis key details for jobs.
2015-12-23 17:29:11 +01:00
Daniel García Aubert
3c23bf12e7
Fixed bug whether a job consumer is empty. And refactored batch module, now is a common object intead of module function
2015-12-22 20:12:10 +01:00
Daniel García Aubert
3762ad7a39
Now jobs are stored in redis instead of user's database
2015-12-21 19:57:10 +01:00
