Daniel García Aubert
78f5706726
Avoid to use scan command to search work in progress queues
2016-11-03 14:22:43 +01:00
Daniel García Aubert
ea06581ddb
Add clear work in progress job
2016-10-28 15:18:57 +02:00
Daniel García Aubert
64d0dc93bf
Removed unnecessary debug
2016-10-28 15:06:07 +02:00
Daniel García Aubert
af75bbda50
Rename
2016-10-28 12:50:33 +02:00
Daniel García Aubert
f0de347b56
Rename
2016-10-28 12:30:33 +02:00
Daniel García Aubert
7b48e43d92
Rename
2016-10-28 12:29:28 +02:00
Daniel García Aubert
224a4c933a
Rename
2016-10-28 12:26:24 +02:00
Daniel García Aubert
1f657a4f94
Ensure test is isolated
2016-10-28 12:24:23 +02:00
Daniel García Aubert
97836e62b9
Add debug message
2016-10-27 20:45:47 +02:00
Daniel García Aubert
72419072ea
Improve var definitions
2016-10-27 20:43:42 +02:00
Daniel García Aubert
0085b8ee3d
List users with work in progress jobs
2016-10-27 20:42:49 +02:00
Daniel García Aubert
f65208ba0d
Add listWorkInProgressJobByUser function
2016-10-27 18:43:28 +02:00
Daniel García Aubert
c1f2f9377d
Change signature
2016-10-27 17:46:43 +02:00
Daniel García Aubert
869139260b
Implement function to save work-in-progress jobs
2016-10-27 17:36:40 +02:00
Raul Ochoa
66d1c18941
Default to 64 queued jobs as max
2016-10-17 15:23:53 +02:00
Raul Ochoa
431f72873a
250 queued jobs as default limit
2016-10-17 13:00:23 +02:00
Raul Ochoa
c62fe29160
Load config on object creation
2016-10-17 10:51:50 +02:00
Raul Ochoa
1e442b37ab
Allow to set a max number of queued jobs per user
2016-10-12 22:40:35 +02:00
Raul Ochoa
1f038ac1f4
Moves from host queues to user queues
...
- Existing jobs are moved before start processing them.
- Uses a new queue prefix to avoid collisions.
- Pub/Sub also changes communication channel.
- Job subscriber emits user+host on new jobs.
- Batch processor is faulty. See TODO in batch.js.
2016-10-12 21:32:29 +02:00
Raul Ochoa
deb1ccf876
DRY job final statuses
2016-10-10 12:09:13 +02:00
Raul Ochoa
d33fe5ac21
Stop indexing jobs per user
...
Removes .list() from job backend
2016-08-30 19:01:23 +02:00
Daniel García Aubert
9f50475ad1
Merge branch 'master' of github.com:CartoDB/CartoDB-SQL-API
2016-08-30 13:50:03 +02:00
Daniel García Aubert
2932227e8b
Improved naming for jobs TTL constant
2016-08-30 13:49:16 +02:00
Daniel García Aubert
02a252940a
Improved naming for jobs TTL constant
2016-08-30 10:11:49 +02:00
Daniel García Aubert
89c3681be0
Fix bug when checking if a job is found
2016-07-19 12:34:06 +02:00
Daniel García Aubert
a1f31df92e
Now Batch API broadcast to other APIs everytime that re-enqueues a multiple-query job
2016-06-29 18:29:53 +02:00
Daniel García Aubert
3caa1373bf
Removed useless condition
2016-05-23 18:47:45 +02:00
Daniel García Aubert
2d86fc2ce3
In fallback jobs, used fallback_status property instead of an array of statuses
2016-05-23 15:05:14 +02:00
Daniel García Aubert
b94a9c7c0a
Fixed conflicts
2016-05-18 11:48:39 +02:00
Daniel García Aubert
8b7d481b9a
Avoided console usage, favor debug
2016-05-18 11:06:49 +02:00
Daniel García Aubert
26cd778583
Improved param name
2016-05-17 19:55:33 +02:00
Daniel García Aubert
b06eaae5e6
Use REDIS_DB as constant
2016-05-17 19:48:55 +02:00
Daniel García Aubert
672b8ef537
Made pure functions
2016-05-17 19:44:45 +02:00
Daniel García Aubert
40d82112a8
Used REDIS_PREFIX as constant
2016-05-17 19:41:31 +02:00
Daniel García Aubert
3bac26cf2f
Used JOB_PREFIX as constant
2016-05-17 19:27:05 +02:00
Daniel García Aubert
b2eac6b880
Implemented test for fallback jobs
2016-05-17 01:00:27 +02:00
Daniel García Aubert
050f077e8c
Avoid null values
2016-05-16 11:56:44 +02:00
Daniel García Aubert
d2d3ba8159
Passed tests
2016-05-16 01:22:47 +02:00
Daniel García Aubert
cc7dd7a0d2
Job model refactor
2016-05-13 18:50:55 +02:00
Daniel García Aubert
4a83de09af
Added job status enumerable to avoid hardcodes strings
2016-04-05 18:50:04 +02:00
dgaubert
e2cc09f1dd
Allowed modification to multiquery-jobs if its status is pending
2016-04-01 11:33:27 +02:00
dgaubert
c886e05b87
Improved condition in job backend
2016-03-31 19:14:38 +02:00
dgaubert
5c5c151237
Added failed_reason to query in multiquery jobs
2016-03-31 19:03:38 +02:00
dgaubert
fd9bfe277e
Implemented multiquery jobs for Batch API
2016-03-31 12:39:03 +02:00
dgaubert
ef65350771
Returns job from redis after change any job status
2016-03-30 16:44:55 +02:00
Daniel García Aubert
c220b157b4
Removed extra empty lines
2016-03-21 19:47:07 +01:00
Daniel García Aubert
efca278bec
Fixed error updating multiquery job
2016-03-21 19:43:28 +01:00
Daniel García Aubert
056f22b156
Implemented multi-jobs, user is able to send an array of jobs and batch service will run them in series
2016-03-18 14:57:18 +01:00
Daniel García Aubert
fbaebfe8f2
Fixed weird message in Batch SQL API
2016-03-02 10:31:14 +01:00
Daniel García Aubert
da16f32789
Added uknown status to jobs when drain fails
2016-01-25 20:07:41 +01:00