Raul Ochoa
|
f7d1f9426c
|
Use constants for queues
|
2016-10-12 17:53:03 +02:00 |
|
Raul Ochoa
|
189aff2aa9
|
Only log message on empty queue
|
2016-10-12 17:42:46 +02:00 |
|
Raul Ochoa
|
6bb2abde0d
|
Only start lock renewal on lock acquisition
|
2016-10-12 17:01:24 +02:00 |
|
Raul Ochoa
|
b86f82d3ca
|
Batch.stop removes all listeners
|
2016-10-12 16:43:18 +02:00 |
|
Raul Ochoa
|
75fc21241f
|
Locker TTL is configured
|
2016-10-12 13:11:20 +02:00 |
|
Raul Ochoa
|
88f6d46d00
|
Reuse existing redlock
Return not connected clients to pool
|
2016-10-12 13:10:18 +02:00 |
|
Raul Ochoa
|
3f1b67993c
|
Locker keep refreshing lock by itself
|
2016-10-12 12:30:13 +02:00 |
|
Raul Ochoa
|
67566c1d0e
|
Callback in subscriber unsubscribe errors
|
2016-10-12 12:29:54 +02:00 |
|
Raul Ochoa
|
c74f9bcce0
|
More aggressive on seek interval
|
2016-10-12 12:29:18 +02:00 |
|
Raul Ochoa
|
98185e55cf
|
Remove Job Queue Pool and use internal structure
- We don't need to create a different job queue per host.
- Batch locks on message instead of dequeue.
|
2016-10-12 12:26:50 +02:00 |
|
Raul Ochoa
|
e1d0ffc7dd
|
Logger set to fatal on test environment
|
2016-10-12 01:40:35 +02:00 |
|
Raul Ochoa
|
22d8e48f53
|
Only lock on dequeue
|
2016-10-12 00:10:40 +02:00 |
|
Raul Ochoa
|
81393190f7
|
Add callback to jobseeker result from initial load
|
2016-10-11 19:59:11 +02:00 |
|
Raul Ochoa
|
8bc52b09cf
|
Remove console call
|
2016-10-11 19:46:27 +02:00 |
|
Raul Ochoa
|
dc1a23e886
|
Add error handler for channel subscriber
|
2016-10-11 19:45:43 +02:00 |
|
Raul Ochoa
|
2822b68198
|
onJobHandler receives host with job
Queue seeker only returns hosts, not mixing responsibilities
|
2016-10-11 19:45:26 +02:00 |
|
Raul Ochoa
|
01cf6f244f
|
Share redis pool for pubsub
|
2016-10-11 19:41:58 +02:00 |
|
Raul Ochoa
|
ecc6bf0400
|
Use real on message handler
|
2016-10-11 19:04:12 +02:00 |
|
Raul Ochoa
|
611508c654
|
Hide queue seeker behind job subscriber
|
2016-10-11 19:01:39 +02:00 |
|
Raul Ochoa
|
e7c4ee32df
|
Share redis channel config
|
2016-10-11 18:41:59 +02:00 |
|
Raul Ochoa
|
d15c7ab0de
|
Always return client to pool
|
2016-10-11 18:30:35 +02:00 |
|
Raul Ochoa
|
e4b1711e8e
|
pub/sub package
|
2016-10-11 18:28:46 +02:00 |
|
Raul Ochoa
|
2c064041a1
|
Add dist lock to run all jobs by host in order
It uses http://redis.io/topics/distlock
Which is not perfect: http://martin.kleppmann.com/2016/02/08/how-to-do-distributed-locking.html
|
2016-10-10 19:54:59 +02:00 |
|
Raul Ochoa
|
0de5d94617
|
Use debug with same params, no considering job status
|
2016-10-10 19:53:59 +02:00 |
|
Raul Ochoa
|
90c489119b
|
Add distributed lock implementation with redis distlock
|
2016-10-10 19:51:11 +02:00 |
|
Raul Ochoa
|
56a632347b
|
Inject publisher
|
2016-10-10 19:47:50 +02:00 |
|
Raul Ochoa
|
66820a67bb
|
Make possible to specify a name for batch
|
2016-10-10 19:46:07 +02:00 |
|
Raul Ochoa
|
deb1ccf876
|
DRY job final statuses
|
2016-10-10 12:09:13 +02:00 |
|
Raul Ochoa
|
8a4f54bb87
|
Allow users to set max statement_timeout for their queries
|
2016-10-10 12:01:36 +02:00 |
|
Raul Ochoa
|
5401a7edff
|
Timeout is passed into query runner
|
2016-10-10 12:00:54 +02:00 |
|
Raul Ochoa
|
51d4ff0698
|
Differentiate between statement timeout and user cancelled query
|
2016-10-10 11:58:44 +02:00 |
|
Raul Ochoa
|
1d20f11f0c
|
Remove unused var
|
2016-10-06 18:44:21 +02:00 |
|
Raul Ochoa
|
578c43b1a8
|
Multiple queries jobs pushed as first job between queries
|
2016-10-06 18:27:38 +02:00 |
|
Raul Ochoa
|
e108d0df57
|
Debug query to run
|
2016-10-06 18:24:28 +02:00 |
|
Raul Ochoa
|
7c7320061f
|
Merge branch 'master' into limit-batch-queries
|
2016-10-06 12:46:34 +02:00 |
|
Raul Ochoa
|
26fe6a1626
|
Add readme for batch queries feature
|
2016-10-06 12:27:38 +02:00 |
|
Raul Ochoa
|
eb2768c197
|
Add dbhost attribute to batch queries logs
|
2016-10-05 19:09:10 +02:00 |
|
Raul Ochoa
|
6c2db4385c
|
Batch Queries: use path instead of stream to be able to reopen FD
|
2016-10-03 13:28:13 +02:00 |
|
Raul Ochoa
|
857ba747d0
|
Rename
|
2016-09-30 18:45:33 +02:00 |
|
Raul Ochoa
|
b269418db4
|
Tag logs
|
2016-09-30 18:45:15 +02:00 |
|
Raul Ochoa
|
72fb851db7
|
Fix typo
|
2016-09-30 16:55:33 +02:00 |
|
Raul Ochoa
|
20573a7f67
|
Always log queries from fallback jobs
- Add query id if exists
- Only log analyses for expected format
- Log with query start and end times
|
2016-09-30 16:54:10 +02:00 |
|
Raul Ochoa
|
ba34412ce3
|
Return on boolean on log
|
2016-09-30 16:51:34 +02:00 |
|
Raul Ochoa
|
9555a2cbde
|
Bring back log logic for FallbackJob
|
2016-09-30 16:47:37 +02:00 |
|
Raul Ochoa
|
60546de147
|
Move log logic to each job
|
2016-09-30 16:44:39 +02:00 |
|
Daniel García Aubert
|
ed27b67cec
|
Simplified batch logger construction
|
2016-09-29 15:17:25 +02:00 |
|
Daniel García Aubert
|
aa0ce62a85
|
Implement batch logger to log query times when queries are defined with id
|
2016-09-29 15:09:36 +02:00 |
|
Daniel García Aubert
|
4f3d361226
|
Fixes #356, set limit to batch queries to 12h
|
2016-09-13 12:32:41 +02:00 |
|
Raul Ochoa
|
461728d3e2
|
Remove user indexer
|
2016-08-30 19:08:06 +02:00 |
|
Raul Ochoa
|
d33fe5ac21
|
Stop indexing jobs per user
Removes .list() from job backend
|
2016-08-30 19:01:23 +02:00 |
|