15 Commits

Author	SHA1	Message	Date
Daniel García Aubert	ecb76ca1de	Improved batch API being consistent with naming, humam readability for job dates, hide redis key details for jobs.	2015-12-23 17:29:11 +01:00
Daniel García Aubert	b16c0983c6	Implemented tests for batch API	2015-12-22 23:13:33 +01:00
Daniel García Aubert	3c23bf12e7	Fixed bug whether a job consumer is empty. And refactored batch module, now is a common object intead of module function	2015-12-22 20:12:10 +01:00
Daniel García Aubert	f41c43aa38	Disabled statement timeout bypassing pgbouncer connection	2015-12-22 15:43:00 +01:00
Daniel García Aubert	3762ad7a39	Now jobs are stored in redis instead of user's database	2015-12-21 19:57:10 +01:00
Daniel García Aubert	fb8feeb964	Now Job is an event emitter instance and we are able to know what happen wwith any job. Implemented test without a silly timeout	2015-12-16 18:13:48 +01:00
Daniel García Aubert	43f759e96a	Refactored Batch API using streams instead a interval to consume the job queue. Limited one job running at the same time per queue instead of using a job's counter to limit it.	2015-12-16 15:57:58 +01:00
Daniel García Aubert	d0787d03f7	Reused matadata backend instance for batch service	2015-12-14 10:36:16 +01:00
Daniel García Aubert	fe9280b0f7	Fixed bug in job manager when reenqueue a job when there is no slot to run it	2015-12-11 18:08:19 +01:00
Daniel García Aubert	1002375439	Fixed issue when retrieving user metadata was not parsed properly	2015-12-10 18:09:43 +01:00
Daniel García Aubert	f5ca879ce3	Added entry point for main app to batch api	2015-12-10 15:08:31 +01:00
Daniel García Aubert	a941d99b2f	Now long running queries with statement SELECT are piped to a new table	2015-12-09 22:05:04 +01:00
Daniel García Aubert	6cc48bf9dd	Implemented batch service	2015-12-09 20:17:45 +01:00
Daniel García Aubert	0c6edc573a	Used cartodb-redis instead redis-mpool	2015-12-09 12:18:33 +01:00
Daniel García Aubert	00721bcd02	Implementing batch service	2015-12-09 00:02:08 +01:00