Commit Graph

2913 Commits

Author SHA1 Message Date
Daniel García Aubert
6676260b17 Implement a throttler stream to check input data speed 2019-05-28 19:24:29 +02:00
Daniel García Aubert
5a116c69e9 Draft for copy from throttle 2019-05-27 19:32:43 +02:00
Daniel García Aubert
7a3e4d617d Encapsulate cancel 2019-05-27 19:24:48 +02:00
Daniel García Aubert
73eb9656cd Removing unpipe calls, regarding documentation, unpipe is emitted when error. 2019-05-27 15:26:44 +02:00
Daniel García Aubert
c0b5997745 Terminate backend when cancel did not work 2019-05-27 15:11:52 +02:00
Daniel García Aubert
19b9aab042 Do not resume internal connection stream (handled properly in the pg-copy-stream module) 2019-05-24 17:31:56 +02:00
Daniel García Aubert
e57f7b6ecf Use CARTO's fork of pg-copy-streams 2019-05-24 17:30:26 +02:00
Daniel García Aubert
c52dbb7a40 Release connection to the pool depending on the action 2019-05-24 15:53:09 +02:00
Daniel García Aubert
9c0e76bb4a decouple cancel from the stream 2019-05-24 15:39:56 +02:00
Daniel García Aubert
7519037333 de-tab 2019-05-24 13:07:34 +02:00
Daniel García Aubert
b297005ebb Do not pass unecessary parameter 2019-05-24 12:45:27 +02:00
Daniel García Aubert
679f9fa451 Use pg-copy-stream upstream 2019-05-17 18:50:41 +02:00
Daniel García Aubert
e743fefe37 Don't use console.log to log errors 2019-05-16 17:46:59 +02:00
Daniel García Aubert
17de6e8d4f Unpipe streams when error 2019-05-16 17:24:21 +02:00
Daniel García Aubert
9b21b813be Do not pass error for emitting cancel events 2019-05-16 15:07:26 +02:00
Daniel García Aubert
62dc063677 Create stream at the begining 2019-05-16 15:06:27 +02:00
Daniel García Aubert
f7f96f004a Be more specific with arguments 2019-05-16 12:19:03 +02:00
Daniel García Aubert
fbc958f8e1 Materialize table creation as test setup 2019-05-16 12:17:24 +02:00
Daniel García Aubert
2208fb9764 Implement a cancel backend through query instead of node-postgres protocol 2019-05-14 15:39:54 +02:00
Daniel G. Aubert
cced53dca8
Merge pull request #586 from CartoDB/enable-keep-alive-db
Enable keepalive for conections to DB
2019-05-07 11:42:46 +02:00
Daniel García Aubert
e643eaa4a1 Enable keepalive for conections to DB 2019-05-06 18:51:00 +02:00
Daniel G. Aubert
9f20ef2a59
Merge pull request #584 from CartoDB/remove-old-jobs
Implemented script to remove old batch-api jobs
2019-04-11 18:35:46 +02:00
Mario de Frutos Dieguez
e14fb1b85c
Merge pull request #585 from CartoDB/pg11_docker_tests
Test against PG11 and Postgis 2.5
2019-04-10 12:12:42 +02:00
Raul Marin
915d86ab50 Update doc ref 2019-04-10 12:03:26 +02:00
Raul Marin
6be8f591bf Add missing error codes 2019-04-10 12:01:40 +02:00
Raul Marin
055f56005c Remove workaround for PARALLEL tags 2019-04-10 11:53:14 +02:00
Mario de Frutos Dieguez
2f74515323
Allow to test against different docker images 2019-04-10 10:55:40 +02:00
Mario de Frutos Dieguez
22aae632de
Test against PG11 and Postgis 2.5 2019-04-09 20:42:45 +02:00
Daniel García Aubert
784b6dd1d0 Ignore jshint 2019-04-09 18:30:29 +02:00
Daniel García Aubert
af9303b577 Implemented script to remove old batch-api jobs 2019-04-09 18:16:01 +02:00
Daniel G. Aubert
c147c751dc
Merge pull request #582 from CartoDB/clear-wip-on-drain
Clear wip jobs on drain
2019-04-05 12:59:49 +02:00
Daniel García Aubert
070c600745 Update news 2019-04-05 12:42:49 +02:00
Daniel García Aubert
8f331becf4 Be more consistent while defining arguments 2019-04-05 11:55:58 +02:00
Daniel García Aubert
df548b301c Typo 2019-04-04 19:42:28 +02:00
Daniel García Aubert
7dad3eb454 Add schedule force exit to SIGINT, SIGTERM, and unhandledRejection events 2019-04-04 19:21:09 +02:00
Daniel García Aubert
29e5b1ff97 Use 'once' 2019-04-04 18:31:07 +02:00
Daniel García Aubert
ce04cbcb45 Use callback properly 2019-04-04 18:21:49 +02:00
Daniel García Aubert
f2b5921ade Flush batch logger to not lose info 2019-04-04 18:15:21 +02:00
Daniel García Aubert
12e35b02e8 Log more info 2019-04-04 17:26:58 +02:00
Daniel García Aubert
5a0e3810d4 Typo 2019-04-04 17:18:45 +02:00
Daniel García Aubert
b01ac63ed7 Do not pass callback to method close 2019-04-04 17:13:04 +02:00
Daniel García Aubert
3ed4b142c0 Improve shutdown 2019-04-04 16:44:54 +02:00
Daniel García Aubert
1905a2bd28 Please, jshint 2019-04-04 15:16:44 +02:00
Daniel García Aubert
2e2e233b68 Use 'bunyan' logger instead of 'debug' to log debug messages 2019-04-04 14:31:41 +02:00
Daniel García Aubert
3c73e2f0b4 Revert "Temporal debugging flag"
This reverts commit b3306ae258.
2019-04-04 11:51:43 +02:00
Daniel García Aubert
b3306ae258 Temporal debugging flag 2019-04-03 19:01:36 +02:00
Daniel García Aubert
87eefb9cb7 Typo 2019-04-03 18:53:58 +02:00
Daniel García Aubert
544d85310f Typo 2019-04-03 18:50:05 +02:00
Daniel García Aubert
7f6f91fc15 Clear job from WIP while draining 2019-04-03 18:49:11 +02:00
Daniel G. Aubert
e573daddf8
Merge pull request #580 from CartoDB/maintenance
Upgrade devel dep sqlite3 to version 4.0.6
2019-04-03 09:41:30 +02:00