Commit Graph

3024 Commits

Author SHA1 Message Date
Daniel G. Aubert
2848de8593
Merge pull request #588 from CartoDB/copy-cancel
Improve copy[to|from] cancel mechanism
2019-05-30 13:39:53 +02:00
Daniel García Aubert
4d469100a7 Update NEWS 2019-05-30 13:37:33 +02:00
Daniel G. Aubert
d9f668048c
Merge pull request #589 from CartoDB/improve-copy-error-handling
Improve copy error handling
2019-05-30 13:25:37 +02:00
Daniel G. Aubert
86fcc57c23
Merge pull request #590 from CartoDB/copy-throttle
Short out copy-from when client is hang
2019-05-30 13:20:12 +02:00
Daniel García Aubert
d37aef21a0 Use copy from protocal to cancel the copy query 2019-05-30 11:36:57 +02:00
Daniel García Aubert
06cb514ece Remove unused reference 2019-05-30 11:36:14 +02:00
Daniel García Aubert
33e659c142 Please, linter 2019-05-29 11:38:25 +02:00
Daniel García Aubert
4ddcc3b0e6 Set minimum input data speed default to 0 bytes 2019-05-29 11:21:22 +02:00
Daniel García Aubert
e6b9325b77 Extract class 2019-05-29 11:20:18 +02:00
Daniel García Aubert
2b86abbeba Please, jshint 2019-05-28 19:30:17 +02:00
Daniel García Aubert
6676260b17 Implement a throttler stream to check input data speed 2019-05-28 19:24:29 +02:00
Daniel García Aubert
5a116c69e9 Draft for copy from throttle 2019-05-27 19:32:43 +02:00
Daniel García Aubert
7a3e4d617d Encapsulate cancel 2019-05-27 19:24:48 +02:00
Daniel García Aubert
73eb9656cd Removing unpipe calls, regarding documentation, unpipe is emitted when error. 2019-05-27 15:26:44 +02:00
Daniel García Aubert
c0b5997745 Terminate backend when cancel did not work 2019-05-27 15:11:52 +02:00
Daniel García Aubert
19b9aab042 Do not resume internal connection stream (handled properly in the pg-copy-stream module) 2019-05-24 17:31:56 +02:00
Daniel García Aubert
e57f7b6ecf Use CARTO's fork of pg-copy-streams 2019-05-24 17:30:26 +02:00
Daniel García Aubert
c52dbb7a40 Release connection to the pool depending on the action 2019-05-24 15:53:09 +02:00
Daniel García Aubert
9c0e76bb4a decouple cancel from the stream 2019-05-24 15:39:56 +02:00
Daniel García Aubert
7519037333 de-tab 2019-05-24 13:07:34 +02:00
Daniel García Aubert
b297005ebb Do not pass unecessary parameter 2019-05-24 12:45:27 +02:00
Daniel García Aubert
679f9fa451 Use pg-copy-stream upstream 2019-05-17 18:50:41 +02:00
Daniel García Aubert
e743fefe37 Don't use console.log to log errors 2019-05-16 17:46:59 +02:00
Daniel García Aubert
17de6e8d4f Unpipe streams when error 2019-05-16 17:24:21 +02:00
Daniel García Aubert
9b21b813be Do not pass error for emitting cancel events 2019-05-16 15:07:26 +02:00
Daniel García Aubert
62dc063677 Create stream at the begining 2019-05-16 15:06:27 +02:00
Daniel García Aubert
f7f96f004a Be more specific with arguments 2019-05-16 12:19:03 +02:00
Daniel García Aubert
fbc958f8e1 Materialize table creation as test setup 2019-05-16 12:17:24 +02:00
Daniel García Aubert
2208fb9764 Implement a cancel backend through query instead of node-postgres protocol 2019-05-14 15:39:54 +02:00
Daniel G. Aubert
cced53dca8
Merge pull request #586 from CartoDB/enable-keep-alive-db
Enable keepalive for conections to DB
2019-05-07 11:42:46 +02:00
Daniel García Aubert
e643eaa4a1 Enable keepalive for conections to DB 2019-05-06 18:51:00 +02:00
Daniel G. Aubert
9f20ef2a59
Merge pull request #584 from CartoDB/remove-old-jobs
Implemented script to remove old batch-api jobs
2019-04-11 18:35:46 +02:00
Mario de Frutos Dieguez
e14fb1b85c
Merge pull request #585 from CartoDB/pg11_docker_tests
Test against PG11 and Postgis 2.5
2019-04-10 12:12:42 +02:00
Raul Marin
915d86ab50 Update doc ref 2019-04-10 12:03:26 +02:00
Raul Marin
6be8f591bf Add missing error codes 2019-04-10 12:01:40 +02:00
Raul Marin
055f56005c Remove workaround for PARALLEL tags 2019-04-10 11:53:14 +02:00
Mario de Frutos Dieguez
2f74515323
Allow to test against different docker images 2019-04-10 10:55:40 +02:00
Mario de Frutos Dieguez
22aae632de
Test against PG11 and Postgis 2.5 2019-04-09 20:42:45 +02:00
Daniel García Aubert
784b6dd1d0 Ignore jshint 2019-04-09 18:30:29 +02:00
Daniel García Aubert
af9303b577 Implemented script to remove old batch-api jobs 2019-04-09 18:16:01 +02:00
Daniel G. Aubert
c147c751dc
Merge pull request #582 from CartoDB/clear-wip-on-drain
Clear wip jobs on drain
2019-04-05 12:59:49 +02:00
Daniel García Aubert
070c600745 Update news 2019-04-05 12:42:49 +02:00
Daniel García Aubert
8f331becf4 Be more consistent while defining arguments 2019-04-05 11:55:58 +02:00
Daniel García Aubert
df548b301c Typo 2019-04-04 19:42:28 +02:00
Daniel García Aubert
7dad3eb454 Add schedule force exit to SIGINT, SIGTERM, and unhandledRejection events 2019-04-04 19:21:09 +02:00
Daniel García Aubert
29e5b1ff97 Use 'once' 2019-04-04 18:31:07 +02:00
Daniel García Aubert
ce04cbcb45 Use callback properly 2019-04-04 18:21:49 +02:00
Daniel García Aubert
f2b5921ade Flush batch logger to not lose info 2019-04-04 18:15:21 +02:00
Daniel García Aubert
12e35b02e8 Log more info 2019-04-04 17:26:58 +02:00
Daniel García Aubert
5a0e3810d4 Typo 2019-04-04 17:18:45 +02:00