Commit Graph

2808 Commits

Author SHA1 Message Date
Rafa de la Torre
ebac334cbd Update NEWS w/ COPY TO patch 2018-09-17 17:52:08 +02:00
Rafa de la Torre
d5a7f6d2d6 Fix paused stream (DB socket) after copy to #590
Ideally, the CopyToQueryStream would take care o piping, unpiping and
resuming the connection with the DB.

For some reason it does not always work when trying that from the
_transform callback.

Since there's no better callback (at least in node6), this patch is
required to make sure that such connection can be returned to the pool
and reused by some other query.
2018-09-17 16:54:51 +02:00
Rafa de la Torre
a927a6993a Add a test to reproduce the issue w/ COPY TO #590 2018-09-17 16:46:09 +02:00
Simon Martín
d0cd999bac
Merge pull request #536 from CartoDB/ensure-tmpDir
Ensure tmpDir
2018-08-31 10:14:18 +02:00
Simon Martín
cc9e6eae43 new tmpDir more verbose 2018-08-30 15:10:43 +02:00
Simon Martín
88b8e3c791 NEWS 2018-08-30 15:08:39 +02:00
Simon Martín
a0db81369a forgotten .only (shame on me) 2018-08-30 15:06:07 +02:00
Simon Martín
3468353876 ensure tmpDir test 2018-08-30 12:50:50 +02:00
Simon Martín
32ff1e7a8e ensure tmpDir folder 2018-08-30 12:27:34 +02:00
Simon Martín
416c3d6285 add mkdirp 2018-08-30 12:27:25 +02:00
Alejandro Guirao Rodríguez
2849a57a01
Merge pull request #533 from CartoDB/naming-fixes-1
Update carto-package.json
2018-08-20 14:55:23 +02:00
Alejandro Guirao Rodríguez
84aa2f901b
PostGIS uses 4 numbers for versions 2018-08-17 10:45:02 +02:00
Alejandro Guirao Rodríguez
b5790ce6b5
Update carto-package.json
Format fixes for dependencies specification
2018-08-17 10:32:22 +02:00
Simon Martín
74811adc74 gdal to requires in carto-package 2018-08-16 16:19:10 +02:00
Simon Martín
8d7ecf61ef
Merge pull request #531 from CartoDB/create-carto-package-json
create carto-package.json file
2018-08-16 15:04:22 +02:00
Simon Martín
70030cae9d Merge branch 'master' into create-carto-package-json 2018-08-16 13:26:21 +02:00
Simon Martín
5170beac6d gdal and carto_postgresql_ext 2018-08-16 13:01:56 +02:00
Simon Martín
e8d0b359c8 back previous commit 2018-08-16 12:59:54 +02:00
Simon Martín
e88f5dc155 removing gdal from travis configuration to check if needed 2018-08-16 12:48:49 +02:00
Simon Martín
d5d248dec8 more versions 2018-08-14 18:30:07 +02:00
Simon Martín
2779346ba0
Merge pull request #532 from CartoDB/copyto-gzip-log
copyto adding gzip to log
2018-08-14 16:55:06 +02:00
Simon Martín
9365986272 better message 2018-08-14 15:30:51 +02:00
Simon Martín
0a1f7c6ba5 copyto adding gzip to log 2018-08-14 15:14:22 +02:00
Simon Martín
2a5f19839a adding versions, not finished 2018-08-14 14:38:04 +02:00
Simon Martín
0a624890c6 create carto-package.json file 2018-08-14 12:29:58 +02:00
Simon Martín
911a9efe1b
Merge pull request #530 from CartoDB/copy-gunzip-exceptions
Handle gunzip/zlib errors
2018-08-13 11:15:40 +02:00
Simon Martín
e008eb66df remove only 2018-08-10 14:40:23 +02:00
Simon Martín
735033faee jshint 2018-08-10 14:39:32 +02:00
Simon Martín
c0ea5be5d3 Improve gzip error message 2018-08-10 14:38:50 +02:00
Simon Martín
9eeeadbc07 maintain req error handler 2018-08-10 14:38:24 +02:00
Rafa de la Torre
319b64e20c Update NEWS.md #528 2018-08-10 12:41:29 +02:00
Rafa de la Torre
8a76df8884 Fix for unhandled gunzip/zlib errors #528 2018-08-10 12:37:49 +02:00
Rafa de la Torre
6193f58dd2 Test for faulty gzip headers scenario 2018-08-10 12:15:31 +02:00
Rafa de la Torre
d40cdd8d37 Modify python code example to really stream data
And add a remark about headers and query/schema inference.
2018-08-02 17:43:07 +02:00
Rafa de la Torre
a9dbde7877
Merge pull request #526 from CartoDB/fix-copy-docs
Fix copy docs
2018-07-31 16:52:40 +02:00
Rafa de la Torre
f2b38bd661 Use https in all examples 2018-07-31 15:59:15 +02:00
Rafa de la Torre
1037241e0a Clarification about table creation
We got some internal feedback about the difficulties in cartodbfy'ing a
table. We also got some feedback telling us about the ambiguity of the
table creation need.

We want to make it clear and straightforward so that people don't find
roadblocks when following the examples.
2018-07-31 15:56:17 +02:00
Rafa de la Torre
bdb3b9fbaa
Merge pull request #522 from CartoDB/521-test-robustness-pgbouncer
521 test robustness pgbouncer
2018-07-30 12:47:41 +02:00
Rafa de la Torre
942b0073d8 Please jshint
As suggested by jshint:
- Remove the unused `res` return value
- Add a semicolon at the end of the file
2018-07-30 12:36:16 +02:00
Rafa de la Torre
2afe845d78 More descriptive comment about the intent of the code
As suggested in review comment.
2018-07-30 12:34:29 +02:00
Rafa de la Torre
bf1d5bf3b4 Early return instead of if/else
As suggested in review comment.
2018-07-30 12:31:57 +02:00
Rafa de la Torre
de1157354c
Merge pull request #525 from CartoDB/copy-configs-tweak
Copy configs tweak
2018-07-26 18:10:46 +02:00
Rafa de la Torre
a709e8f26f Set the default copy_from_max_post_size to 2 GB
Set the default copy_from_max_post_size to exactly 2 GB, as the nginx
limitation has been removed for that endpoint. So, the application is
now in control and this keeps the code clear and clean.
2018-07-26 12:52:20 +02:00
Rafa de la Torre
0a7edc2e11 Add missing COPY config parameters to staging.js.example
I forgot to add these to the staging example file and missed them when
testing config changes there.

Related to https://github.com/CartoDB/CartoDB-SQL-API/pull/523
2018-07-26 12:46:05 +02:00
Rafa de la Torre
7277143c27 Merge remote-tracking branch 'origin/master' into 521-test-robustness-pgbouncer 2018-07-25 15:07:55 +02:00
Rafa de la Torre
097900f00d Stub next version 2018-07-25 10:00:13 +02:00
Rafa de la Torre
d53b7bb5f9 Release version 2.2.0 2018-07-25 09:55:56 +02:00
Rafa de la Torre
e00ab734cd
Merge pull request #523 from CartoDB/copy-limits-rework
Copy limits rework
2018-07-25 09:45:22 +02:00
Rafa de la Torre
82348a79a5 Remove unnecessary metrics.end(null, err)
As per comment in PR
2018-07-24 14:36:39 +02:00
Rafa de la Torre
19c9c15969 Replace let by const in pseudo-constant conditional assignment 2018-07-23 18:41:27 +02:00