Simon Martín
|
3d30f1f762
|
trailing white spaces
|
2018-06-19 10:34:52 +02:00 |
|
Simon Martín
|
30402f2e89
|
remove unused statsClient
|
2018-06-19 10:04:17 +02:00 |
|
Simon Martín
|
7727a9d506
|
data ingestion logger created in controller and added to app
|
2018-06-18 18:48:11 +02:00 |
|
Simon Martín
|
8a450a862c
|
recover the metrics header (needed for tests purposes)
|
2018-06-15 13:25:47 +02:00 |
|
Simon Martín
|
9097cbe16e
|
adding log of the error when headers are already sent
|
2018-06-14 18:29:50 +02:00 |
|
Simon Martín
|
b091a375fc
|
fix ensuring right validation error
|
2018-06-14 10:49:36 +02:00 |
|
Simon Martín
|
1f31b8e2ae
|
removing old copy logs
|
2018-06-14 10:45:23 +02:00 |
|
Daniel García Aubert
|
9299fe51ce
|
Add todo
|
2018-06-14 01:01:05 +02:00 |
|
Daniel García Aubert
|
9c8d802f75
|
Chain response event callbacks after .pipe() in order to improve readability in copyto controller
|
2018-06-14 00:31:08 +02:00 |
|
Daniel García Aubert
|
508d688b9d
|
Use request 'close' event when the request is closed unexpectedly by the client
|
2018-06-14 00:16:06 +02:00 |
|
Daniel García Aubert
|
bd8e4be596
|
Do not emit to regist the number of rows processed in copyfrom
|
2018-06-13 20:11:39 +02:00 |
|
Daniel García Aubert
|
5655f26fbd
|
Do not emit to regist the number of rows processed in copyto
|
2018-06-13 20:06:35 +02:00 |
|
Daniel García Aubert
|
e6a331433a
|
Handle error when client disconnects in copyto requests
|
2018-06-13 19:54:34 +02:00 |
|
Daniel García Aubert
|
6aba1ea307
|
Handle error when sql injected in pgstream fails (e.g: unexisting table)
|
2018-06-13 19:52:53 +02:00 |
|
Daniel García Aubert
|
2792d95c41
|
Do not handle stream unpiping when it wasn't even created
|
2018-06-13 18:30:05 +02:00 |
|
Simon Martín
|
270daae579
|
removing forgotten callback
|
2018-06-12 18:40:51 +02:00 |
|
Simon Martín
|
409273bafe
|
removing 2nd calback using events
|
2018-06-12 18:39:50 +02:00 |
|
Simon Martín
|
19aae3c40f
|
manage pgstrem error on stream copy class
|
2018-06-12 17:04:44 +02:00 |
|
Simon Martín
|
ba2f85421d
|
StreamCopy to class
|
2018-06-12 16:56:18 +02:00 |
|
Simon Martín
|
8a15b2f8d1
|
Merge branch 'master' into pgcopy-stream-refactor2
|
2018-06-12 15:21:28 +02:00 |
|
Simon Martín
|
4d99872975
|
return in next err
|
2018-06-12 15:18:28 +02:00 |
|
Simon Martín
|
b9a0fa78d2
|
adding metadataBackend to user middleware in copycontroller
|
2018-06-11 14:55:37 +02:00 |
|
Simon Martín
|
df63e0eedb
|
adding log of the error when headers are already sent
|
2018-06-11 13:19:12 +02:00 |
|
Simon Martín
|
2995676adb
|
let to const
|
2018-06-11 12:56:16 +02:00 |
|
Simon Martín
|
4fab96cb3a
|
rename gzip to isGzip
|
2018-06-11 12:55:30 +02:00 |
|
Simon Martín
|
87fd9db1fe
|
remove uneeded comment
|
2018-06-11 12:43:35 +02:00 |
|
Simon Martín
|
2581ddbfb4
|
better formatting
|
2018-06-08 17:09:28 +02:00 |
|
Simon Martín
|
6a9e7d7c14
|
forgotten )
|
2018-06-08 17:04:10 +02:00 |
|
Simon Martín
|
7266b3c708
|
one logger
|
2018-06-08 17:02:31 +02:00 |
|
Simon Martín
|
014f0a1491
|
refactor of copy to PoC
|
2018-06-08 16:58:32 +02:00 |
|
Simon Martín
|
f7454228c6
|
refactor of copy from PoC
|
2018-06-08 16:50:12 +02:00 |
|
Simon Martín
|
e259a51623
|
unifiyng to see 'the forest'
|
2018-06-08 15:03:21 +02:00 |
|
Simon Martín
|
8e8ccc9c67
|
removing old metrics in copy
|
2018-06-08 13:33:17 +02:00 |
|
Simon Martín
|
c62ef15dda
|
using StreamCopy in controller
|
2018-06-08 11:15:23 +02:00 |
|
Simon Martín
|
2bcea0484a
|
rename BunyanLogger to Logger
|
2018-06-08 10:59:34 +02:00 |
|
Simon Martín
|
1cf7032c9a
|
adding user and date in copy logs
|
2018-06-04 18:08:34 +02:00 |
|
Simon Martín
|
008fad3d13
|
undo 'ensuring data ingestion log'
|
2018-05-29 12:45:57 +02:00 |
|
Simon Martín
|
e092647246
|
ensuring data ingestion log
|
2018-05-28 11:25:09 +02:00 |
|
Simon Martín
|
7d32ae293f
|
rename buyan_logger file name
|
2018-05-28 11:18:30 +02:00 |
|
Simon Martín
|
3cf28bb7ff
|
jshint happy
|
2018-05-25 18:50:56 +02:00 |
|
Simon Martín
|
22caa049ee
|
StreamCopyMetrics
|
2018-05-25 18:47:41 +02:00 |
|
Simon Martín
|
b31984cbc6
|
simplify response
|
2018-05-25 17:57:40 +02:00 |
|
Simon Martín
|
1fa5afd759
|
unify error handler
|
2018-05-25 17:50:59 +02:00 |
|
Simon Martín
|
6c3f9cf1d3
|
simplify controllers
|
2018-05-25 17:42:30 +02:00 |
|
Simon Martín
|
fd70673d88
|
more details
|
2018-05-25 16:46:25 +02:00 |
|
Simon Martín
|
8a2c777577
|
details
|
2018-05-25 16:00:27 +02:00 |
|
Simon Martín
|
9b0b92fb6b
|
removing try catch
|
2018-05-25 15:46:12 +02:00 |
|
Simon Martín
|
5bed04a38c
|
fix gzip problem with req close event
|
2018-05-25 15:34:30 +02:00 |
|
Simon Martín
|
fe3bd4fd37
|
handling errors from request in COPYfrom
|
2018-05-25 14:33:54 +02:00 |
|
Simon Martín
|
e2bba967f9
|
handling copyto errors
|
2018-05-24 19:48:24 +02:00 |
|
Simon Martín
|
fca6ee8232
|
changing name of dataIngestionLogPath
|
2018-05-23 17:32:44 +02:00 |
|
Simon Martín
|
b2a36eb556
|
copy metrics with BunyanLogger
|
2018-05-23 17:25:46 +02:00 |
|
Simon Martín
|
5ba7dca79c
|
copyfrom metrics to kibana
|
2018-05-23 10:30:37 +02:00 |
|
Paul Ramsey
|
f77707f6da
|
Fix reponse copy from
|
2018-05-22 10:48:11 -04:00 |
|
Paul Ramsey
|
a4654f82b2
|
Merge branch 'pgcopy-stream' of github.com:CartoDB/CartoDB-SQL-API into pgcopy-stream-q
|
2018-05-22 10:37:50 -04:00 |
|
Paul Ramsey
|
ed696a96ec
|
Merge branch 'pgcopy-stream' of github.com:CartoDB/CartoDB-SQL-API into pgcopy-stream-q
|
2018-05-22 10:23:04 -04:00 |
|
Simon Martín
|
6d73d97ae2
|
copyFrom metrics to statsd
|
2018-05-22 16:02:14 +02:00 |
|
Simon Martín
|
e347985465
|
changing query parameter name from sql to q
unify query validatrion
|
2018-05-22 15:42:57 +02:00 |
|
Simon Martín
|
b9474e7fc3
|
total_rows in copyto metrics
|
2018-05-22 15:29:08 +02:00 |
|
Simon Martín
|
185f708d5b
|
small style refactor
|
2018-05-22 14:15:55 +02:00 |
|
Simon Martín
|
f01191472b
|
refactoring copy controller middlewares
|
2018-05-22 11:56:50 +02:00 |
|
Simon Martín
|
433bd01c27
|
copyto metrics
|
2018-05-22 11:54:10 +02:00 |
|
Simon Martín
|
81be15fbc3
|
adding format to copy metrics
|
2018-05-21 19:13:44 +02:00 |
|
Paul Ramsey
|
64fc0c32e3
|
Change from 'sql' as query parameter to 'q', aping existing sql api
|
2018-05-21 07:47:16 -07:00 |
|
Simon Martín
|
816779fefd
|
erratum
|
2018-05-18 17:32:59 +02:00 |
|
Simon Martín
|
82c9fec18a
|
copy from metrics
|
2018-05-18 17:31:29 +02:00 |
|
Simon Martín
|
bc8a867334
|
jshinty happy
|
2018-05-11 14:51:43 +02:00 |
|
Simon Martín
|
f2acc8f653
|
forgotten log
|
2018-05-11 14:16:26 +02:00 |
|
Simon Martín
|
eee8bc2674
|
moving copyto headers to correct position
|
2018-05-11 14:12:23 +02:00 |
|
Simon Martín
|
791967877c
|
addining gzip support to copyfrom
|
2018-05-11 13:33:54 +02:00 |
|
Simon Martín
|
f749798ca5
|
validating inputs
|
2018-05-11 10:38:33 +02:00 |
|
Paul Ramsey
|
8f211f905c
|
Remove wrong examples
|
2018-05-10 12:21:33 -07:00 |
|
Paul Ramsey
|
f0021264d2
|
Change from form-multipart to POST with chunked upload
|
2018-05-10 12:11:55 -07:00 |
|
Simon Martín
|
82d14ab98f
|
busboy configuration
|
2018-05-08 13:15:19 +02:00 |
|
Simon Martín
|
7c4409bcf5
|
from var to const/let
|
2018-05-08 13:10:25 +02:00 |
|
Simon Martín
|
c40ab801b1
|
refactoring handleCopyTo
|
2018-05-08 13:08:29 +02:00 |
|
Simon Martín
|
b036b876ff
|
using Busboy instead of multer
|
2018-05-08 12:52:33 +02:00 |
|
Simon Martín
|
2b066eadfa
|
removing unused dependencies
|
2018-05-04 15:35:23 +02:00 |
|
Simon Martín
|
4322ccdd09
|
adding new endpoints to rate limits
|
2018-05-03 18:50:13 +02:00 |
|
Simon Martín
|
af4c5906c8
|
adding /sql tro the endpoints
|
2018-05-03 18:31:49 +02:00 |
|
Paul Ramsey
|
e2d8896307
|
Typo in curl example
|
2018-04-27 12:32:47 +02:00 |
|
Paul Ramsey
|
5f9cc37dba
|
Jshint change, DRY the content-disposition handler
|
2018-04-27 12:19:53 +02:00 |
|
Paul Ramsey
|
fe52af71ac
|
Add documentation SQL API copyfrom/copyto end points,
and make small modifications arising from that task
|
2018-04-27 11:55:06 +02:00 |
|
Paul Ramsey
|
c78cac9bd6
|
Use the correct database credentials, so we obey security
|
2018-04-26 10:45:52 +02:00 |
|
Paul Ramsey
|
f13028b497
|
More jshint changes
|
2018-04-26 10:20:21 +02:00 |
|
Paul Ramsey
|
cc5fa5c6ce
|
Changes suggested by jshint
|
2018-04-26 10:04:38 +02:00 |
|
Paul Ramsey
|
ea66076255
|
Remove 'console.debug', try and get travis tests clean
|
2018-04-26 09:40:13 +02:00 |
|
Paul Ramsey
|
a98781d335
|
Working code for /copyfrom (streaming) and /copyto (streaming)
|
2018-04-25 18:37:04 +02:00 |
|
Paul Ramsey
|
b59bda5780
|
Get working copyto implementation in place. Many test cases
needed still and thoughts on how to communicate errors back
that are maybe nicer than stack messages?
|
2018-04-24 15:55:20 +02:00 |
|
Paul Ramsey
|
4914100205
|
CopyFrom works, but still needs a decent return payload and
a lot of work on returning useful information for error cases (post empty input,
db errors returned more nicely? etc)
|
2018-04-24 13:07:57 +02:00 |
|
Paul Ramsey
|
72bce5732b
|
WIP on /copyfrom
|
2018-04-24 11:26:15 +02:00 |
|
Rafa de la Torre
|
2229d0ee57
|
Fix jshint issues
|
2018-04-13 16:36:43 +02:00 |
|
Paul Ramsey
|
0161696627
|
Update copy_controller.js
|
2018-04-13 05:43:23 -07:00 |
|
Paul Ramsey
|
d54e2f5a07
|
Implementation including multer, custom storage engine, and pg-copy,
but without turning over pg-copy, and demonstrating the missing 'sql'
parameter in the custom storage engine.
|
2018-04-12 12:25:28 -07:00 |
|