cartodb/CartoDB-SQL-API
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
3,261 Commits 1 Branch 118 Tags 9.7 MiB
master
Commit Graph

79 Commits

Author SHA1 Message Date
Daniel García Aubert
062000b50e fix: linter 2021-09-02 12:59:42 +02:00
Daniel García Aubert
277400660a fix: use a command timeout as fallback when user's render timeout is deactivated (render timeout === 0) 2021-09-02 12:49:13 +02:00
Daniel García Aubert
53f69dd6e4 fix: add cdb-user field to data ingestion and batch queries logs 2021-04-08 17:05:34 +02:00
Daniel García Aubert
5cedad09c1 Merge branch 'master' into feature/ch145435/reduce-sql-api-log-verbosity 2021-04-08 12:12:15 +02:00
Daniel García Aubert
d3d0baaac1 fix: be able to run test in development env w/o requiring a different dokerfile image 2021-04-07 19:03:09 +02:00
Daniel García Aubert
935f08c5b5 feat: reduce log verbosity 2021-04-05 16:03:33 +02:00
cgonzalez
26d9c60a40 Use a uniq value also for SHP files 2021-03-29 17:27:16 +01:00
cgonzalez
d8a74feeaf Merge branch 'master' into feature/ch139802/phl-inconsistent-errors-when-downloading 2021-03-25 11:35:19 +00:00
cgonzalez
61352eb54d Clean custom logs 2021-03-24 17:42:54 +00:00
cgonzalez
bd5c10eca9 Add 'close' event for input stream 2021-03-24 16:25:20 +00:00
cgonzalez
7974866e33 Minor changes 2021-03-24 13:47:56 +00:00
cgonzalez
cf74ef1d17 Remove 'baking' logic 2021-03-24 13:41:33 +00:00
cgonzalez
8c35f8912c Add ended logic 2021-03-24 10:55:45 +00:00
cgonzalez
acff0c0413 Test a solution 2021-03-24 10:15:27 +00:00
cgonzalez
2c1700b3bd Testing more events 2021-03-23 11:14:01 +00:00
cgonzalez
41e22df257 Test stream events 2021-03-23 10:43:21 +00:00
cgonzalez
3302cdcd9c Testing open stream event 2021-03-22 20:04:11 +00:00
cgonzalez
223c4bd775 Testing stream sting stream 'close' event 2021-03-22 19:20:53 +00:00
cgonzalez
83c291d049 More logs about stream behavior 2021-03-22 15:11:17 +00:00
cgonzalez
bfe2e5b76b Remove fallback changes 2021-03-22 14:52:16 +00:00
cgonzalez
41541c2ffd More logs around 'sendFile' 2021-03-22 13:46:57 +00:00
cgonzalez
ef882846f2 Removing useless logs 2021-03-22 13:15:45 +00:00
Alberto Hernández
42eeefd451
build onprem image (#678) 
* build onprem image

Co-authored-by: Jorge Tarrero <thedae@gmail.com>
 2021-03-22 13:39:33 +01:00
cgonzalez
f5437b42f7 Add more logs around exportation 2021-03-22 12:15:18 +00:00
cgonzalez
12cd59f3bd Add more logs 2021-03-19 12:01:22 +00:00
cgonzalez
b9d7cb7cb6 Add custom debug logs 2021-03-19 10:33:47 +00:00
Álvaro
07119ce90a
Remove hardcoded values in tests 2020-12-17 11:11:49 +01:00
Daniel García Aubert
b9834cf453 CORS: use wildcard for Access-Control-Expose-Headers and Access-Control-Allow-Headers 2020-11-05 16:50:31 +01:00
Jorge Tarrero
97310ba7ff Fix row_too_large error handling 2020-10-22 16:48:50 +02:00
Daniel García Aubert
8e0366c1ed Missing new middleware 2020-07-23 12:19:40 +02:00
Daniel García Aubert
6857a892f7 Log request with the username bound 2020-07-23 12:14:39 +02:00
Daniel García Aubert
1eae4ee41f Log stats with the username bound 2020-07-23 11:58:52 +02:00
Daniel García Aubert
df604adc2a Add request duration in milliseconds 2020-07-23 11:37:00 +02:00
Daniel García Aubert
b7ecea3201 Rename 'message' key by 'event_message' 2020-07-23 10:32:58 +02:00
Daniel García Aubert
1ae9a66f85 Adapt logger output to the new standard for the entire platform 2020-07-22 18:29:05 +02:00
Daniel García Aubert
b611b85604 Missing header 2020-07-06 11:48:10 +02:00
Daniel García Aubert
84a6432e42 Handle error coming from database, such as query statement timeout 2020-07-01 20:59:21 +02:00
Daniel García Aubert
5e0cbcb879 For copyto endpoint, log on custom event to be able able to log all the gathered info even when error 2020-07-01 20:23:16 +02:00
Daniel García Aubert
65640a4c77 Do not use logger in stream-copy module 2020-07-01 17:38:35 +02:00
Daniel García Aubert
dc6e28097f Use named params for controllers 2020-07-01 12:32:51 +02:00
Daniel García Aubert
c4db741028 Move down init-logger and profiler middlewares to controllers 2020-07-01 12:29:51 +02:00
Daniel García Aubert
72eb0379e3 Rename 2020-07-01 12:19:19 +02:00
Daniel García Aubert
c1ed382949 Merge branch 'master' into dgaubert/ch87185/log-system-revamp-sql-api 2020-06-30 17:50:10 +02:00
Daniel García Aubert
762a240890 Breaking changes: 
- Log system revamp:
  - Logs to stdout, disabled while testing
  - Use header `X-Request-Id`, or create a new `uuid` when no present, to identyfy log entries
  - Be able to set log level from env variable `LOG_LEVEL`, useful while testing: `LOG_LEVEL=info npm test`; even more human-readable: `LOG_LEVEL=info npm t | ./node_modules/.bin/pino-pretty`
  - Be able to reduce the footprint in the final log file depending on the environment
  - Use one logger for every service: Queries, Batch Queries (Jobs), and Data Ingestion (CopyTo/CopyFrom)
  - Stop using headers such as: `X-SQL-API-Log`, `X-SQL-API-Profiler`, and `X-SQL-API-Errors` as a way to log info.
  - Be able to tag requests with labels as an easier way to provide business metrics
  - Metro: Add log-collector utility (`metro`), it will be moved to its own repository. Attaching it here fro development purposes. Try it with the following command `LOG_LEVEL=info npm t | node metro`
  - Metro: Creates `metrics-collector.js` a stream to update Prometheus' counters and histograms and exposes them via Express' app (`:9145/metrics`). Use the ones defined in `grok_exporter`

Announcements:
- Profiler is always set. No need to check its existence anymore
- Unify profiler usage for every endpoint

Bug fixes:
- Avoid hung requests while fetching user identifier
 2020-06-30 17:42:59 +02:00
Álvaro Manera
0046480231 move middleware to sql-router 2020-06-22 12:51:35 +02:00
Álvaro Manera
598e7615a5 missing return on error case 2020-06-22 12:50:48 +02:00
Álvaro Manera
a4a100e65a respond with user-id and client in the headers 
added headers to the test-client callback to be able to check them
 2020-06-22 09:47:22 +02:00
Daniel García Aubert
882ac9c2bc Remove mkdirp as dep 2020-06-01 10:55:18 +02:00
Daniel García Aubert
57be7add68 Do not emit error as it closes the internal DB's connection stream and the Pool needs to keep it open to reuse the the connection 2020-05-19 09:23:48 +02:00
Daniel García Aubert
0c92fcaf96 Node.js 12 support: 
- Update `gc-stats` to version 1.4.0
- Replace `zipfile` -> `adm-zip`
- Update `libxmljs` to version 0.19.7
- Update `sqlite` to version 4.2.0
- Adapted pool acquires to the new version of `cartodb-redis`
- Adapted test to use `adm-zip`
 2020-05-18 11:32:41 +02:00