Commit Graph

3221 Commits

Author SHA1 Message Date
cgonzalez
223c4bd775 Testing stream sting stream 'close' event 2021-03-22 19:20:53 +00:00
cgonzalez
83c291d049 More logs about stream behavior 2021-03-22 15:11:17 +00:00
cgonzalez
bfe2e5b76b Remove fallback changes 2021-03-22 14:52:16 +00:00
cgonzalez
41541c2ffd More logs around 'sendFile' 2021-03-22 13:46:57 +00:00
cgonzalez
ef882846f2 Removing useless logs 2021-03-22 13:15:45 +00:00
cgonzalez
f5437b42f7 Add more logs around exportation 2021-03-22 12:15:18 +00:00
cgonzalez
12cd59f3bd Add more logs 2021-03-19 12:01:22 +00:00
cgonzalez
b9d7cb7cb6 Add custom debug logs 2021-03-19 10:33:47 +00:00
Alberto Hernández
62558e1c7f
add dev-env tests (#676)
* add dev-env tests

Co-authored-by: alberhander <albertoh@carto.com>
2021-03-04 11:02:09 +01:00
Alberto Hernández
206f689a74
Merge pull request #675 from CartoDB/fix_wrong_pr_tags
update branch variable
2021-02-15 10:49:16 +01:00
alberhander
02ebf045b9 update branch variable 2021-02-15 10:36:15 +01:00
Alberto Hernández
c56c66037d
Merge pull request #674 from CartoDB/add_docker_labels
add docker labels
2021-02-08 17:08:56 +01:00
alberhander
352a9e0d3c replacing slashes in docker tags 2021-02-08 16:56:43 +01:00
alberhander
4029e22cf6 add docker labels 2021-02-08 16:51:31 +01:00
Álvaro Manera
2b29d9b5b4 bump submodule 2020-12-23 07:54:20 +01:00
Álvaro Manera
ca3c277045 yaml typo 2020-12-21 13:22:39 +01:00
Álvaro Manera
48fe56676d configure docker to push 2020-12-21 13:13:17 +01:00
Álvaro
95cf0391a8
Merge pull request #673 from CartoDB/cleanUp
Run build in Github Actions
2020-12-21 09:07:18 +01:00
Álvaro Manera
3b63b28742 leftovers 2020-12-18 07:31:48 +01:00
Álvaro Manera
b7140da284 Update Readme 2020-12-17 11:16:51 +01:00
Álvaro Manera
c3bae9bc68 add submodule and run test build in Actions 2020-12-17 11:16:35 +01:00
Álvaro
07119ce90a
Remove hardcoded values in tests 2020-12-17 11:11:49 +01:00
Daniel G. Aubert
92e65ac4ba
Merge pull request #671 from CartoDB/cors-wildcards
CORS, use wildcard
2020-11-05 17:29:28 +01:00
Daniel García Aubert
b9834cf453 CORS: use wildcard for Access-Control-Expose-Headers and Access-Control-Allow-Headers 2020-11-05 16:50:31 +01:00
Jorge Tarrero
8a630186c8
Merge pull request #670 from CartoDB/chore/ch106733/improve-sql-api-error-handling
Fix row_too_large error handling
2020-10-23 15:31:15 +02:00
Jorge Tarrero
97310ba7ff Fix row_too_large error handling 2020-10-22 16:48:50 +02:00
Rafa de la Torre
053d28edc5
Merge pull request #667 from CartoDB/feature/ch94770/node-minimal-doc-in-the-repos-about-how-to
[Node] Minimal doc in the repos about how to add new log traces
2020-08-04 09:20:23 +02:00
Rafa de la Torre
3384719ea9 Add a markdown explaining how the logger works 2020-08-03 16:19:21 +02:00
Alberto Asuero
b28835ff56 Adding docker ressources to .gitignore 2020-07-28 09:00:27 +00:00
Daniel G. Aubert
ad2e37e89e
Merge pull request #666 from CartoDB/feature/ch91877/remove-log-aggregation-in-metro
Adapt logger output to the new standard for the entire platform
2020-07-23 13:44:24 +02:00
Daniel García Aubert
8e0366c1ed Missing new middleware 2020-07-23 12:19:40 +02:00
Daniel García Aubert
6857a892f7 Log request with the username bound 2020-07-23 12:14:39 +02:00
Daniel García Aubert
1eae4ee41f Log stats with the username bound 2020-07-23 11:58:52 +02:00
Daniel García Aubert
df604adc2a Add request duration in milliseconds 2020-07-23 11:37:00 +02:00
Daniel García Aubert
b7ecea3201 Rename 'message' key by 'event_message' 2020-07-23 10:32:58 +02:00
Daniel García Aubert
1ae9a66f85 Adapt logger output to the new standard for the entire platform 2020-07-22 18:29:05 +02:00
Daniel G. Aubert
36fd4a85c1
Merge pull request #663 from CartoDB/dgaubert/ch87185/log-system-revamp-sql-api
Log system revamp
2020-07-06 13:59:59 +02:00
Daniel García Aubert
b611b85604 Missing header 2020-07-06 11:48:10 +02:00
Daniel García Aubert
84a6432e42 Handle error coming from database, such as query statement timeout 2020-07-01 20:59:21 +02:00
Daniel García Aubert
5e0cbcb879 For copyto endpoint, log on custom event to be able able to log all the gathered info even when error 2020-07-01 20:23:16 +02:00
Daniel García Aubert
65640a4c77 Do not use logger in stream-copy module 2020-07-01 17:38:35 +02:00
Daniel García Aubert
dc6e28097f Use named params for controllers 2020-07-01 12:32:51 +02:00
Daniel García Aubert
c4db741028 Move down init-logger and profiler middlewares to controllers 2020-07-01 12:29:51 +02:00
Daniel García Aubert
72eb0379e3 Rename 2020-07-01 12:19:19 +02:00
Daniel García Aubert
c31f4c9c25 Use the right port for sql-api prometheus metrics 2020-07-01 10:54:11 +02:00
Daniel García Aubert
d3a1974569 Lint 2020-07-01 10:53:44 +02:00
Daniel García Aubert
c1e02c2c95 Use the latest version of metro 2020-06-30 19:41:36 +02:00
Daniel García Aubert
c1ed382949 Merge branch 'master' into dgaubert/ch87185/log-system-revamp-sql-api 2020-06-30 17:50:10 +02:00
Daniel García Aubert
762a240890 Breaking changes:
- Log system revamp:
  - Logs to stdout, disabled while testing
  - Use header `X-Request-Id`, or create a new `uuid` when no present, to identyfy log entries
  - Be able to set log level from env variable `LOG_LEVEL`, useful while testing: `LOG_LEVEL=info npm test`; even more human-readable: `LOG_LEVEL=info npm t | ./node_modules/.bin/pino-pretty`
  - Be able to reduce the footprint in the final log file depending on the environment
  - Use one logger for every service: Queries, Batch Queries (Jobs), and Data Ingestion (CopyTo/CopyFrom)
  - Stop using headers such as: `X-SQL-API-Log`, `X-SQL-API-Profiler`, and `X-SQL-API-Errors` as a way to log info.
  - Be able to tag requests with labels as an easier way to provide business metrics
  - Metro: Add log-collector utility (`metro`), it will be moved to its own repository. Attaching it here fro development purposes. Try it with the following command `LOG_LEVEL=info npm t | node metro`
  - Metro: Creates `metrics-collector.js` a stream to update Prometheus' counters and histograms and exposes them via Express' app (`:9145/metrics`). Use the ones defined in `grok_exporter`

Announcements:
- Profiler is always set. No need to check its existence anymore
- Unify profiler usage for every endpoint

Bug fixes:
- Avoid hung requests while fetching user identifier
2020-06-30 17:42:59 +02:00
Álvaro
5caba983b1
Merge pull request #660 from CartoDB/clientHeaders
respond with user-id and client in the headers
2020-06-23 17:56:20 +02:00