Commit Graph

27 Commits

Author SHA1 Message Date
cgonzalez
61352eb54d Clean custom logs 2021-03-24 17:42:54 +00:00
cgonzalez
bd5c10eca9 Add 'close' event for input stream 2021-03-24 16:25:20 +00:00
cgonzalez
7974866e33 Minor changes 2021-03-24 13:47:56 +00:00
cgonzalez
cf74ef1d17 Remove 'baking' logic 2021-03-24 13:41:33 +00:00
cgonzalez
8c35f8912c Add ended logic 2021-03-24 10:55:45 +00:00
cgonzalez
acff0c0413 Test a solution 2021-03-24 10:15:27 +00:00
cgonzalez
2c1700b3bd Testing more events 2021-03-23 11:14:01 +00:00
cgonzalez
41e22df257 Test stream events 2021-03-23 10:43:21 +00:00
cgonzalez
3302cdcd9c Testing open stream event 2021-03-22 20:04:11 +00:00
cgonzalez
223c4bd775 Testing stream sting stream 'close' event 2021-03-22 19:20:53 +00:00
cgonzalez
83c291d049 More logs about stream behavior 2021-03-22 15:11:17 +00:00
cgonzalez
41541c2ffd More logs around 'sendFile' 2021-03-22 13:46:57 +00:00
cgonzalez
ef882846f2 Removing useless logs 2021-03-22 13:15:45 +00:00
cgonzalez
f5437b42f7 Add more logs around exportation 2021-03-22 12:15:18 +00:00
cgonzalez
12cd59f3bd Add more logs 2021-03-19 12:01:22 +00:00
cgonzalez
b9d7cb7cb6 Add custom debug logs 2021-03-19 10:33:47 +00:00
Jorge Tarrero
97310ba7ff Fix row_too_large error handling 2020-10-22 16:48:50 +02:00
Daniel García Aubert
762a240890 Breaking changes:
- Log system revamp:
  - Logs to stdout, disabled while testing
  - Use header `X-Request-Id`, or create a new `uuid` when no present, to identyfy log entries
  - Be able to set log level from env variable `LOG_LEVEL`, useful while testing: `LOG_LEVEL=info npm test`; even more human-readable: `LOG_LEVEL=info npm t | ./node_modules/.bin/pino-pretty`
  - Be able to reduce the footprint in the final log file depending on the environment
  - Use one logger for every service: Queries, Batch Queries (Jobs), and Data Ingestion (CopyTo/CopyFrom)
  - Stop using headers such as: `X-SQL-API-Log`, `X-SQL-API-Profiler`, and `X-SQL-API-Errors` as a way to log info.
  - Be able to tag requests with labels as an easier way to provide business metrics
  - Metro: Add log-collector utility (`metro`), it will be moved to its own repository. Attaching it here fro development purposes. Try it with the following command `LOG_LEVEL=info npm t | node metro`
  - Metro: Creates `metrics-collector.js` a stream to update Prometheus' counters and histograms and exposes them via Express' app (`:9145/metrics`). Use the ones defined in `grok_exporter`

Announcements:
- Profiler is always set. No need to check its existence anymore
- Unify profiler usage for every endpoint

Bug fixes:
- Avoid hung requests while fetching user identifier
2020-06-30 17:42:59 +02:00
Raúl Marín
25f15dfc61 Fix an ogr2ogr export issue when the temporal name is too big
If the final name is going to be too big, use the hash over the proposed
path to create an unique name that fits the requirements of path length
under Linux
2020-05-11 18:35:35 +02:00
Raúl Marín
a8d10f25ee ogr2ogr csv: Keep output consistent between gdal releases 2020-04-16 18:35:57 +02:00
Daniel García Aubert
932fd8ef55 Do not yield to the next middleware before handleQuery is done 2020-02-20 12:16:20 +01:00
Daniel García Aubert
ac4d1c4e28 eslint errors 2019-12-26 18:12:47 +01:00
Daniel García Aubert
fddc76b542 Eslint errors 2019-12-26 18:01:38 +01:00
Daniel García Aubert
014158c968 Eslint errors 2019-12-26 17:46:27 +01:00
Daniel García Aubert
ac7d60d97d Fix lint errors 2019-12-26 14:51:09 +01:00
Daniel García Aubert
5a96dbb59c Run eslint --fix 2019-12-23 18:19:08 +01:00
Daniel García Aubert
06a47a8afc Changed folder structure to reflect application functionallity. Renamed files using hyphens instead of underscore to have a more consistent naming across the whole project 2019-10-03 18:24:39 +02:00