Commit Graph

70 Commits

Author SHA1 Message Date
Esther Lozano
419adea234
Add pubsub metrics (#642)
* Create middleware and service for pubsub metrics

* Use pubsub middleware for all request

* Replace isEnabled with isDisabled to avoid negation

* Use new headers names

* Add acceptance and unit tests

* Remove commented log calls

* Remove only filters in tests

Remove typo

* Refactor service to ease integration test

* Fix interaction with query controller

* Use middleware at api-router and test all controllers

* Rename user middleware function

* Use sinon latest version

* Create middleware and service for pubsub metrics

* Use pubsub middleware for all request

* Replace isEnabled with isDisabled to avoid negation

* Use new headers names

* Add acceptance and unit tests

* Remove commented log calls

* Remove only filters in tests

Remove typo

* Refactor service to ease integration test

* Fix interaction with query controller

* Use middleware at api-router and test all controllers

* Rename user middleware function

* Use sinon latest version

* Fix tests

* Fix typos

* Checks if pubsub config exists to enable the service

* Fix typo

* Normalize headers values for pubsub

* Trim fields when normalizing

* Trim fields when normalizing
2020-02-26 17:19:06 +01:00
Owayss Kabtoul
46ac8337e2 Default to stdout logging on dev environment 2019-10-17 13:02:13 +02:00
Owayss Kabtoul
51d74e0e0d Default to stdout logging on dev environment 2019-10-17 12:59:10 +02:00
Daniel García Aubert
cec1c609c0 Have a default configuration of "routes" when missing environment settings. It prevents errors while deploying (if the new setting is not available yet) 2019-10-02 17:35:34 +02:00
Daniel García Aubert
51ea2b066d Create sql-router to encapsulate common stuff from api-router. Extract WIP jobs from job-controller and attatch it to api-router.
Note: it modifies routes structure in configuration.
2019-10-02 16:02:13 +02:00
Daniel García Aubert
f71c7bc3a8 Typo 2019-10-01 17:54:09 +02:00
Daniel García Aubert
1d55de3e43 Explicit routes configuration 2019-10-01 17:45:12 +02:00
Daniel García Aubert
3dee09a5c5 Draft: be able to inject custom middlewares 2019-10-01 17:27:46 +02:00
Daniel García Aubert
46190008f5 Remove table cache 2019-07-24 17:44:04 +02:00
Daniel García Aubert
ccb0bbfb86 Set directive 'max-age' to 5 min when there are affacted tables where we can't know when were updated for the last time, e.g: non cartodified tables or foreing tables without cartodb support 2019-07-04 10:45:35 +02:00
Daniel García Aubert
4ddcc3b0e6 Set minimum input data speed default to 0 bytes 2019-05-29 11:21:22 +02:00
Daniel García Aubert
6676260b17 Implement a throttler stream to check input data speed 2019-05-28 19:24:29 +02:00
Daniel García Aubert
e643eaa4a1 Enable keepalive for conections to DB 2019-05-06 18:51:00 +02:00
Simon Martín
68aebe6b3f Merge branch 'master' into log-queries 2019-02-27 16:14:12 +01:00
Simon Martín
b35654d1f6 copy config parameters 2019-02-27 13:00:52 +01:00
Simon Martín
e145a631c1 dev parameters 2019-02-26 14:01:58 +01:00
Simon Martín
254896e666 remove query_format rate limit 2018-12-10 18:20:10 +01:00
Rafa de la Torre
a709e8f26f Set the default copy_from_max_post_size to 2 GB
Set the default copy_from_max_post_size to exactly 2 GB, as the nginx
limitation has been removed for that endpoint. So, the application is
now in control and this keeps the code clear and clean.
2018-07-26 12:52:20 +02:00
Rafa de la Torre
6053940d51 Add config for COPY FROM max POST size
You may be wondering: why it checks for 1.99 GB but it says the limit is
at 2 GB? The actual hard-limit is set in nginx, but we want the app to
catch this error condition and report it properly to the client,
hence the 0.5 % license.
2018-07-23 16:59:27 +02:00
Rafa de la Torre
17c8cbc723 Add a timeout setting for COPY commands 2018-07-20 15:32:32 +02:00
Simon Martín
fca6ee8232 changing name of dataIngestionLogPath 2018-05-23 17:32:44 +02:00
Simon Martín
b2a36eb556 copy metrics with BunyanLogger 2018-05-23 17:25:46 +02:00
Simon Martín
b373c76d8c adding parameter in config files 2018-04-24 15:54:48 +02:00
Simon Martín
35df7798ab config params 2018-03-01 11:30:58 +01:00
Simon Martín
8665caa3cb changing error log format 2017-12-12 10:55:54 +01:00
Simon Martín
1eae2e4790 adding error header to environment files 2017-11-28 17:32:29 +01:00
Rafa de la Torre
8c2e5f74df Add tableCacheEnabled setting to sample config #422 2017-06-27 13:14:13 +02:00
Raul Ochoa
14846b254e Document gc_interval configuration param 2017-04-24 18:28:10 +02:00
Daniel García Aubert
4b98b7056a Make zip command path configurable 2017-04-18 12:15:47 +02:00
Raul Ochoa
aa69bcf34c Increase to 4 the default value for fixed capacity 2016-10-20 20:16:34 +02:00
Raul Ochoa
19def2f31e Default to 2 jobs in fixed capacity. 2016-10-20 11:12:27 +02:00
Raul Ochoa
66cc137d04 Split http capacity between simple and load
- Simple will use 'available_cores' from response.
- Load will use 'cores' and 'relative_load'.
2016-10-20 11:12:08 +02:00
Raul Ochoa
0af5cf703a Allow to configure capacity strategy
- HTTP strategy: mechanism to compute load from db host.
- Fixed strategy: hardcoded number of queries to run at the same time, via configuration.
2016-10-19 18:42:53 +02:00
Raul Ochoa
66d1c18941 Default to 64 queued jobs as max 2016-10-17 15:23:53 +02:00
Raul Ochoa
1e442b37ab Allow to set a max number of queued jobs per user 2016-10-12 22:40:35 +02:00
Raul Ochoa
595d4f0918 Fix sample config for batch timeout 2016-10-10 11:10:28 +02:00
Raul Ochoa
7c7320061f Merge branch 'master' into limit-batch-queries 2016-10-06 12:46:34 +02:00
Daniel García Aubert
59e5c10f85 Set batch queries log path 2016-09-29 15:37:14 +02:00
Daniel García Aubert
4f3d361226 Fixes #356, set limit to batch queries to 12h 2016-09-13 12:32:41 +02:00
Daniel García Aubert
2932227e8b Improved naming for jobs TTL constant 2016-08-30 13:49:16 +02:00
Daniel García Aubert
31ac48ef1a Changed job's ttl to be configurable 2016-01-21 15:33:42 +01:00
Daniel García Aubert
f41c43aa38 Disabled statement timeout bypassing pgbouncer connection 2015-12-22 15:43:00 +01:00
Raul Ochoa
93e965af29 Makes ogr2ogr command configurable so it's possible to change path/bin 2015-06-16 15:53:33 +02:00
Francisco Dans
cebc568ca8 uses remote-addr in example configurations 2015-05-26 19:19:37 +02:00
Raul Ochoa
8fe4224a55 Changes configuration example base_url for subdomainless users 2015-04-08 16:14:05 +02:00
Luis Bosque
373dca0733 Added ; to the end of disabledfile config param 2015-03-25 18:28:45 +01:00
Luis Bosque
897df7634b Return failed health checks with disabled file 2015-03-25 17:15:41 +01:00
Raul Ochoa
9dcb397737 Merge pull request #205 from CartoDB/url_rewrite
added /u/:user routing
2015-03-20 12:22:07 +01:00
Raul Ochoa
a9dac76e38 Examples for configuring max size per row limit 2015-02-26 16:18:37 +01:00
Raul Ochoa
dc388ca2db Adds configuration options examples for keep alive 2015-02-19 17:27:41 +01:00