cartodb/Windshaft-cartodb
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
6,214 Commits 1 Branch 311 Tags 39 MiB
6cad976078
Commit Graph

208 Commits

Author SHA1 Message Date
Raul Ochoa
c84ed0a4b4 Merge branch 'master' into pgraster 
Conflicts:
	npm-shrinkwrap.json
	package.json
 2014-11-05 14:54:59 +01:00
Raul Ochoa
6325a23bb4 Adds default value for raster overviews configuration 2014-11-05 12:48:26 +01:00
Raul Ochoa
c88330f5f2 Allow a different cache-control max-age for layergroup responses 2014-10-24 16:05:41 +02:00
Raul Ochoa
e3d0f0ec8f Adds default value for redis returnToHead configuration 2014-10-17 14:18:14 +02:00
Raul Ochoa
cf5e34eae6 Upgrades Windshaft to start reporting redis/renderers/mapnik pool metrics 2014-10-15 16:45:49 +02:00
Raul Ochoa
98967cdf88 Be more clear about the effect of the statusInterval number 2014-10-15 16:25:35 +02:00
Raul Ochoa
ceb1bb7f50 Document what emitter.statusInterval is. 2014-10-15 16:20:51 +02:00
Raul Ochoa
20cb559714 Merge branch 'master' into one-redis-mpool 2014-10-15 11:44:38 +02:00
Raul Ochoa
f4cb87f493 Adds default values for slow queries in redis 2014-10-14 22:14:34 +02:00
Raul Ochoa
804088009e Report to statsd the status of redis pools 2014-10-14 22:12:35 +02:00
Raul Ochoa
d89b2986fd Allow to add more node.js' threadpool workers via process.env.UV_THREADPOOL_SIZE 2014-10-08 16:50:35 +02:00
Sandro Santilli
e9f5c60719 Use a windshaft-specific name for the test user 
Avoids problems with running cartodb-sql-api tests after
windshaft-cartodb tests (as the test database is not cleaned up)
 2014-10-08 10:31:32 +02:00
Raul Ochoa
713e394e7b Slow pool configuration in example configurations 2014-08-13 15:15:30 +02:00
Raul Ochoa
2ed656ca0d Upgrades windshaft (and grainstore) to be able to specify the tile 
format, see: https://github.com/mapnik/mapnik/wiki/OutputFormats
 2014-08-07 01:57:21 +02:00
Sandro Santilli
5a4a35b665 Fix documentation for redis.max setting 
Closes #192
 2014-04-16 17:53:42 +02:00
Sandro Santilli
312194228a Stop duplicating global.environment as global.settings 2014-03-28 18:47:59 +01:00
Sandro Santilli
5c1125900b Add support for log_filename directive, reopen logfile on SIGHUP 2014-03-28 18:05:18 +01:00
Sandro Santilli
e8367b765a Add persist_connection setting in .example configs 2014-03-24 17:40:43 +01:00
Sandro Santilli
91cd0df7b3 Typo in comment 2014-03-24 17:03:32 +01:00
Sandro Santilli
60b552027b Add optional support for rollbar 
Re-targets to 1.10.0
Also installs an uncaught exception handler

Closes #150
 2014-03-12 17:21:35 +01:00
javi
5bfc360856 added serverMetadata option for layer group, close #182 CDB-1940 2014-03-06 15:19:12 +01:00
Sandro Santilli
dbae0eeb31 It is "cacheDns", not "dnsCache" 
See https://github.com/sivy/node-statsd/issues/38
 2014-03-04 17:37:19 +01:00
Sandro Santilli
bd9a21b805 Add "dnsCache" statsd setting in the example configs 2014-03-04 16:52:16 +01:00
Sandro Santilli
f284362988 Reduce sql-api communication timeout, and allow overriding it 
Introduces new sqlapi.timeout directive, defaults to 100 ms
Includes testcase.
Closes #167
 2014-02-27 10:33:32 +01:00
Sandro Santilli
36628ce78e Also enable the profiler in the example test config 
This is again for #157 without closing it
 2014-02-21 17:06:29 +01:00
Sandro Santilli
d2d7bba357 Add statsd prefix in test example config 
Still doesn't add automated testing (#157) but makes manual
testing easier.
 2014-02-21 16:57:02 +01:00
Sandro Santilli
6824c09916 Change example test user and database names 
This is to avoid a clash with cartodb test databases
 2014-02-20 18:03:43 +01:00
Sandro Santilli
09ea924eb2 Allow using GET with sql-api for queries shorter than configured len 
Introduces new sqlapi.max_get_sql_length directive, defaults to 2048.
Closes #155
Includes testcases.
 2014-02-20 10:17:48 +01:00
Sandro Santilli
019540e622 Set example statsd prefix with :host placeholder 2014-02-19 16:16:39 +01:00
Sandro Santilli
1f552a9e24 Do not duplicate date in logs (already injected by logger) 2014-02-19 11:16:37 +01:00
Sandro Santilli
69693acea0 Add statsd prefix in example configs 2014-02-18 10:38:15 +01:00
Sandro Santilli
4c0ab92771 Default to installed mapnik_version during testing 
See https://github.com/CartoDB/Windshaft/issues/117
 2014-02-18 09:55:00 +01:00
Sandro Santilli
8401dcf6d7 Use /api/v1/map route for unified map api in the examples 
Closes #146
 2014-02-17 16:29:23 +01:00
Sandro Santilli
8e323a6c07 Remove more commas (see previous commit) 2014-02-14 16:08:32 +01:00
xavijam
d50c6c6dc3 close #144 - removed unnecessary comma 2014-02-14 13:12:52 +01:00
Sandro Santilli
678d653ee9 Allow configuring TTL of mapConfigs via "mapConfigTTL" 2014-02-13 15:44:54 +01:00
Sandro Santilli
e4cd37647e Allow limiting number of allowed user templates 
Adds maxUserTemplates directive.
Closes #136
 2014-02-13 14:55:31 +01:00
Sandro Santilli
bf45bbea56 Do not send multiple equal commands to Varnish on connect 
Closes #135
Also accept varnish "secret" in config
 2014-02-12 16:14:27 +01:00
Sandro Santilli
cdbcc7dc18 Put statsd config in all example configs 2014-02-12 16:01:50 +01:00
javi
c421ea6bfc added basic statsd cnfiguration options in sample file #139 2014-02-12 15:33:41 +01:00
Sandro Santilli
9018e39762 Make endpoints configurable 
Closes #127
Uses /api/v1/maps* in the production and staging example configs,
keeps /maps* for development and test (they are examples...)
 2014-02-05 15:14:47 +01:00
Sandro Santilli
db478579c5 Fix example development configuration to avoid use of empty sqlapi.domain 
This is because as of CartoDB-SQL-API-1.8.2 the "user_from_host"
default configuration for "development" environment is:

  '^(.*)\\.localhost'

Which would not match a domain-less hostname

Closes #117 for real now.
 2014-01-30 16:56:23 +01:00
Sandro Santilli
ca4f3d2025 Re-introduce sqlapi.host directive, allowing DNS lookups drop 
For backward compatibility, sqlapi.host is only used if domain
is also defined and has a different value (empty string allowed).

Closes #117
 2014-01-30 16:12:37 +01:00
Sandro Santilli
1f693c6c78 Add 'user_from_host' directive to generalize username extraction 
Closes #100
Default extractor is backward compatible
 2013-12-17 17:17:17 +01:00
Sandro Santilli
53d03e82ab Set test redis port to 6335 2013-12-17 17:17:15 +01:00
Sandro Santilli
dd48aa73e2 Improve documentation for postgres_auth_* configuration directives 2013-12-17 17:17:15 +01:00
Sandro Santilli
baa95a62d1 Add support for reading user-specific database_password from redis 
This commits adds support for CartoDB-2.5.0 model.
Closes #89.
Change is backward compatible.
 2013-12-17 17:17:14 +01:00
Sandro Santilli
eb51d18012 Add support for specifying database connection passwords 2013-12-17 17:17:13 +01:00
Sandro Santilli
633e8d164b Rename sqlapi.host configuration to sqlapi.domain. Closes #79. 
Support for "host" is retained for backward compatibility.
 2013-08-21 10:11:30 +02:00
Sandro Santilli
db951234aa Add note about cache dir need to be writable by server user 
As per
https://groups.google.com/d/msg/cartodb/z06r9SwaoOM/b34In4TTdd0J
 2013-08-21 10:04:43 +02:00
Sandro Santilli
7cb69d1db9 Add example of including profile in response log line 2013-07-18 09:53:59 +02:00
Sandro Santilli
ec97381820 Add more timing in the profile, add useProfiler config variable 
Default to useProfiler:true in staging and development
 2013-07-16 16:33:03 +02:00
Sandro Santilli
e8cbc666e2 Handle SQL API errors by logging them and requesting NO cache 
SQL api is used to determine the list of source tables affected
by a query. Before this commit, the X-Cache-Channel header set
on sql api error was an arbitrary 'table' string, now the header
is omitted, the error logged and Cache-Control and Pragma headers
are sent as an attempt to request no caching.

The code includes test for this mechanism.
 2013-03-13 10:39:00 +01:00
Sandro Santilli
f6d50fafb1 Expose renderer settings in the environment config files 
These are: metatile, bufferSize and cache_ttl
 2013-02-25 17:05:59 +01:00
Sandro Santilli
14e3ead06e Add redis.max configuration setting and document it. 2013-02-21 12:56:04 +01:00
Sandro Santilli
61f4212ba2 Remove use of ANSI colors from all example log formats 2013-01-30 12:59:05 +01:00
Sandro Santilli
2510a47262 Add maxConnection environment configuration, have it default to 128 
The number gives the maximum number of contemporary connections and
is dimensioned on the limit of open file descriptors found to be
needed on a per-connection basis.
 2013-01-29 17:36:50 +01:00
Sandro Santilli
42b3d0ab9c Add redis timeout and reap interval options in production.js.example 
Use default values, for documentation purposes
 2013-01-29 13:01:17 +01:00
Sandro Santilli
cc91e0dcff Add a row limitof 65535 (256x256) in the example configs. 
Closes #64
 2012-12-07 20:34:24 +01:00
Sandro Santilli
b884fe00ea The parameter to simplify geometries is "simplify_geometries" 
Closes #63
 2012-12-07 19:50:57 +01:00
Sandro Santilli
4f8b855f1f Add reference to the list of accepted parameters for the postgres section 2012-12-07 18:58:31 +01:00
Sandro Santilli
6f5e3837e3 Use an env config parameter for socket timeout 2012-12-05 13:59:20 +01:00
Sandro Santilli
69508f05d7 Reduce default extent to allow for consistent proj4 round-tripping 
See https://github.com/Vizzuality/grainstore/issues/42
 2012-11-29 10:20:37 +01:00
Sandro Santilli
a0cd4354a7 Enlarge default map extent 
See https://github.com/Vizzuality/grainstore/issues/42
 2012-11-28 11:24:04 +01:00
Sandro Santilli
bbdc29faae Set max_size=500 in the example configurations 
TODO: add a ./configure switch to set it
 2012-11-27 18:30:08 +01:00
Sandro Santilli
52303e7821 Fix use of "style_version" with GET (inline styles) 
It took a lot of time to produce a testcase for this as the test
config was setting srid to 4326 but not changing geom column name
thus all tiles fetched by tests returned blank (ouch!)
 2012-11-06 12:45:04 +01:00
Sandro Santilli
9cdd2800fa Use "undefined" mapnik_version in the example configs 
Using "undefined" for mapnik_version triggers autodetection,
which is more appropriate.
 2012-10-09 12:12:33 +02:00
Sandro Santilli
961269fa1f Autodetect target mapnik version and let config override it 
Closes #40
 2012-10-08 17:45:03 +02:00
Sandro Santilli
a201888fde Make logging format configurable (closes #4) 
NOTE: the default format for the "test" environment is without
ansi colors, to be easier on remote terminal sessions
 2012-10-05 15:52:51 +02:00
Sandro Santilli
5ae864a3c8 Remove config files from repo, provide ./configure script to generate 
Closes #34
 2012-10-05 15:50:40 +02:00
Sandro Santilli
dd34fc507a Automated localization of external resources referenced in carto 2012-09-19 18:52:13 +02:00
Sandro Santilli
b469d5eabf Rename authenticated postgresql user configuration setting 
See issue #49
 2012-09-05 15:49:10 +02:00
Sandro Santilli
4a95342636 Add staging environment file 2012-09-04 10:52:42 +02:00
Sandro Santilli
87b0e07815 Expose Varnish cache TTL in configuration. Closes #46 2012-09-03 18:57:35 +02:00
Sandro Santilli
de275bfc50 Delegate user permission to PostgreSQL (closes #18) 
If the request is authenticated (with map_key) then we log as the
database owner, otherwise we log as the default user.
The default user is now "publicuser" by default.

Raises dependency on Windshaft to 0.4.9+, to get the grainstore
version allowing override of database username.

Add test for req2params function, particularly authentication,
Add test for authenticated / unauthenticated access
 2012-07-18 11:09:17 +02:00
Sandro Santilli
a85302e28b Use redis in port 6333 for testing (see #27) 2012-07-09 18:55:25 +02:00
Simon Tokumine
f95e15e6fe remove max_size from test 2012-06-06 15:25:39 +01:00
Simon Tokumine
cea22f438c Merge branch 'master' of github.com:Vizzuality/Windshaft-cartodb 2012-06-06 15:24:55 +01:00
Simon Tokumine
98e5bab8e4 commenting and removal of bogus config. also disable cache in test environment 2012-06-06 15:24:44 +01:00
Sandro Santilli
604fd58f2e Override grainstore "extent" to be full webmercator 
See https://github.com/Vizzuality/cartodb/issues/737
 2012-06-05 19:18:45 +02:00
Sandro Santilli
0a305a9751 Do not set postgresql.max_size=0, doesn't work as expected (#16) 2012-05-07 18:51:21 +02:00
Sandro Santilli
5ea5d7707f Have development env use the_geom_webmercator, matching production 2012-05-07 18:30:43 +02:00
Simon Tokumine
4078098c3f enable cache clearing at table level granularity 2012-05-02 19:32:54 +01:00
Simon Tokumine
d5759db8ca cache enabled in settings 2012-05-01 19:02:50 +01:00
Simon Tokumine
d1226992c3 clean up environment settings 2012-05-01 19:00:14 +01:00
Simon Tokumine
36d2f00618 tidy settings 2012-04-01 18:15:35 +01:00
Simon Tokumine
64bb864d5a Merge branch 'master' of github.com:Vizzuality/Windshaft-cartodb 2012-04-01 18:14:17 +01:00
Simon Tokumine
bbff84d162 make tiler work from the_geom in development and enable simplification 2012-04-01 18:14:05 +01:00
Luis Bosque
d084c07080 by default cluster.js binds to 127.0.0.1 instead of 0.0.0.0 2012-02-09 16:41:16 +01:00
Simon Tokumine
ef15f4b48b migrated to node-varnish, fixed tests, refactor 2011-12-12 18:02:10 +00:00
Simon Tokumine
d373124f5c update packages 2011-12-09 00:51:35 +00:00
javi
421a0a6efb Merge branch 'new_cache' 2011-12-05 15:51:31 +01:00
javi santana
8474425375 added varnish invalidation code 2011-11-30 19:59:28 +01:00
Simon Tokumine
c92d16fd5e bump windshaft 2011-11-30 17:49:08 +01:00
javi
472ed8bd79 disabled caching 2011-11-29 21:19:20 +01:00
Simon Tokumine
1bcf1f9778 enable cache 2011-11-29 20:50:32 +01:00
Simon Tokumine
6c6e907060 more in pool 2011-11-29 20:41:12 +01:00
Simon Tokumine
8730f28509 set max pool size to reasonable 2011-11-19 02:54:54 +00:00
Simon Tokumine
3e8f74c790 set max pool size to small 2011-11-19 02:54:34 +00:00
javi
102e17363f added ttl_settings 2011-10-21 17:42:57 +02:00
javi
87b04ce80a added last-modified header to tiler 2011-10-20 18:52:11 +02:00
javi santana
3d03d334b3 fixed production settings 2011-10-13 16:48:47 +02:00
javi santana
ab808b1dcb set cache settings in enviorments 2011-10-13 15:22:54 +02:00
Simon Tokumine
2e1b36a1a4 configure tileuser and mapkey security 2011-09-21 16:33:25 -04:00
Simon Tokumine
3d3ea9902e updated production settings 2011-09-13 21:51:51 -06:00
Simon Tokumine
1cabf0e836 update port 2011-09-06 17:38:36 +01:00
Simon Tokumine
d3de832f37 updated deps 2011-09-06 14:41:43 +01:00
Simon Tokumine
431fb56ad2 windshaft for cartodb 2011-09-05 00:00:41 +01:00