Javier Goizueta
6a5e4b0460
Fix overviews tests
...
The aggregation method for strings has changed
2016-01-27 16:54:30 +01:00
Javier Goizueta
b8d50204dd
Avoid aggregation which causes out-of-memory crashes in PostgreSQL
...
The use of multiple string_agg functions, even if applied to groups
of one single record causes out of memory crashes in PG 9.3.4 for
some (large) tables.
2016-01-27 15:24:04 +01:00
Javier Goizueta
474de01757
Change the overview table naming scheme
...
The scheme is changed from table_ovN to _vovw_N_table for
lower collision probability.
Also future naming changes will be easier by using the functions
_CDB_OverviewTableDiscriminator, _CDB_OverviewTableName,
_CDB_IsOverviewTableOf, etc.
2016-01-26 13:20:28 +01:00
Javier Goizueta
1ebaeb76ac
Overload CDB_Overviews to accept either a single table or an array
...
The result of CDB_Overviews has been expandend with a base_table column
2016-01-26 10:39:26 +01:00
Javier Goizueta
7033a8d9ac
Fixes for table names that require quotes or which include a schema name
...
Some cases left unsolved, with FIXME comments
2016-01-13 18:49:27 +01:00
Javier Goizueta
46bc774d38
Fix CDB_Overviews for the case that the table name requires quoting
2016-01-13 18:24:06 +01:00
Javier Goizueta
a9e2d19918
Document CDB_DropOverviews
2016-01-12 16:20:11 +01:00
Javier Goizueta
d352e1c463
Update Overviews tests
2016-01-12 15:36:07 +01:00
Javier Goizueta
5b47c51221
Add function to drop overviews
2016-01-12 15:35:50 +01:00
Javier Goizueta
ebaded0c7a
Merge branch 'master' into overviews
2016-01-12 13:34:26 +01:00
Javier Goizueta
ccdf8de59e
Enhance documentation, update comments
2016-01-12 12:08:41 +01:00
Javier Goizueta
a2f6cb4c04
Fix documentation
2016-01-12 11:59:57 +01:00
Javier Goizueta
02f386be33
Regard the GridCluster reduction strategy as private
...
The *strategy* parameteriation will be considered an
implementation detail for the time being.
2016-01-12 11:59:42 +01:00
Javier Goizueta
a7c70fe497
Fix: CDB_ZoomFromScale deviation for lowest zoom levels
2016-01-12 11:46:47 +01:00
Javier Goizueta
0a066e0126
Change the default overview reduction strategy to GridCluster
2016-01-11 15:35:04 +01:00
Javier Goizueta
913640e2dc
Preserve the column ordering of the base table in overviews
2016-01-11 15:34:10 +01:00
Javier Goizueta
ef7e613d41
Change CDB_ColumnNames to order columns names as in table
2016-01-11 15:28:27 +01:00
Javier Goizueta
fd7a8cff71
Change regular expression for consistency
2016-01-11 15:27:05 +01:00
Javier Goizueta
6ea63af974
Add function to obtain existing overviews of a table
2016-01-11 14:50:10 +01:00
Javier Goizueta
496f079b1c
Copy dataset privileges to overview tables
2016-01-04 18:06:56 +01:00
Javier Goizueta
4580c9cd5c
Change the cartodb_ids of aggregated overviews
...
Instead of arbitrary ids, the id of one of the aggregated records
is used, so that if it is used in the UI to query point
the information of one of the records grouped at the point will be
retrieved.
2016-01-04 10:33:39 +01:00
Javier Goizueta
08828b8b7d
Set owner of overlays to the owner of the base table
2015-12-29 15:22:12 +01:00
Javier Goizueta
cecba655eb
Preserve aggregated attributes of singleton groups
2015-12-29 14:56:47 +01:00
Javier Goizueta
b34a752172
Generate overviews for all Z levels
...
Skipping levels produces visually inferior results
2015-12-29 14:56:04 +01:00
Javier Goizueta
8ba9e74c4a
Order columns of aggregated overlays as in the base table
2015-12-29 13:38:07 +01:00
Javier Goizueta
6a6a5bc96a
Fix Sampling reduction to avoid RandomTids problems
...
The fixed cases will not be common but do occur in tests.
This is an interim fix which should be reverted if CDB_randomTids changes.
2015-12-28 19:41:14 +01:00
Javier Goizueta
2ff686de27
Clean up: remove spurious comment
2015-12-28 19:30:20 +01:00
Javier Goizueta
07326626b7
More efficient sampling strategy
...
It is also renamed properly.
2015-12-28 19:28:20 +01:00
Javier Goizueta
4afc427008
Rename Ref. Z strategy function
...
It's not that *dummy* anymore, so choose a more descriptive name
2015-12-28 17:47:57 +01:00
Paul Norman
2ab059460b
Merge pull request #189 from pnorman/fix_travis
...
Fix test errors on Travis
2015-12-23 10:56:56 -08:00
Javier Goizueta
8d1bbc63fa
Add overview tests
2015-12-23 16:33:34 +01:00
Javier Goizueta
06ca4f74ee
Enable Overviews module in the extension
2015-12-23 16:32:44 +01:00
Javier Goizueta
a8a2c04d71
Remove invalid comment
2015-12-23 14:20:57 +01:00
Javier Goizueta
a5bca7d715
Add function for post-processing new overview tables
2015-12-23 14:17:50 +01:00
Javier Goizueta
552206464e
Make strategy function public
2015-12-23 12:50:04 +01:00
Javier Goizueta
2af0b9a57f
Add function comments
2015-12-23 12:42:40 +01:00
Javier Goizueta
1b5de84c9a
Add missing attribute-aggregationto the point reduction strategy
2015-12-23 12:17:37 +01:00
Paul Norman
3b48acf60c
Round extent outputs in test
...
Travis was reporting rounded results, so this should make the behavior more consistent
2015-12-22 16:34:18 -08:00
Paul Norman
efb319074a
Add constraint to QueryTablesTest
2015-12-22 16:21:54 -08:00
Javier Goizueta
c36a5d35c3
Merge branch 'overviews' of github.com:CartoDB/cartodb-postgresql into overviews
2015-12-22 18:02:16 +01:00
Javier Goizueta
5a78ee2896
Optimize the gridded clustering strategy
...
The internal grid_px parameter is adjusted for best results with default symbol size
2015-12-22 17:59:49 +01:00
Rafa de la Torre
480e2d0979
Merge pull request #187 from CartoDB/overviews-rtorre
...
Overviews rtorre touches
2015-12-22 17:45:14 +01:00
Javier Goizueta
c8a1ef6f68
Slight optimization of gridded clustering
2015-12-22 15:25:21 +01:00
Rafa de la Torre
564ab75d2d
Use _cdb_estimated_extent instead of ST_Extent
...
With a 3.8M points table, this was a ~30% gain in my local env.
2015-12-21 18:41:50 +01:00
Rafa de la Torre
5010109c7d
Add _cdb_estimated_extent to get the extent from stats
2015-12-21 18:41:45 +01:00
Paul Norman
a9f6e26fed
Merge pull request #184 from pnorman/readme_url
...
Update wiki URL
2015-12-21 08:35:01 -08:00
Rafa de la Torre
e60f73a31b
A bit of internal documentation
2015-12-21 13:16:57 +01:00
Javier Goizueta
415a09392f
Gridded clustering aggregation strategy for overviews
2015-12-16 17:45:36 +01:00
Javier Goizueta
e5cc9ef0bd
Fix: typo
2015-12-16 17:26:17 +01:00
Javier Goizueta
f7857945c1
Change feature density computation algorithm
...
Now parameterize by the number of levels to traverse and
start with the level that covers the extent of the table
with at least N*N tiles (N=4).
2015-12-16 16:39:38 +01:00
