Commit Graph

601 Commits

Author SHA1 Message Date
John Krauss
5bdcb59df3 remove commented code 2016-12-28 19:34:37 +00:00
John Krauss
6e475cf210 fix uppercase NULL in tests 2016-12-28 19:17:57 +00:00
John Krauss
eb508c5d16 Revert "subdivide complex geoms in obs_getmeasure"
This reverts commit d44887b2b3.
2016-12-28 18:40:01 +00:00
John Krauss
bbd0cc0938 capture boundary in multi, capture message from env 2016-12-28 16:54:16 +00:00
John Krauss
d44887b2b3 subdivide complex geoms in obs_getmeasure 2016-12-28 16:19:13 +00:00
John Krauss
fa96de5aa9 remove notices from getgeometryscores 2016-12-28 15:57:56 +00:00
John Krauss
b7943ad8d2 fix divide by zero issues for denominated 2016-12-21 23:22:31 +00:00
John Krauss
6b071db588 remove notices 2016-12-21 23:18:25 +00:00
John Krauss
fbf13be62a unit tests passing with 2015 geoms included, fixes to obs_getmeasure 2016-12-21 23:17:03 +00:00
John Krauss
fc3fcbec4e fix broken polygon area normalization 2016-12-21 22:41:53 +00:00
John Krauss
d3a57e637c keep track of table_id in obs_meta and geometryscores, use obs_getmeasure*multi for obs_getmeasure 2016-12-21 21:53:53 +00:00
John Krauss
24587b7e03 switch over to multi for the "split" test 2016-12-19 16:49:50 +00:00
John Krauss
2398b0268f major performance speedup for obs_getmeasuremeta 2016-12-16 21:54:42 +00:00
John Krauss
4c6d854e81 Merge branch 'release-v-1.1.7' into obs_getmeasure_res_bypass 2016-12-16 18:01:17 +00:00
John Krauss
fd32f962f2 remove failing MX test 2016-12-15 20:19:12 +00:00
John Krauss
5a5d5a9386 tests pass, although obs_getmeasure performance suffers 2016-12-14 22:58:22 +00:00
John Krauss
88d1145c12 fix issue with NULL being passed into obs_getmeasure, add tests for obs_getmeasuremeta and obs_getmeasuredata 2016-12-13 15:43:04 +00:00
John Krauss
9567f52a36 minor tweaks to obs_getmeasuremeta and obs_getmeasuredata, good behavior for geometryscores even when null is passed as desired_num_geoms 2016-12-13 00:14:19 +00:00
John Krauss
fad7bb991b split obs_getmeasuremeta and obs_getmeasuredata 2016-12-12 23:10:12 +00:00
John Krauss
d17b865648 add test that takes out the geom component 2016-12-12 21:49:00 +00:00
John Krauss
d4e6e7ac95 use obs_column_table_tile_raster with simpler bands for faster performance 2016-12-12 21:25:59 +00:00
John Krauss
82137d5679 Merge branch 'develop' into raster-simplification-experiments 2016-12-12 17:36:12 +00:00
Mario de Frutos
aa3e0ed76b Version 1.1.6 release artifacts 2016-12-12 16:44:36 +01:00
John Krauss
21b108d32c move redundant aggregates to CTE 2016-12-09 22:31:29 +00:00
John Krauss
9f640f0c35 use simple envelope for very complex geometries in obs_getgetgeometryscores 2016-12-09 21:47:30 +00:00
John Krauss
95b6cba085 remove some unnecessary calculations from obs_getgeometryscores, yields QPS improvement from about 20 to 30 2016-12-09 21:06:42 +00:00
John Krauss
6a6d1bc3e4 Merge branch 'release-v-1.1.6' into raster-simplification-experiments 2016-12-09 19:38:12 +00:00
John Krauss
e33bcae964 add several ignored MX measures likely due to new geometry scoring 2016-12-08 03:21:04 +00:00
John Krauss
48a8df8b98 switch brazil testpoint 2016-12-08 03:13:55 +00:00
John Krauss
4b9ba06b42 fix lat/lng switch for brazil 2016-12-08 02:55:53 +00:00
John Krauss
7373794c30 fix divide-by-zero condition with obs_getmeasure(area) using denominator 2016-12-08 02:32:03 +00:00
John Krauss
39473db14b Merge branch 'improve-perftest' into complex-geom-perf-improvements 2016-12-08 02:21:29 +00:00
John Krauss
b7ee3a6d67 perftest updates, adding BR test point 2016-12-08 02:17:38 +00:00
John Krauss
1aca5b5ff0 Merge branch 'improve-perftest' into complex-geom-perf-improvements 2016-12-05 22:57:03 +00:00
John Krauss
255f8dc18e support peristence of test results to JSON 2016-12-05 22:55:14 +00:00
John Krauss
463db99222 add perf tests for different geometry complexities as well as all code branches for getmeasure 2016-12-05 18:51:58 +00:00
John Krauss
59857355c7 simplifying raster experiments 2016-12-02 19:33:16 +00:00
John Krauss
44932be1f5 improvements to scoring, fixing oversimplification and removing some premature optimization 2016-12-01 21:50:39 +00:00
John Krauss
4ce1648550 score rasters with lots of missing space lower 2016-11-30 23:16:18 +00:00
John Krauss
ff0f6ea6e0 use st_subdivide to deal with more complex geometries 2016-11-30 23:15:30 +00:00
John Krauss
34a3aab323 remove redundant area checks from other polygon-based getmeasure branches 2016-11-30 17:24:45 +00:00
John Krauss
f32cc60d61 remove redundant area check 2016-11-30 17:15:39 +00:00
John Krauss
81c8fc316b remove almost all %L formats, including all where geoms were dropped in 2016-11-30 16:53:22 +00:00
Mario de Frutos
603d26c674 Version 1.1.5 artifacts 2016-11-29 17:43:28 +01:00
John Krauss
6c08681446 return NULL when there is no data for a measure at a geometry according to our raster. Fixes #220 2016-11-29 16:41:44 +00:00
Mario de Frutos
713aacf535 Version 1.1.4 artifact 2016-11-22 10:03:22 +01:00
John Krauss
fa778f4eb0 test for #216 2016-11-21 22:03:31 +00:00
John Krauss
22a413102b Fixes bug where multiple subsections returned from OBS_LegacyBuilderMetadata, #216 2016-11-21 21:50:56 +00:00
Mario de Frutos
54d512d4fb Release 1.1.3 artifact 2016-11-17 20:03:50 +01:00
John Krauss
62e13086e1 release v1.1.3 2016-11-15 18:36:53 +00:00
Mario de Frutos
7e04c38c3a Release 1.1.2 artifact 2016-11-11 17:08:04 +01:00
john krauss
17d343a756 Merge pull request #209 from CartoDB/use-rasters
Use rasters
2016-11-09 16:58:25 -05:00
John Krauss
be4b5abbfa use highest ranked geom for obs_getmeasure, simplify scoring 2016-11-07 23:57:33 +00:00
John Krauss
8dad88a6b3 fix minor bug in _obs_getgeometryscores with FIRST, add tests 2016-11-07 21:26:44 +00:00
John Krauss
7e6489f2a1 add test points for EU and EPA, make it easier to work with meta.py 2016-11-07 16:50:00 +00:00
John Krauss
9fdca9161c minor stylistic fix 2016-11-04 15:32:25 +00:00
John Krauss
785a5eed29 obs_getgeometryscores and usage by obs_getavailablegeometries 2016-11-02 21:11:38 +00:00
Mario de Frutos
174ee65f46 Release 1.1.1 artifact 2016-10-21 12:08:49 +02:00
John Krauss
89d10ff993 do not skip canada tests 2016-10-14 18:39:47 +00:00
John Krauss
e35b7825ce adding testpoints for FR, Guayane, and CA 2016-10-07 20:27:04 +00:00
Javier Goizueta
06e0b5bcf8 Release 1.1.0 2016-10-05 16:24:55 +02:00
John Krauss
017b404264 make bounds optional for dimensional queries, add all tests 2016-10-04 22:21:05 +00:00
John Krauss
50b745227b working obs_getavailablenumerators tests 2016-10-04 20:10:24 +00:00
John Krauss
2171cb83c7 add tests for builder legacy func 2016-10-04 19:46:37 +00:00
John Krauss
0d9f0e4996 allow null geom to be passed in for the obs_get* functions, add in convenience legacy builder metadata function 2016-10-04 19:16:32 +00:00
John Krauss
b473ffe307 updated fixtures generation from local postgres, fixed a few tests that broke 2016-10-03 20:36:14 +00:00
John Krauss
2a1598d491 first pass on generating new metadata from local 2016-09-30 20:44:03 +00:00
John Krauss
827104756e another test stub 2016-09-30 17:39:25 +00:00
John Krauss
3602aab804 remove table defintions, stub in tests 2016-09-29 20:53:12 +00:00
John Krauss
48221fc358 Merge branch 'develop' into builder-api-func 2016-09-29 20:23:08 +00:00
Carla Iriberri
f4113eaea3 Release 1.0.7 2016-09-21 11:24:29 +02:00
John Krauss
2d753cd758 Skip bad MX measure, smaller buffer for faster tests, updated NEWS.md 2016-09-20 17:56:23 +00:00
john krauss
96a98c3bce Merge pull request #194 from CartoDB/null-resilience
Resolve #178
2016-09-20 13:38:11 -04:00
John Krauss
104608c6d3 Add point to make sure CA data is present 2016-09-20 16:31:15 +00:00
John Krauss
c67fe12111 return NULL in cases when NULL is passed as input geometry or geometry ID. resolves #178 2016-09-20 16:26:13 +00:00
John Krauss
18cfdc60d0 tmp commit 2016-09-19 16:08:37 +00:00
Carla Iriberri
860290595c Release 1.0.6 2016-09-08 10:37:37 +02:00
Carla
bf4ade2fa0 Merge pull request #186 from CartoDB/measure_release
Use explicit functions for query construction and metadata
2016-09-08 09:58:25 +02:00
Carla
32d37a74b3 Remove cascades and quote conveniently 2016-09-02 12:04:03 +02:00
Carla Iriberri
5eb4ede219 Fix 2016-08-23 17:20:48 +02:00
Carla Iriberri
dd5f560359 Separate functions between files 2016-08-19 16:39:30 +02:00
Carla Iriberri
62c2693553 Avoid function check to dispatch 2016-08-19 13:04:54 +02:00
Carla Iriberri
48d1bfdb13 Remove JSON manipulation to use json functions 2016-08-19 12:45:38 +02:00
Carla Iriberri
30f27e5b58 Check function name and use param names instead of 2016-08-18 15:43:03 +02:00
Carla Iriberri
26b22a9bf4 Use explicit functions for query construction and metadata 2016-08-18 15:36:32 +02:00
Mario de Frutos
4c13434b9a Merge pull request #182 from CartoDB/sql-tests
SQL Integration and Performance Tests
2016-08-18 14:54:53 +02:00
Mario de Frutos
8785639ece Merge pull request #154 from CartoDB/iriberri-patch-1
Use 6432 for connections from server
2016-08-18 11:10:02 +02:00
John Krauss
f991f5a1e6 docs and NEWS for the new tests 2016-08-12 18:56:06 +00:00
John Krauss
e4b4ebf72d Adapted autotest to to work with SQL directly instead of over HTTP SQL API 2016-08-12 18:48:31 +00:00
John Krauss
e9857e89fb release-v-1.0.4 increment and news 2016-07-26 13:08:28 +00:00
John Krauss
af69b44f25 Always default to NULL, fixes #173 2016-07-26 13:05:40 +00:00
John Krauss
1c7c73f948 release candidate 1.0.3 2016-07-25 13:20:09 +00:00
john krauss
360adc47df Merge pull request #170 from CartoDB/handle-bad-geoms
Handle bad geoms
2016-07-25 09:15:09 -04:00
john krauss
571f1f343a Merge pull request #168 from CartoDB/fix-per-sq-m-obs-getmeasure-area
Fix per sq m obs getmeasure area
2016-07-25 09:14:08 -04:00
john krauss
186c57efbd Merge pull request #167 from CartoDB/null-defaults
Null defaults
2016-07-25 09:12:51 -04:00
john krauss
b139a24012 Merge pull request #165 from CartoDB/fix-required-libs
Fix required libs
2016-07-25 09:09:21 -04:00
john krauss
260704327e Merge pull request #164 from CartoDB/hotfix-error-on-exception
in this function, its "measure_id" not "numer_id"
2016-07-25 09:06:26 -04:00
John Krauss
252610673a handle difficult geometries more gracefully. fixes #160 2016-07-25 13:05:36 +00:00
John Krauss
d054f37528 fixes #160: snaptogrid then buffer input polygons 2016-07-22 21:47:06 +00:00
John Krauss
3d58fd284a fix #159
ensure getuscensusmeasure and getpopulation work as expected with NULL passed explicitly as normalization
2016-07-22 19:24:36 +00:00
John Krauss
efcea9be7b Merge branch 'fix-required-libs' into fix-per-sq-m-obs-getmeasure-area 2016-07-22 18:59:42 +00:00
John Krauss
cf242515e3 install postgres_fdw in test setup. fixes #166 2016-07-22 18:59:11 +00:00
John Krauss
4c434f5448 tests doublechecking NULL default handled correctly, and that area normalization for polygon is per square kilometer 2016-07-22 18:56:27 +00:00
John Krauss
59dd09c554 Merge branch 'fix-required-libs' into fix-per-sq-m-obs-getmeasure-area 2016-07-22 18:17:54 +00:00
John Krauss
8187ab4bbe ensure tests run in order. Fixes #162 2016-07-22 17:44:16 +00:00
John Krauss
e54d95fa8f remove unused plpythonu and cartodb dependencies
Fixes #161
2016-07-22 17:43:40 +00:00
John Krauss
d766f08b03 calculate area normalization of a polygon by square kilometer, not square meter. fixes #158 2016-07-22 15:18:43 +00:00
John Krauss
8f345fd508 in this function, its "measure_id" not "numer_id" 2016-07-21 15:35:09 -04:00
Carla
bfa57f4971 Use 6432 for connections from server 2016-07-19 17:54:08 +02:00
Carla
173d7c0aec Add postgres_fdw as a dependency of observatory 2016-07-19 15:56:25 +02:00
Mario de Frutos
876515f9aa Merge pull request #127 from CartoDB/table_level_functions
Add table level functions and mocks
2016-07-15 15:47:02 +02:00
Carla
d93752efa3 move addr_host as a parameter 2016-07-15 11:34:42 +02:00
John Krauss
c09e0b6e83 can eliminate getrelatedcolumn 2016-07-13 18:42:25 -04:00
John Krauss
748428ace1 Merge branch 'release-v-1.0.2' into getmeasure-using-obsmeta 2016-07-13 18:41:04 -04:00
john krauss
10a0dc9b26 Merge pull request #141 from CartoDB/fix-hardcoded-getcategory-geom
Fix hardcoded getcategory geom
2016-07-13 18:39:31 -04:00
john krauss
9245de84b0 Merge pull request #142 from CartoDB/comment-notices
comment out notices
2016-07-13 18:38:59 -04:00
John Krauss
7bb1bbd804 handle predenomination of points properly 2016-07-13 18:37:17 -04:00
John Krauss
1d008ccbe9 should not try to use area normalization for zhvi 2016-07-13 18:33:53 -04:00
John Krauss
f581278b8a default is now NULL 2016-07-13 18:24:45 -04:00
John Krauss
cbf1c5e67d fix default normalizations 2016-07-13 18:16:53 -04:00
John Krauss
adc663b563 default to area normalization for point, no normalization for polygon getmeasures 2016-07-13 18:14:09 -04:00
John Krauss
3a37b98b72 we still needt hese for getdemographicsnapshot 2016-07-13 17:54:19 -04:00
John Krauss
a4a20e9c1d prevent internal join for denominated getmeasure by polygon 2016-07-13 17:41:05 -04:00
John Krauss
f485426085 fix syntax error 2016-07-13 17:38:54 -04:00
John Krauss
75e765f256 explicit type casts for = ANY 2016-07-13 17:38:05 -04:00
John Krauss
b690478aff use IN ANY to avoid joins elsewhere, and filter by nonzero overlap for all getmeasure polygon queries 2016-07-13 17:36:27 -04:00
John Krauss
6fa9d5c96a add missing array_agg 2016-07-13 17:27:03 -04:00
John Krauss
fc6317161f avoid joins 2016-07-13 17:26:01 -04:00
John Krauss
c07d9f6833 add missing params 2016-07-13 17:13:45 -04:00
John Krauss
ff173a0152 filter so theres some overlap 2016-07-13 17:12:16 -04:00
John Krauss
a7de1f2228 intersects, not overlaps 2016-07-13 16:57:27 -04:00
John Krauss
86529ada5a use st_overlaps instead of && 2016-07-13 16:53:50 -04:00
John Krauss
80cdc5e8ca fix predicate 2016-07-13 16:48:06 -04:00
John Krauss
7c8c5cca0a fix params 2016-07-13 16:42:02 -04:00
John Krauss
a946ab9d03 fix params in denominated polygon getmeasure 2016-07-13 16:28:50 -04:00
John Krauss
da127baa3c implementation for polygon/multipolygon weighted getmeasure 2016-07-13 16:24:33 -04:00
John Krauss
e89a88aa83 use subselects as joins are horrifically slow over FDW 2016-07-13 15:59:27 -04:00
John Krauss
af2259bb0a fix wrong number of variables INTO 2016-07-13 13:39:33 -04:00
John Krauss
fb083f4b9e fix typo 2016-07-13 13:30:05 -04:00
John Krauss
976e119abb fix typo 2016-07-13 12:21:53 -04:00
John Krauss
bbc6f9ef36 getmeasure bypassing several older functions, areas not yet implemented 2016-07-13 12:20:01 -04:00
John Krauss
5229279ee9 Merge branch 'comment-notices' into release-v-1.0.2-preview 2016-07-13 11:14:00 -04:00
John Krauss
2107796f07 updates to NEWS.md and observatory.control 2016-07-12 17:49:34 -04:00
John Krauss
6a39bedee7 fix ambiguous colname for categories in points too 2016-07-12 16:10:00 -04:00
John Krauss
81176d1df2 fix possible ambiguity in category colname 2016-07-12 16:06:19 -04:00
John Krauss
4b26eeda65 fix to correct segment for testarea area 2016-07-12 15:33:26 -04:00
John Krauss
4fc02f99e2 choose largest segment in the polygon 2016-07-12 14:37:43 -04:00
John Krauss
5bb4285528 fix typo 2016-07-12 14:16:28 -04:00
John Krauss
1e9c3fb860 fix typo 2016-07-12 14:15:00 -04:00
John Krauss
62a2c259a7 fix typo 2016-07-12 14:13:09 -04:00