cartodb4/observatory-extension
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,102 Commits 1 Branch 34 Tags 43 MiB
3295dd069f
Commit Graph

655 Commits

Author SHA1 Message Date
John Krauss
000a440417 resolve issues in build and with code, now returning geometries and data as expected from obs_getoverpass 2017-01-03 16:37:16 +00:00
John Krauss
ff50c5e2bf first pass on overpass api, still getting an error with columns 2017-01-03 15:39:01 +00:00
John Krauss
d7552031f6 support obtaining text measures with obs_getmeasuredatamulti 2016-12-29 23:01:48 +00:00
John Krauss
39eb031316 support POINT and LINESTRING types from obs_getboundaries 2016-12-29 17:07:38 +00:00
John Krauss
5bdcb59df3 remove commented code 2016-12-28 19:34:37 +00:00
John Krauss
6e475cf210 fix uppercase NULL in tests 2016-12-28 19:17:57 +00:00
John Krauss
eb508c5d16 Revert "subdivide complex geoms in obs_getmeasure" 
This reverts commit d44887b2b3.
 2016-12-28 18:40:01 +00:00
John Krauss
bbd0cc0938 capture boundary in multi, capture message from env 2016-12-28 16:54:16 +00:00
John Krauss
d44887b2b3 subdivide complex geoms in obs_getmeasure 2016-12-28 16:19:13 +00:00
John Krauss
fa96de5aa9 remove notices from getgeometryscores 2016-12-28 15:57:56 +00:00
John Krauss
b7943ad8d2 fix divide by zero issues for denominated 2016-12-21 23:22:31 +00:00
John Krauss
6b071db588 remove notices 2016-12-21 23:18:25 +00:00
John Krauss
fbf13be62a unit tests passing with 2015 geoms included, fixes to obs_getmeasure 2016-12-21 23:17:03 +00:00
John Krauss
fc3fcbec4e fix broken polygon area normalization 2016-12-21 22:41:53 +00:00
John Krauss
d3a57e637c keep track of table_id in obs_meta and geometryscores, use obs_getmeasure*multi for obs_getmeasure 2016-12-21 21:53:53 +00:00
John Krauss
24587b7e03 switch over to multi for the "split" test 2016-12-19 16:49:50 +00:00
John Krauss
2398b0268f major performance speedup for obs_getmeasuremeta 2016-12-16 21:54:42 +00:00
John Krauss
4c6d854e81 Merge branch 'release-v-1.1.7' into obs_getmeasure_res_bypass 2016-12-16 18:01:17 +00:00
John Krauss
fd32f962f2 remove failing MX test 2016-12-15 20:19:12 +00:00
John Krauss
5a5d5a9386 tests pass, although obs_getmeasure performance suffers 2016-12-14 22:58:22 +00:00
John Krauss
88d1145c12 fix issue with NULL being passed into obs_getmeasure, add tests for obs_getmeasuremeta and obs_getmeasuredata 2016-12-13 15:43:04 +00:00
John Krauss
9567f52a36 minor tweaks to obs_getmeasuremeta and obs_getmeasuredata, good behavior for geometryscores even when null is passed as desired_num_geoms 2016-12-13 00:14:19 +00:00
John Krauss
fad7bb991b split obs_getmeasuremeta and obs_getmeasuredata 2016-12-12 23:10:12 +00:00
John Krauss
d17b865648 add test that takes out the geom component 2016-12-12 21:49:00 +00:00
John Krauss
d4e6e7ac95 use obs_column_table_tile_raster with simpler bands for faster performance 2016-12-12 21:25:59 +00:00
John Krauss
82137d5679 Merge branch 'develop' into raster-simplification-experiments 2016-12-12 17:36:12 +00:00
Mario de Frutos
aa3e0ed76b Version 1.1.6 release artifacts 2016-12-12 16:44:36 +01:00
John Krauss
21b108d32c move redundant aggregates to CTE 2016-12-09 22:31:29 +00:00
John Krauss
9f640f0c35 use simple envelope for very complex geometries in obs_getgetgeometryscores 2016-12-09 21:47:30 +00:00
John Krauss
95b6cba085 remove some unnecessary calculations from obs_getgeometryscores, yields QPS improvement from about 20 to 30 2016-12-09 21:06:42 +00:00
John Krauss
6a6d1bc3e4 Merge branch 'release-v-1.1.6' into raster-simplification-experiments 2016-12-09 19:38:12 +00:00
John Krauss
e33bcae964 add several ignored MX measures likely due to new geometry scoring 2016-12-08 03:21:04 +00:00
John Krauss
48a8df8b98 switch brazil testpoint 2016-12-08 03:13:55 +00:00
John Krauss
4b9ba06b42 fix lat/lng switch for brazil 2016-12-08 02:55:53 +00:00
John Krauss
7373794c30 fix divide-by-zero condition with obs_getmeasure(area) using denominator 2016-12-08 02:32:03 +00:00
John Krauss
39473db14b Merge branch 'improve-perftest' into complex-geom-perf-improvements 2016-12-08 02:21:29 +00:00
John Krauss
b7ee3a6d67 perftest updates, adding BR test point 2016-12-08 02:17:38 +00:00
John Krauss
1aca5b5ff0 Merge branch 'improve-perftest' into complex-geom-perf-improvements 2016-12-05 22:57:03 +00:00
John Krauss
255f8dc18e support peristence of test results to JSON 2016-12-05 22:55:14 +00:00
John Krauss
463db99222 add perf tests for different geometry complexities as well as all code branches for getmeasure 2016-12-05 18:51:58 +00:00
John Krauss
59857355c7 simplifying raster experiments 2016-12-02 19:33:16 +00:00
John Krauss
44932be1f5 improvements to scoring, fixing oversimplification and removing some premature optimization 2016-12-01 21:50:39 +00:00
John Krauss
4ce1648550 score rasters with lots of missing space lower 2016-11-30 23:16:18 +00:00
John Krauss
ff0f6ea6e0 use st_subdivide to deal with more complex geometries 2016-11-30 23:15:30 +00:00
John Krauss
34a3aab323 remove redundant area checks from other polygon-based getmeasure branches 2016-11-30 17:24:45 +00:00
John Krauss
f32cc60d61 remove redundant area check 2016-11-30 17:15:39 +00:00
John Krauss
81c8fc316b remove almost all %L formats, including all where geoms were dropped in 2016-11-30 16:53:22 +00:00
Mario de Frutos
603d26c674 Version 1.1.5 artifacts 2016-11-29 17:43:28 +01:00
John Krauss
6c08681446 return NULL when there is no data for a measure at a geometry according to our raster. Fixes #220 2016-11-29 16:41:44 +00:00
Mario de Frutos
713aacf535 Version 1.1.4 artifact 2016-11-22 10:03:22 +01:00
John Krauss
fa778f4eb0 test for #216 2016-11-21 22:03:31 +00:00
John Krauss
22a413102b Fixes bug where multiple subsections returned from OBS_LegacyBuilderMetadata, #216 2016-11-21 21:50:56 +00:00
Mario de Frutos
54d512d4fb Release 1.1.3 artifact 2016-11-17 20:03:50 +01:00
John Krauss
62e13086e1 release v1.1.3 2016-11-15 18:36:53 +00:00
Mario de Frutos
7e04c38c3a Release 1.1.2 artifact 2016-11-11 17:08:04 +01:00
john krauss
17d343a756 Merge pull request #209 from CartoDB/use-rasters 
Use rasters
 2016-11-09 16:58:25 -05:00
John Krauss
be4b5abbfa use highest ranked geom for obs_getmeasure, simplify scoring 2016-11-07 23:57:33 +00:00
John Krauss
8dad88a6b3 fix minor bug in _obs_getgeometryscores with FIRST, add tests 2016-11-07 21:26:44 +00:00
John Krauss
7e6489f2a1 add test points for EU and EPA, make it easier to work with meta.py 2016-11-07 16:50:00 +00:00
John Krauss
9fdca9161c minor stylistic fix 2016-11-04 15:32:25 +00:00
John Krauss
785a5eed29 obs_getgeometryscores and usage by obs_getavailablegeometries 2016-11-02 21:11:38 +00:00
Mario de Frutos
174ee65f46 Release 1.1.1 artifact 2016-10-21 12:08:49 +02:00
John Krauss
89d10ff993 do not skip canada tests 2016-10-14 18:39:47 +00:00
John Krauss
e35b7825ce adding testpoints for FR, Guayane, and CA 2016-10-07 20:27:04 +00:00
Javier Goizueta
06e0b5bcf8 Release 1.1.0 2016-10-05 16:24:55 +02:00
John Krauss
017b404264 make bounds optional for dimensional queries, add all tests 2016-10-04 22:21:05 +00:00
John Krauss
50b745227b working obs_getavailablenumerators tests 2016-10-04 20:10:24 +00:00
John Krauss
2171cb83c7 add tests for builder legacy func 2016-10-04 19:46:37 +00:00
John Krauss
0d9f0e4996 allow null geom to be passed in for the obs_get* functions, add in convenience legacy builder metadata function 2016-10-04 19:16:32 +00:00
John Krauss
b473ffe307 updated fixtures generation from local postgres, fixed a few tests that broke 2016-10-03 20:36:14 +00:00
John Krauss
2a1598d491 first pass on generating new metadata from local 2016-09-30 20:44:03 +00:00
John Krauss
827104756e another test stub 2016-09-30 17:39:25 +00:00
John Krauss
3602aab804 remove table defintions, stub in tests 2016-09-29 20:53:12 +00:00
John Krauss
48221fc358 Merge branch 'develop' into builder-api-func 2016-09-29 20:23:08 +00:00
Carla Iriberri
f4113eaea3 Release 1.0.7 2016-09-21 11:24:29 +02:00
John Krauss
2d753cd758 Skip bad MX measure, smaller buffer for faster tests, updated NEWS.md 2016-09-20 17:56:23 +00:00
john krauss
96a98c3bce Merge pull request #194 from CartoDB/null-resilience 
Resolve #178
 2016-09-20 13:38:11 -04:00
John Krauss
104608c6d3 Add point to make sure CA data is present 2016-09-20 16:31:15 +00:00
John Krauss
c67fe12111 return NULL in cases when NULL is passed as input geometry or geometry ID. resolves #178 2016-09-20 16:26:13 +00:00
John Krauss
18cfdc60d0 tmp commit 2016-09-19 16:08:37 +00:00
Carla Iriberri
860290595c Release 1.0.6 2016-09-08 10:37:37 +02:00
Carla
bf4ade2fa0 Merge pull request #186 from CartoDB/measure_release 
Use explicit functions for query construction and metadata
 2016-09-08 09:58:25 +02:00
Carla
32d37a74b3 Remove cascades and quote conveniently 2016-09-02 12:04:03 +02:00
Carla Iriberri
5eb4ede219 Fix 2016-08-23 17:20:48 +02:00
Carla Iriberri
dd5f560359 Separate functions between files 2016-08-19 16:39:30 +02:00
Carla Iriberri
62c2693553 Avoid function check to dispatch 2016-08-19 13:04:54 +02:00
Carla Iriberri
48d1bfdb13 Remove JSON manipulation to use json functions 2016-08-19 12:45:38 +02:00
Carla Iriberri
30f27e5b58 Check function name and use param names instead of 2016-08-18 15:43:03 +02:00
Carla Iriberri
26b22a9bf4 Use explicit functions for query construction and metadata 2016-08-18 15:36:32 +02:00
Mario de Frutos
4c13434b9a Merge pull request #182 from CartoDB/sql-tests 
SQL Integration and Performance Tests
 2016-08-18 14:54:53 +02:00
Mario de Frutos
8785639ece Merge pull request #154 from CartoDB/iriberri-patch-1 
Use 6432 for connections from server
 2016-08-18 11:10:02 +02:00
John Krauss
f991f5a1e6 docs and NEWS for the new tests 2016-08-12 18:56:06 +00:00
John Krauss
e4b4ebf72d Adapted autotest to to work with SQL directly instead of over HTTP SQL API 2016-08-12 18:48:31 +00:00
John Krauss
e9857e89fb release-v-1.0.4 increment and news 2016-07-26 13:08:28 +00:00
John Krauss
af69b44f25 Always default to NULL, fixes #173 2016-07-26 13:05:40 +00:00
John Krauss
1c7c73f948 release candidate 1.0.3 2016-07-25 13:20:09 +00:00
john krauss
360adc47df Merge pull request #170 from CartoDB/handle-bad-geoms 
Handle bad geoms
 2016-07-25 09:15:09 -04:00
john krauss
571f1f343a Merge pull request #168 from CartoDB/fix-per-sq-m-obs-getmeasure-area 
Fix per sq m obs getmeasure area
 2016-07-25 09:14:08 -04:00
john krauss
186c57efbd Merge pull request #167 from CartoDB/null-defaults 
Null defaults
 2016-07-25 09:12:51 -04:00
john krauss
b139a24012 Merge pull request #165 from CartoDB/fix-required-libs 
Fix required libs
 2016-07-25 09:09:21 -04:00
john krauss
260704327e Merge pull request #164 from CartoDB/hotfix-error-on-exception 
in this function, its "measure_id" not "numer_id"
 2016-07-25 09:06:26 -04:00
John Krauss
252610673a handle difficult geometries more gracefully. fixes #160 2016-07-25 13:05:36 +00:00
John Krauss
d054f37528 fixes #160: snaptogrid then buffer input polygons 2016-07-22 21:47:06 +00:00
John Krauss
3d58fd284a fix #159 
ensure getuscensusmeasure and getpopulation work as expected with NULL passed explicitly as normalization
 2016-07-22 19:24:36 +00:00
John Krauss
efcea9be7b Merge branch 'fix-required-libs' into fix-per-sq-m-obs-getmeasure-area 2016-07-22 18:59:42 +00:00
John Krauss
cf242515e3 install postgres_fdw in test setup. fixes #166 2016-07-22 18:59:11 +00:00
John Krauss
4c434f5448 tests doublechecking NULL default handled correctly, and that area normalization for polygon is per square kilometer 2016-07-22 18:56:27 +00:00
John Krauss
59dd09c554 Merge branch 'fix-required-libs' into fix-per-sq-m-obs-getmeasure-area 2016-07-22 18:17:54 +00:00
John Krauss
8187ab4bbe ensure tests run in order. Fixes #162 2016-07-22 17:44:16 +00:00
John Krauss
e54d95fa8f remove unused plpythonu and cartodb dependencies 
Fixes #161
 2016-07-22 17:43:40 +00:00
John Krauss
d766f08b03 calculate area normalization of a polygon by square kilometer, not square meter. fixes #158 2016-07-22 15:18:43 +00:00
John Krauss
8f345fd508 in this function, its "measure_id" not "numer_id" 2016-07-21 15:35:09 -04:00
Carla
bfa57f4971 Use 6432 for connections from server 2016-07-19 17:54:08 +02:00
Carla
173d7c0aec Add postgres_fdw as a dependency of observatory 2016-07-19 15:56:25 +02:00
Mario de Frutos
876515f9aa Merge pull request #127 from CartoDB/table_level_functions 
Add table level functions and mocks
 2016-07-15 15:47:02 +02:00
Carla
d93752efa3 move addr_host as a parameter 2016-07-15 11:34:42 +02:00
John Krauss
c09e0b6e83 can eliminate getrelatedcolumn 2016-07-13 18:42:25 -04:00
John Krauss
748428ace1 Merge branch 'release-v-1.0.2' into getmeasure-using-obsmeta 2016-07-13 18:41:04 -04:00
john krauss
10a0dc9b26 Merge pull request #141 from CartoDB/fix-hardcoded-getcategory-geom 
Fix hardcoded getcategory geom
 2016-07-13 18:39:31 -04:00
john krauss
9245de84b0 Merge pull request #142 from CartoDB/comment-notices 
comment out notices
 2016-07-13 18:38:59 -04:00
John Krauss
7bb1bbd804 handle predenomination of points properly 2016-07-13 18:37:17 -04:00
John Krauss
1d008ccbe9 should not try to use area normalization for zhvi 2016-07-13 18:33:53 -04:00
John Krauss
f581278b8a default is now NULL 2016-07-13 18:24:45 -04:00
John Krauss
cbf1c5e67d fix default normalizations 2016-07-13 18:16:53 -04:00
John Krauss
adc663b563 default to area normalization for point, no normalization for polygon getmeasures 2016-07-13 18:14:09 -04:00
John Krauss
3a37b98b72 we still needt hese for getdemographicsnapshot 2016-07-13 17:54:19 -04:00
John Krauss
a4a20e9c1d prevent internal join for denominated getmeasure by polygon 2016-07-13 17:41:05 -04:00
John Krauss
f485426085 fix syntax error 2016-07-13 17:38:54 -04:00
John Krauss
75e765f256 explicit type casts for = ANY 2016-07-13 17:38:05 -04:00
John Krauss
b690478aff use IN ANY to avoid joins elsewhere, and filter by nonzero overlap for all getmeasure polygon queries 2016-07-13 17:36:27 -04:00
John Krauss
6fa9d5c96a add missing array_agg 2016-07-13 17:27:03 -04:00
John Krauss
fc6317161f avoid joins 2016-07-13 17:26:01 -04:00
John Krauss
c07d9f6833 add missing params 2016-07-13 17:13:45 -04:00
John Krauss
ff173a0152 filter so theres some overlap 2016-07-13 17:12:16 -04:00
John Krauss
a7de1f2228 intersects, not overlaps 2016-07-13 16:57:27 -04:00
John Krauss
86529ada5a use st_overlaps instead of && 2016-07-13 16:53:50 -04:00
John Krauss
80cdc5e8ca fix predicate 2016-07-13 16:48:06 -04:00
John Krauss
7c8c5cca0a fix params 2016-07-13 16:42:02 -04:00
John Krauss
a946ab9d03 fix params in denominated polygon getmeasure 2016-07-13 16:28:50 -04:00
John Krauss
da127baa3c implementation for polygon/multipolygon weighted getmeasure 2016-07-13 16:24:33 -04:00
John Krauss
e89a88aa83 use subselects as joins are horrifically slow over FDW 2016-07-13 15:59:27 -04:00
John Krauss
af2259bb0a fix wrong number of variables INTO 2016-07-13 13:39:33 -04:00
John Krauss
fb083f4b9e fix typo 2016-07-13 13:30:05 -04:00
John Krauss
976e119abb fix typo 2016-07-13 12:21:53 -04:00
John Krauss
bbc6f9ef36 getmeasure bypassing several older functions, areas not yet implemented 2016-07-13 12:20:01 -04:00
John Krauss
5229279ee9 Merge branch 'comment-notices' into release-v-1.0.2-preview 2016-07-13 11:14:00 -04:00
John Krauss
2107796f07 updates to NEWS.md and observatory.control 2016-07-12 17:49:34 -04:00
John Krauss
6a39bedee7 fix ambiguous colname for categories in points too 2016-07-12 16:10:00 -04:00
John Krauss
81176d1df2 fix possible ambiguity in category colname 2016-07-12 16:06:19 -04:00
John Krauss
4b26eeda65 fix to correct segment for testarea area 2016-07-12 15:33:26 -04:00
John Krauss
4fc02f99e2 choose largest segment in the polygon 2016-07-12 14:37:43 -04:00
John Krauss
5bb4285528 fix typo 2016-07-12 14:16:28 -04:00
John Krauss
1e9c3fb860 fix typo 2016-07-12 14:15:00 -04:00
John Krauss
62a2c259a7 fix typo 2016-07-12 14:13:09 -04:00
John Krauss
61854a070d fix wrong quoting 2016-07-12 14:11:02 -04:00
John Krauss
8654c22c87 handle area categories properly 2016-07-12 14:06:43 -04:00
John Krauss
62c08864af remove bad "target_table" notice 2016-07-12 12:37:30 -04:00
John Krauss
af39a37b43 fix missing comma 2016-07-12 12:34:32 -04:00
John Krauss
26b61a6ddb minor formatting 2016-07-12 12:26:10 -04:00
John Krauss
965fb94704 fix bugs in obs_getcategory implementation 2016-07-12 12:22:06 -04:00
John Krauss
84dec8bdf4 simplify obs_getcategory and use obs_meta 2016-07-12 12:09:42 -04:00
John Krauss
ebc27dbbb7 faster obs_meta generation, use better formatting and handle NULL boundary_id 2016-07-12 11:52:56 -04:00
John Krauss
56fa19118b adjust expectations 2016-07-12 11:25:50 -04:00
John Krauss
4f3baac10a adjust expectations and make sure echo is none 2016-07-12 11:21:42 -04:00
John Krauss
b512985b46 drop/create less, better indexes 2016-07-12 11:15:08 -04:00
John Krauss
329b4dbca3 do not imitate foreign keys 2016-07-12 10:46:53 -04:00
John Krauss
897cf38d42 faster generation of obs-meta via indexes 2016-07-12 10:42:00 -04:00
John Krauss
fe6343c73f should use coaelesce, not nullif 2016-07-12 10:16:19 -04:00
John Krauss
26ee8aedb1 solve null identifier issue 2016-07-12 10:16:13 -04:00
John Krauss
66e2c6be54 create obs_meta out of dump band 2016-07-12 10:16:02 -04:00
John Krauss
6b41994a87 add missing formatstring args 2016-07-12 10:15:53 -04:00
John Krauss
d3d5cbdbbd use obs_meta in obs_getmeasurebyid 2016-07-12 10:15:44 -04:00
John Krauss
4d51ecc12e comment out notices 2016-07-12 10:14:59 -04:00
Rafa de la Torre
926435a908 Update NEWS and control file for v1.0.1 2016-07-01 18:57:21 +02:00
John Krauss
11dbb860ab preemptively set_srid for obs_getavailableboundaries 2016-07-01 18:43:05 +02:00
Carla
9ade6588e2 Add augment functions, add mocks for data retrieval, create own fdw functions to avoid cartodb dependency 2016-07-01 12:31:39 +02:00
John Krauss
17aeb5187b update to NEWS and control file in prep for release 2016-06-27 12:51:39 -04:00
John Krauss
cf7c115a76 Merge branch 'release-v-0.0.6' into fix-geom_geoid_colname 2016-06-27 12:39:09 -04:00
John Krauss
4e8341daab Merge branch 'release-v-0.0.6' into obs-dump-version 2016-06-27 12:37:15 -04:00
John Krauss
ca4327d3cd use data_geoid_colname with data table, reenable area-based measure tests that can catch this bug 2016-06-27 11:55:03 -04:00
John Krauss
bac48d7bea add missing RETURN 2016-06-22 14:35:40 -04:00
John Krauss
91383fe933 correct obs_getdumpversion to obs_dumpversion 2016-06-22 14:33:53 -04:00
John Krauss
446bdec30d obs_dumpversion and associated tests 2016-06-22 14:29:58 -04:00
John Krauss
f362e97f88 remove geometrycollection from obs_table fixture 2016-06-22 14:20:03 -04:00
John Krauss
975137641d fix ambiguous reference o the_geom 2016-06-22 13:38:29 -04:00
John Krauss
9379224629 use intersection against geom instead of && against bounds, update fixtures 2016-06-22 12:20:52 -04:00
Andy Eschbacher
8fbb9ebbcc updating version to 0.0.5 2016-05-26 13:48:37 -04:00
Andy Eschbacher
076e285ed7 adds notes on test calls 2016-05-26 13:37:02 -04:00
Andy Eschbacher
43dc37f62b Merge branch 'develop' into add-getmeasurebyid 2016-05-26 13:31:55 -04:00
Andy Eschbacher
49d584822c adds another test on different types of inputs 2016-05-26 13:28:56 -04:00
Mario de Frutos
faa72b69ed Version 0.0.4 files 2016-05-25 15:45:59 +02:00
John Krauss
de567e4dc7 fix expectations that were borked because of a holey fixture resolved with https://github.com/CartoDB/bigmetadata/issues/38 2016-05-24 15:18:40 -04:00
John Krauss
614bce3051 remove tight binding between metadata and tests for some of the exploration tests 2016-05-24 13:24:37 -04:00
Andy Eschbacher
b5267c14bf removes unneeded todo 2016-05-24 13:15:19 -04:00
Andy Eschbacher
afb548c75d adds tests 2016-05-24 12:02:32 -04:00
Andy Eschbacher
94756a2377 minor formatting changes 2016-05-24 11:27:41 -04:00
Andy Eschbacher
2e312464aa fixes geom_ref in where condition 2016-05-24 11:22:39 -04:00
Andy Eschbacher
3f77a384c7 adds missing comma 2016-05-24 11:06:53 -04:00
Andy Eschbacher
1ba7299fe4 adds obs_getmeasurebyid 2016-05-24 11:02:35 -04:00
John Krauss
45ae255223 update es.ine expectations and tests 2016-05-24 12:51:55 +00:00