cartodb4/dataservices-api
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
928 Commits 1 Branch 183 Tags 3.3 MiB
72998c324a
Commit Graph

394 Commits

Author SHA1 Message Date
Carla
8c5a4d32de Update setup.py 2016-04-01 10:15:27 +02:00
Mario de Frutos
d625b26e57 Fixed timeout and random problems 2016-04-01 08:45:40 +02:00
Carla
62da0eff21 Update test_helper.py 2016-03-31 16:45:27 +02:00
Carla
5f74d012a6 Update 00_install_test files 2016-03-31 16:25:59 +02:00
Carla Iriberri
1505e0e6ea Make isoline credentials independent 2016-03-31 15:52:52 +02:00
Mario de Frutos
0deb834531 Version 0.6.0 extension files 2016-03-28 09:11:01 +02:00
Mario de Frutos
89ec3dcfa6 Mapzen geocoder integrated 2016-03-23 13:37:30 +01:00
Mario de Frutos
d622e17608 Version 0.5.2-server 2016-03-23 13:11:57 +01:00
Mario de Frutos
357458f44d Check for some issues like empty input, recoverable exceptions, etc 2016-03-22 15:19:03 +01:00
Mario de Frutos
4061009df0 4xx generated empty responses 2016-03-17 22:54:19 +01:00
Mario de Frutos
47f2eba4e4 Removed old versioning system 2016-03-17 22:49:55 +01:00
Mario de Frutos
7802f85c4b Full 0.5.1 server file updated 2016-03-17 11:55:23 +01:00
Mario de Frutos
0f262510b2 User config helper for internal geocoder too 2016-03-17 11:48:25 +01:00
Mario de Frutos
b9f18dda69 Added exception info for config retrieving 2016-03-17 11:36:52 +01:00
Mario de Frutos
7acf70131b Change db and timeout attributes too 2016-03-17 11:01:56 +01:00
Mario de Frutos
0e44910165 Change to sentinel_id 2016-03-17 10:58:49 +01:00
Mario de Frutos
1c33a72fdc Change sentinel attribute to use the config one 2016-03-17 10:56:25 +01:00
Mario de Frutos
5d57624fd5 Merge pull request #107 from CartoDB/rename_and_metrics 
Rename and metrics
 2016-03-17 10:23:14 +01:00
Mario de Frutos
f0a49d5fbc Deleted the used_credits field 2016-03-17 10:15:12 +01:00
Mario de Frutos
6fb891ec86 Added headers for the generated files 2016-03-16 18:05:48 +01:00
Mario de Frutos
60f17fdb09 QPS manager for Mapzen 2016-03-14 11:21:26 +01:00
Mario de Frutos
bd2e380225 Add logger for the internal geocoder too 2016-03-08 16:47:49 +01:00
Mario de Frutos
c293b55c3c Added log and cost_per_hit config to the db config 2016-03-08 16:47:49 +01:00
Mario de Frutos
b97e838416 Refactor to move logic from SQL functions to Python 
- Moved the logic the retrieve the redis connection params to
  RedisDBConfig class
- Moved the logic that retrieve the services configuration to
  ServicesDBConfig
 2016-03-08 16:47:49 +01:00
Mario de Frutos
ac1627b5c5 Logger for geocoder metrics 2016-03-08 16:47:48 +01:00
Mario de Frutos
0b4d1bb17f Upgrade files for the 0.5.1 version of the server 2016-03-08 16:47:48 +01:00
Mario de Frutos
e867394261 Move the old version files to a folder 2016-03-08 16:47:48 +01:00
Mario de Frutos
7237e01601 Change metrics increment naming to reflect service instead of geocoder 2016-03-07 16:03:28 +01:00
Mario de Frutos
fbd42e3db0 Scaffolding for the 0.5.1 version 2016-03-07 16:03:23 +01:00
Mario de Frutos
df08b27068 Removed dependency with polyline and use our implementation 2016-03-02 10:49:02 +01:00
Mario de Frutos
4d04882c18 Polyline decoder 2016-03-02 10:43:27 +01:00
Mario de Frutos
9a36445661 Sentinel id could be removed safely from the config 
Removing the sentinel_master_id property from the cdb_conf
redis config, the extension is going to use a single redis instance
instead of Sentinel
 2016-02-26 10:49:10 +01:00
Mario de Frutos
e6b0e3794b Mapzen integration for the server side 2016-02-26 10:49:10 +01:00
Mario de Frutos
d2e73a69fa Python library supports Mapzen routing 2016-02-26 10:49:10 +01:00
Luis Bosque
2a807af6df Fix upgrade/downgrade paths to 0.5.0 2016-02-26 10:49:09 +01:00
Luis Bosque
6c5b1b4e99 Use strictredis if sentinel_master_id is not null 
Also, use only a redis_host and redis_port attributes either if the
connection is to redis or to sentinel
 2016-02-26 10:49:09 +01:00
Luis Bosque
04617332a2 Add _redis_conf_params type alter 
In order to add or remove redis_host attribute to upgrade/downgrade path
 2016-02-26 10:49:09 +01:00
Luis Bosque
93463b3032 Support using a common redis connection 
If sentinel_host or sentinel_cluster_id is not provided it will try to
connect with a redis_host parameter
 2016-02-26 10:49:08 +01:00
Mario de Frutos
d27b2a2b78 Block google services users to use isolines functions 
Due some service restrictions, google services users couldn't use
the HERE services which includes the isolines functions.
 2016-02-26 10:42:05 +01:00
Mario de Frutos
448f47589a Renamed from routing to isolines helper 2016-02-22 10:28:19 +01:00
Mario de Frutos
e764b9036d Quota check for the routing feature 
We have refactor all the quota logic and extracted to a new QuotaChecker
class in order to have it ready to create a factory when needed

Added the logic for the routing quota check
 2016-02-18 15:40:55 +01:00
Mario de Frutos
32c146336d Change the url to production in here routing functions 2016-02-12 14:52:00 +01:00
Mario de Frutos
93f003a672 Fixed error in the imports for the version 0.3.0 2016-02-12 12:55:12 +01:00
Mario de Frutos
3a4130282e Limit the mode types accepted 2016-02-12 10:01:42 +01:00
Mario de Frutos
f36a345db2 Updated python library version with routing part 2016-02-10 22:26:53 +01:00
Mario de Frutos
5c1b320555 Routing server side working properly 2016-02-10 22:26:32 +01:00
Carla Iriberri
d0f7ac4d49 Fix conflict 2016-02-10 20:00:48 +01:00
Carla Iriberri
d4a2184ce0 Multiple fixes 2016-02-10 19:59:00 +01:00
Carla
42d0812383 Fix indents 2016-02-10 17:58:48 +01:00
Carla Iriberri
e996d3796a Comment quota code 2016-02-10 17:42:11 +01:00
Carla Iriberri
b97ce043c3 Avoid conflict in gitignore file 2016-02-10 17:19:16 +01:00
Carla Iriberri
bd3f6678c1 Upload server functions for routing 2016-02-10 17:17:53 +01:00
Mario de Frutos
54622d5c81 Added the routing config and metrics 2016-02-10 17:01:41 +01:00
Mario de Frutos
75a915019f Helper to transform to Postgis multipolygon 2016-02-10 16:01:03 +01:00
Mario de Frutos
13cfee2d4c Fixed tests for the heremaps geocoder 2016-02-10 15:24:25 +01:00
Mario de Frutos
3b0f92d5e7 Routing isolines python library 2016-02-10 15:11:45 +01:00
Mario de Frutos
910381e4a6 Dataservices server 0.4.0 scaffold 2016-02-09 10:51:12 +01:00
Mario de Frutos
7544b3c4ab Freeze 0.3.0 server file 2016-02-09 10:20:38 +01:00
Mario de Frutos
142affc95e Removed legacy name for street function 2016-02-08 13:27:19 +01:00
Mario de Frutos
95c23edd1b Changed the sentinel test config 2016-02-08 12:39:30 +01:00
Mario de Frutos
2994a1b402 Geocoder server renamed to dataservices server extension 2016-02-05 17:57:22 +01:00
Mario de Frutos
2a9d6c14bd Added metrics storage for internal functions and trim for all the params 2016-02-05 16:00:46 +01:00
Mario de Frutos
17b8b5942e Refactor to make the service config extensible to other services 2016-02-05 10:18:21 +01:00
Mario de Frutos
1665cf8069 Fixed some python import calls due the refactor made 2016-02-04 20:04:46 +01:00
Mario de Frutos
43b09da396 Commit cdb_geocoder_server--0.2.0.sql into VC 2016-02-04 16:30:59 +01:00
Mario de Frutos
db715d6d54 Added security definer permission to the sql part too 2016-02-04 15:42:22 +01:00
Mario de Frutos
6676b26250 Hotfix: Added to the downgrade file too 2016-02-04 11:48:24 +01:00
Mario de Frutos
7a0b927acd Hotfix: Other method that need security definer 2016-02-04 11:03:38 +01:00
Mario de Frutos
8176eee356 Hotfix: Permission problems without security definer 2016-02-04 10:57:54 +01:00
Mario de Frutos
1367c46957 Added automatic generated files warning header 2016-02-04 10:38:12 +01:00
Mario de Frutos
3960c13484 Refactor python library to unify and rename as cdb_services 2016-02-03 10:21:57 +01:00
Mario de Frutos
e7c58b9a51 Google geocoder working 2016-02-03 10:21:34 +01:00
Mario de Frutos
a5d6650e2f Freeze the 0.1.0 complete version of server extension 2016-02-03 10:17:52 +01:00
Mario de Frutos
440dadb5e8 Commit cdb_geocoder_server--0.1.0.sql into VC 
We need to store this files because they are used in the execution
of the make file and if one of this doesn't exists the make
execution is going to crash like this:

make: *** No rule to make target `cdb_geocoder_server--0.1.0.sql',
needed by `all'.  Stop.
 2016-02-03 10:16:31 +01:00
Mario de Frutos
e73736cbec Restrict the python-dateutil library to avoid conflict with other projects that need that specific version 2016-01-26 19:57:18 +01:00
Mario de Frutos
bb629dfe4b Change the signature name for the geocoder street point function 2016-01-26 16:22:28 +01:00
Mario de Frutos
343bcf539a Add security definer to connect redis function too 2016-01-26 13:15:15 +01:00
Mario de Frutos
2409d548b6 Grants to be applied again to give permissions to the new functions 2016-01-26 12:55:12 +01:00
Mario de Frutos
35b59c448f Add needed security definer to config function 2016-01-26 12:55:06 +01:00
Rafa de la Torre
593da7926a Remove duplicated old rule 2016-01-25 17:57:43 +01:00
Mario de Frutos
4e53397f1c Change heremaps module to support host as parameter 2016-01-25 17:36:18 +01:00
Mario de Frutos
fffcef90a5 Check for the mandatories configurations in Redis before proceed 2016-01-25 08:17:03 +01:00
Mario de Frutos
1a8109ecdf Quote NULL values to avoid treat the NULL as a string 2016-01-22 19:17:16 +01:00
Rafa de la Torre
63651f512b Commit cdb_geocoder_server--0.0.1.sql into VC 
After making sure it is the same version as in production. Same as
generated from last 0.0.1beta2 tag.
 2016-01-22 18:30:28 +01:00
Rafa de la Torre
c129a8c82d Fix makefile 
Populate missing variable and also make sure devclean deletes the right
files.
 2016-01-22 18:20:09 +01:00
Mario de Frutos
d3d6147b8e Server extension makefile migrate the upgrades and downgrades too 2016-01-22 17:24:18 +01:00
Mario de Frutos
e46600325b Use the real heremaps url 2016-01-22 16:39:55 +01:00
Mario de Frutos
9062ff8b74 Added server tests for the street functions 2016-01-22 15:56:17 +01:00
Mario de Frutos
db3eaf31ad Versioned the server tests and created the upgrade and downgrade files 2016-01-22 15:36:16 +01:00
Mario de Frutos
984519e7f1 Change to have functions for all the geocoder types but only one function to call them 2016-01-22 10:05:46 +01:00
Mario de Frutos
c74947b0a5 Cartodb geocoder python module tests fixed 2016-01-22 10:05:40 +01:00
Mario de Frutos
aced68096b Heremaps tests fixed 2016-01-21 18:07:07 +01:00
Mario de Frutos
8a51558068 We need to have one date at least to check the quota 2016-01-21 18:06:04 +01:00
Mario de Frutos
3488d3f990 Pass the amount always 2016-01-21 18:05:34 +01:00
Mario de Frutos
111804dafc Refactor of the google geocoder keys in the config object 2016-01-21 18:05:08 +01:00
Mario de Frutos
af051e2ed5 Set the soft geocoding limit always 2016-01-21 18:04:08 +01:00
Mario de Frutos
4d0cabb429 Add username and orgname to the config object instead of pass them to every object 2016-01-21 18:03:23 +01:00
Mario de Frutos
7c3ab87b78 When geocoder API calls heremaps increments the usage metrics 2016-01-21 13:45:29 +01:00
Mario de Frutos
ad9c16b4df Nokia geocoder config moved to the config helper 2016-01-21 08:40:25 +01:00
Mario de Frutos
fc35911b91 Geocoder street function with quota checking 2016-01-20 20:57:24 +01:00
Mario de Frutos
b2fa8739e2 User config now is retrieved from redis 2016-01-20 20:56:19 +01:00
Mario de Frutos
a7371c0a48 geocoder api server extension points to the new version 2016-01-20 16:03:30 +01:00
Mario de Frutos
6740ada16e Makefile create the upgrade sql files for the extension too 2016-01-20 16:02:48 +01:00
Mario de Frutos
9ecabf9144 Create either metrics and metadata redis connections 2016-01-20 16:02:16 +01:00
Mario de Frutos
922c531313 Added orgname to the arguments we pass to the server 2015-12-03 11:03:10 +01:00
Mario de Frutos
941e7084e6 Change functions to user username and remove JSON config passed as argument 2015-12-02 18:54:49 +01:00
Mario de Frutos
082d876c8d Create and give permissions to the server user 2015-12-01 17:23:32 +01:00
Mario de Frutos
97cab091b6 Added cdb_* prefix to all the functions 2015-11-24 15:36:52 +01:00
Mario de Frutos
2b141452b4 Changed api key verifying to client instead of server 2015-11-24 12:44:52 +01:00
Mario de Frutos
8434a830b2 Changed server geocode ip address signature to match client 2015-11-24 10:14:34 +01:00
Mario de Frutos
fa1d7af410 Deleted unused test for config tables 2015-11-23 12:53:46 +01:00
Mario de Frutos
6722f64f23 Added server specification API tests 2015-11-23 11:48:24 +01:00
Mario de Frutos
d2a096907e Removed unused examples for python geocoder library 2015-11-23 09:50:10 +01:00
Mario de Frutos
9e30bf2223 New Redis structure for services 2015-11-23 09:40:10 +01:00
Mario de Frutos
928e33b489 Added config helper for user and geocoder config 2015-11-23 09:39:47 +01:00
Mario de Frutos
e28aa9a3a2 Removed the _conf table functions and change to use cartodb.cdb_conf 2015-11-23 09:39:47 +01:00
Mario de Frutos
e8983283da Redis connection get from sentinel master 2015-11-23 09:39:47 +01:00
Mario de Frutos
b38a9b2fd3 Added redis config logic 2015-11-23 09:39:47 +01:00
Mario de Frutos
da12d6628d Extracted redis connection and quota check to be reusable 2015-11-23 09:39:47 +01:00
Rafa de la Torre
05d75c82ee Merge pull request #25 from CartoDB/add-config-table-and-funcs 
Config table and functions for server extension
 2015-11-12 17:04:26 +01:00
Rafa de la Torre
b45aba4278 Config table and functions for server extension 
Pretty much as done in cartodb and client extensions.
 2015-11-12 13:02:51 +01:00
Carla Iriberri
e3269af48f Removes double tests for namedplaces 2015-11-12 12:49:54 +01:00
Rafa de la Torre
6efebdc668 Merge pull request #23 from CartoDB/add-missing-functions 
Add missing functions
 2015-11-12 12:27:31 +01:00
Guido Fioravantti
c1d4ffb37a Exception typo 2015-11-12 12:11:05 +01:00
Guido Fioravantti
ff3f5a1f4c Removes unnecessary arrays 2015-11-12 12:07:15 +01:00
Guido Fioravantti
2afb541d8d Fix indentation 2015-11-12 11:58:32 +01:00
Guido Fioravantti
4ba76df016 Improves ip query 2015-11-12 11:57:28 +01:00
Carla Iriberri
e830134ec5 Revert "Adding tests" 
This reverts commit 3f6df14fc7.
 2015-11-12 11:53:29 +01:00
Carla Iriberri
1216e58120 Editing test output 2015-11-12 11:47:22 +01:00
Guido Fioravantti
84f45f82b4 Typo in .gitignore 2015-11-12 11:40:51 +01:00
Carla
ec6ebdd683 Update 50_namedplaces_test.out 2015-11-12 11:38:39 +01:00
Carla
4283d3a25b Update 50_namedplaces_test.sql 2015-11-12 11:37:32 +01:00
Carla
18f6e141a8 Update 50_namedplaces_test.sql 2015-11-12 11:37:04 +01:00
Carla Iriberri
3f6df14fc7 Adding tests 2015-11-12 11:35:12 +01:00
Guido Fioravantti
b210182f27 Adds rule to ignore results/*.out files 2015-11-12 11:32:36 +01:00
Guido Fioravantti
b71947bad0 Fixes plural forms 2015-11-12 11:29:25 +01:00
Carla Iriberri
7ba807d4a7 Adding more tests 2015-11-12 11:28:34 +01:00
Guido Fioravantti
20cc610da5 Adds postalcode polygon and renames 2015-11-12 11:20:12 +01:00
Guido Fioravantti
cb19a8ca08 Adds postalcode with country 2015-11-12 11:06:50 +01:00
Rafa de la Torre
4e7525cc88 Merge pull request #21 from CartoDB/implement_server_functions 
Implement server functions
 2015-11-11 19:35:22 +01:00
Guido Fioravantti
c116541b10 Adds cdb_geocoder_server.geocode_postalcode_point and tests 2015-11-11 19:25:48 +01:00
Mario de Frutos
6b9a8537c6 Added new requeriments 2015-11-11 18:46:46 +01:00
Carla Iriberri
2b2d0bbc33 Adding more tests 2015-11-11 18:24:02 +01:00
Carla Iriberri
3c56d0db81 Merge branch 'implement_server_functions' of https://github.com/CartoDB/geocoder-api into implement_server_functions 2015-11-11 18:14:34 +01:00
Carla Iriberri
4aa757ac88 Adds namedplace function with 3 params #6 2015-11-11 18:14:22 +01:00
Guido Fioravantti
50abb76b6b Fixes cdb_geocoder_server.geocode_ip_point 2015-11-11 17:48:11 +01:00
Mario de Frutos
55337efc3a Added schema to server functions and fixed some errors 2015-11-11 17:38:14 +01:00
Carla Iriberri
b54c417754 Adding country, city function for namedplaces 2015-11-11 17:17:18 +01:00
Carla Iriberri
f2bcd1b103 Killing trailspaces 2015-11-11 16:30:34 +01:00
Carla Iriberri
6e301b0f9e Adds first function for namedplaces #6 2015-11-11 16:29:17 +01:00
Guido Fioravantti
24c0e01b06 Adds limit 1 to _geocode_ip_point 2015-11-11 16:07:55 +01:00
Guido Fioravantti
66fd33da37 Fixes param type for geocode_ip 2015-11-11 15:43:11 +01:00
Guido Fioravantti
1c44fbbf56 Adds 90_geocode_ip and tests 2015-11-11 15:38:18 +01:00
Carla
4592dc8644 Delete 40_admin1_test.out 2015-11-11 14:06:53 +01:00
Carla Iriberri
93513d6954 Adding a new function 2015-11-11 14:05:17 +01:00
Carla Iriberri
8d450a7870 Adds first admin1 function #6 2015-11-11 13:33:14 +01:00
Mario de Frutos
6a75eae03c Added soft/hard geocoder limit 2015-11-11 13:17:15 +01:00
Carla
f95f5d950e Create 30_admin1.sql 2015-11-11 12:46:07 +01:00
Mario de Frutos
a18bfa9554 Added quota service tests 2015-11-11 12:31:00 +01:00
Mario de Frutos
fbd48135b2 Added tests for user service 2015-11-11 12:31:00 +01:00
Mario de Frutos
f22807553f Removed logger 2015-11-11 12:30:59 +01:00
Mario de Frutos
29ec5da86d Added properties instead of getters 2015-11-11 12:30:59 +01:00
Mario de Frutos
7eab3e1f90 Refactor, extracted user_service 2015-11-11 12:30:59 +01:00
Mario de Frutos
bb3b2cc2da Change to use the installed package 2015-11-11 12:30:59 +01:00
Mario de Frutos
ab19c1b8ed Added setup.py for the package 2015-11-11 12:30:59 +01:00
Mario de Frutos
8ed26d4dd0 Client example using the cdb_conf table 2015-11-11 12:30:59 +01:00
Mario de Frutos
76c3b18dd6 Client function example 2015-11-11 12:30:59 +01:00
Mario de Frutos
a375e9dcfb Cached redis connections 2015-11-11 12:30:59 +01:00
Mario de Frutos
904336a298 Added plpythonu function example 2015-11-11 12:30:59 +01:00
Mario de Frutos
48052f8a70 Increment every time a row is georeferenced successfully 2015-11-11 12:30:59 +01:00
Mario de Frutos
1b347b7ad0 Checking from redis at localhost 2015-11-11 12:30:58 +01:00
Rafa de la Torre
738138b205 Move admin0 server functions around 
- move files to its right place
- add some boilerplate for test setup
- add tests
 2015-11-10 19:27:07 +01:00
Rafa de la Torre
7dfd08c947 Fix typo 2015-11-10 17:17:14 +01:00
Guido Fioravantti
88a7e479c9 Merge pull request #10 from CartoDB/adds-conf-table 
Connects with conf table, implements helper and adds tests
 2015-11-10 15:56:13 +01:00
Rafa de la Torre
2977a64ef4 Merge pull request #11 from CartoDB/internal-geocoder-server-functions 
Internal geocoder server functions
 2015-11-10 15:52:04 +01:00
Guido Fioravantti
389b0a2b31 Changes conf table config 2015-11-10 15:36:57 +01:00
Rafa de la Torre
08aac5a362 Add tx_id (transaction id) param 2015-11-10 15:33:06 +01:00
Guido Fioravantti
aabc873eac Connects with conf table, implements helper and adds tests 2015-11-10 15:31:53 +01:00
Rafa de la Torre
3d274c4dd1 Remove schema_triggers as a dependency 
(it is an indirect dependency, maybe to remove in the future)
 2015-11-10 12:50:33 +01:00
Rafa de la Torre
4e23bfaa3a Add server functions for country geocoder #6 2015-11-10 12:36:53 +01:00
Guido Fioravantti
0e9d1451c6 Removes redundant VOLATILE modifier 2015-11-10 11:36:48 +01:00
Guido Fioravantti
6bdc517a45 Changes geocode_street signature to include city and rename state_province 2015-11-10 11:34:58 +01:00
Rafa de la Torre
f97dfceea6 Add cdb_geocoder as a dependency 2015-11-10 11:13:21 +01:00
Rafa de la Torre
deab21dff5 Move .gitignore and add cdb_geocoder_server--0.0.1.sql FTM 2015-11-10 11:09:25 +01:00
Rafa de la Torre
40c8187dee New README.md for the server extension 2015-11-10 11:04:48 +01:00
Rafa de la Torre
419c07808e Remove schema from function definition 
The schema is implicit during extension creation.
 2015-11-10 10:56:36 +01:00
Rafa de la Torre
607a8ae801 Remove artifact until we roll-out version 0.0.1 2015-11-10 10:55:20 +01:00
Guido Fioravantti
4a28d89480 Fixes typo 2015-11-10 10:23:47 +01:00
Guido Fioravantti
97af24c2e0 Removes unused functions 2015-11-06 18:28:29 +01:00
Guido Fioravantti
38e84201cb Reorganisation 2015-11-06 18:23:47 +01:00
Guido Fioravantti
d772033b45 Adds cdb_cartodb_server schema 2015-11-06 18:13:57 +01:00
Guido Fioravantti
0297214c53 Initial cdb_geocoder_server commit 2015-11-06 17:22:39 +01:00
Guido Fioravantti
e367456156 Make heremaps module pip installable 2015-11-06 12:07:41 +01:00
Mario de Frutos
a77b8f3686 Created new structure 2015-11-05 17:05:07 +01:00