dataservices-api/README.md

84 lines
3.9 KiB
Markdown
Raw Normal View History

2016-02-25 21:30:19 +08:00
# Data Services API
The CartoDB Data Services SQL API (server and client FTM)
2016-01-25 23:22:00 +08:00
### Deploy instructions
2016-02-25 21:30:19 +08:00
Steps to deploy a new Data Services API version :
2016-01-25 23:22:00 +08:00
- Deploy new version of dataservices API to all servers
- Update the server user using: ALTER EXTENSION cdb_dataservices_server UPDATE TO '<CURRENT_VERSION>';
2016-01-25 23:22:00 +08:00
- Update the python dependencies if needed: **cartodb_geocoder** and **heremaps**
- Add the needed config in the `cdb_conf` table:
- `redis_metadata_config` and `redis_metrics_conf`
- `{"sentinel_host": "localhost", "sentinel_port": 26379, "sentinel_master_id": "mymaster", "timeout": 0.1, "redis_db": 5}`
2016-01-25 23:22:00 +08:00
- `heremaps_conf`
- `{"app_id": "APP_ID", "app_code": "APP_CODE"}`
- Deploy the client to all the servers with the new version
- Deploy the editor with the new dataservices api version changed (https://github.com/CartoDB/cartodb/blob/master/app/models/user/db_service.rb#L18)
2016-01-25 23:22:00 +08:00
- Execute the rails task to update first the CartoDB team organizaton to test in production
- `RAILS_ENV=production bundle exec rake cartodb:db:configure_geocoder_extension_for_organizations['team']`
- Check if all works perfectly for our team. If so, execute the rake tasks to update all the users and organizations:
- `RAILS_ENV=production bundle exec rake cartodb:db:configure_geocoder_extension_for_organizations['', true]`
- `RAILS_ENV=production bundle exec rake cartodb:db:configure_geocoder_extension_for_non_org_users['', true]`
- Freeze the generated SQL file for the version. Eg. cdb_dataservices_server--0.0.1.sql
2016-02-24 18:54:55 +08:00
### Local install instructions
2016-03-31 21:02:19 +08:00
- install data services geocoder extension
2016-02-24 18:54:55 +08:00
```
git clone git@github.com:CartoDB/data-services.git
2016-03-31 21:02:19 +08:00
cd data-services/geocoder/extension
2016-02-24 18:54:55 +08:00
sudo make install
```
- install server and client extensions
```
cd client && sudo make install
2016-03-31 21:02:19 +08:00
cd server/extension && sudo make install
2016-02-24 18:54:55 +08:00
```
- install python library
```
cd server/lib/python/cartodb_services && python setup.py install
```
- install extensions in user database
```
create extension cdb_geocoder;
create extension plproxy;
create extension cdb_dataservices_server;
create extension cdb_dataservices_client;
```
- add configuration for different services in user database
```
2016-03-31 22:01:22 +08:00
# If sentinel is used:
SELECT CDB_Conf_SetConf('redis_metadata_config', '{"sentinel_host": "localhost", "sentinel_port": 26379, "sentinel_master_id": "mymaster", "timeout": 0.1, "redis_db": 5}');
SELECT CDB_Conf_SetConf('redis_metrics_config', '{"sentinel_host": "localhost", "sentinel_port": 26379, "sentinel_master_id": "", "timeout": 0.1, "redis_db": 5}');
# If sentinel is not used
SELECT CDB_Conf_SetConf('redis_metadata_config', '{"redis_host": "localhost", "redis_port": 26379, "sentinel_master_id": "mymaster", "timeout": 0.1, "redis_db": 5}');
SELECT CDB_Conf_SetConf('redis_metrics_config', '{"redis_host": "localhost", "redis_port": 6379, "sentinel_master_id": "mymaster", "timeout": 0.1, "redis_db": 5}');
SELECT CDB_Conf_SetConf('heremaps_conf', '{"app_id": "APP_ID", "app_code": "APP_CODE", "geocoder_cost_per_hit": "COST_PER_HIT"}');
SELECT CDB_Conf_SetConf('user_config', '{"is_organization": false, "entity_name": "<YOUR_USERNAME>"}')
SELECT CDB_Conf_SetConf('mapzen_conf', '{"routing_app_key": "ROUTING_API_KEY", "geocoder_app_key": "GEOCODER_API_KEY"}');
SELECT CDB_Conf_SetConf('logger_con', '{"geocoder_log_path": "/tmp/geocodings.log"}')
2016-02-24 18:54:55 +08:00
```
2016-03-31 22:01:22 +08:00
- configure plproxy to point to the a database (you can use a specific database for the server or your same user)
2016-02-24 18:54:55 +08:00
```
2016-03-31 22:01:22 +08:00
SELECT CDB_Conf_SetConf('geocoder_server_config', '{ "connection_str": "host=localhost port=5432 dbname=<SERVER_DB_NAME> user=postgres"}');
2016-02-24 18:54:55 +08:00
```
2016-02-24 19:13:57 +08:00
2016-03-31 21:02:19 +08:00
- configure the search path in order to be able to execute the functions without using the schema:
2016-02-24 19:13:57 +08:00
```
2016-03-31 22:01:22 +08:00
ALTER ROLE "<USER_ROLE>" SET search_path="$user", public, cartodb, cdb_dataservices_client;
2016-02-24 19:13:57 +08:00
```