CartoDB-SQL-API/NEWS.md

1116 lines
26 KiB
Markdown
Raw Normal View History

# Changelog
2016-11-30 23:36:25 +08:00
2020-01-27 19:54:50 +08:00
## 5.0.2
2020-01-27 19:57:28 +08:00
Released 2020-mm-dd
- Updated allowed list of custom headers with the ones for metrics
2020-01-27 19:54:50 +08:00
2019-11-13 20:16:32 +08:00
## 5.0.1
2020-01-27 19:57:28 +08:00
Released 2020-01-27
2019-11-13 20:16:32 +08:00
2019-12-30 18:50:50 +08:00
- Removed `jshint` as linter in favour of `eslint` to check syntax, find problems, and enforce code style.
2019-12-30 18:17:36 +08:00
- Stop using two different tools for package management, testing, and any other developer workflow.
- Removes Makefile and related bash scripts
- Use npm scripts as the only tool for testing, CI and linting.
- Simplified CI configuration.
- Improved documentation:
- Centralized several documents into README.md
- Remove outdated sections
- Update old sections
- Added missing sections.
- Remove deprecated coverage tool istanbul, using nyc instead.
2019-10-08 01:30:30 +08:00
## 5.0.0
2019-11-13 20:10:00 +08:00
Released 2019-11-13
2019-10-08 01:30:30 +08:00
Breaking changes:
- Removed "base_url" definition in configuration files. Added new property "routes". See [`cec1c60`](https://github.com/CartoDB/CartoDB-SQL-API/commit/cec1c609c04d134f45ee74a81f82c07a19bf11bd) for more details.
2019-10-08 01:39:58 +08:00
- Remove development client and munin tool, both abandoned years ago.
2019-10-08 01:30:30 +08:00
Announcements:
- Added mechanism to inject custom middlewares through configuration.
2019-10-08 17:01:39 +08:00
- Stop requiring unused config properties: "base_url".
2019-10-21 22:23:36 +08:00
- Be able to set a coherent TTL in Cache-Control header to expire all resources belonging to a query simultaneously.
2019-11-12 17:12:23 +08:00
- Attach error middleware to api router instead of for each controller.
2019-10-08 01:30:30 +08:00
2019-07-24 23:44:04 +08:00
## 4.0.0
2019-09-30 23:47:25 +08:00
Released 2019-09-30
2019-04-03 15:29:40 +08:00
2019-07-24 23:44:04 +08:00
Breaking:
* Remove in-memory table cache and `/cachestatus` endpoint.
* Update `cartodb-query-tables` to version [`0.6.3`](https://github.com/CartoDB/node-cartodb-query-tables/blob/0.6.3/NEWS.md#version-063).
* Update `cartodb-psql` to version [`0.14.0`](https://github.com/CartoDB/node-cartodb-psql/blob/d8dae1d9726da7fb96806062247649fd6fb3c2f4/NEWS.md#version-0140-2019-09-10).
2019-07-24 23:44:04 +08:00
2019-04-03 15:29:40 +08:00
Announcements:
2019-07-09 22:55:26 +08:00
* Update `cartodb-query-tables` to version [`0.5.0`](https://github.com/CartoDB/node-cartodb-query-tables/releases/tag/0.5.0)
2019-07-05 21:43:54 +08:00
* Cache control header fine tuning. Set a shorter value for "max-age" directive if there is no way to know when to trigger the invalidation.
2019-04-03 15:29:40 +08:00
* Upgrade devel dependency `sqlite3` to version `4.0.6`
2019-02-27 23:14:48 +08:00
* Log queries (https://github.com/CartoDB/CartoDB-SQL-API/pull/574)
2019-04-05 18:42:49 +08:00
* Improve batch-queries draining while exiting the process #582
2019-05-30 19:37:33 +08:00
* Implement a mechanism to short out hung connections in copy-from endpoints.
2019-06-03 18:48:45 +08:00
* Implement POST method for copy-to endpoint.
2019-06-04 23:09:56 +08:00
* Log NOTICE's and WARNING's coming from COPY TO queries.
2019-06-04 17:47:08 +08:00
* Retrieve the exact PG field type information in JSON format responses.
2019-07-11 17:40:01 +08:00
* Middlewarify client abort query checker.
2019-07-30 15:58:49 +08:00
* Middlewarify query controller.
2019-07-31 22:00:38 +08:00
* Set a hard limit on the size of the X-SQLAPI-Log header.
* Update cartodb-psql to 0.14.0 and use the timeout parameter for pg.query.
2019-09-27 15:52:51 +08:00
* Expose rate limit headers for CORS requests.
2019-02-22 20:07:54 +08:00
## 3.0.0
2019-02-22 19:57:40 +08:00
Released 2019-02-22
2019-01-16 21:43:50 +08:00
Breaking changes:
* Drop support for Node.js 6
* Drop support for npm 3
* Drop support for Postgres 9.5
* Drop support for PosGIS 2.2
* Drop support for Redis 3
2019-01-17 22:11:43 +08:00
Announcements:
* Deps:
* Upgrade `debug` to version 4.1.1
* Upgrade `express` to version 4.16.4
* Upgrade `request` to version 2.88.0
* Dev deps:
* Upgrade `jshint` to version 2.9.7
* Upgrade `mocha` to version 5.2.0
* Upgrade `zipfile` to version 0.5.12
2019-01-16 21:43:50 +08:00
2019-01-04 17:31:08 +08:00
## 2.4.0
2019-01-16 21:41:50 +08:00
Released 2019-01-16
2018-09-18 16:33:25 +08:00
2019-01-02 18:16:00 +08:00
Announcements:
* Update docs: compatible Node.js and npm versions
2019-01-03 21:21:56 +08:00
* Set platform limits message also on streaming responses
* Consider cancelled queries as platform limits.
2019-01-04 17:31:08 +08:00
* Report fine-grained Garbage Collector stats
2019-01-09 16:04:45 +08:00
* Both query endpoints as the same one in rate limits terms
2019-01-10 23:58:55 +08:00
* Adding Authorization to Access-Control-Allow-Headers (https://github.com/CartoDB/CartoDB-SQL-API/issues/534)
2018-12-27 00:23:44 +08:00
2018-12-26 22:33:57 +08:00
## 2.3.1
2018-12-27 00:22:00 +08:00
Released 2018-12-23
Bug fixes:
* Update carto-package.json
2018-12-26 22:33:57 +08:00
2018-11-22 18:45:03 +08:00
## 2.3.0
2018-12-26 22:31:36 +08:00
Released 2018-12-26
2018-09-18 16:33:25 +08:00
2018-11-22 18:45:03 +08:00
Announcements:
* Support Node.js 10
* Add package-lock.json
* Configure Travis CI to run docker tests against Node.js 6 & 10 versions
2018-12-11 00:24:53 +08:00
* Update cartodb-psql to 0.13.1 (type cache depends now on db host)
2018-11-22 18:45:03 +08:00
2018-10-24 21:50:45 +08:00
Bug fixes:
2018-11-22 18:45:03 +08:00
* Do not use `assert` to throw erros as in Node.js > 6 wraps the original error, the keyword 'throw' does the trick and it's backwards compatible
* Make all modules to use strict mode semantics.
2018-12-07 17:31:04 +08:00
* Avoid too long messages in `X-SQLAPI-Errors` header #543
2018-09-18 16:33:25 +08:00
2018-07-25 16:00:13 +08:00
## 2.2.1
2018-09-18 16:11:53 +08:00
Released 2018-09-18
2018-07-25 16:00:13 +08:00
2018-08-10 18:41:29 +08:00
Bug fixes:
* Errors from zlib while gunzipping (`/sql/copyfrom` compressed requests) are now handled correctly.
2018-08-30 21:08:39 +08:00
* Ensure exports temporal folder
2018-09-17 23:52:08 +08:00
* Fix an issue with COPY TO returning paused DB connections to the pool #537
2018-07-25 16:00:13 +08:00
2018-07-23 23:03:41 +08:00
## 2.2.0
2018-07-25 15:55:56 +08:00
Released 2018-07-25
2018-06-13 19:29:26 +08:00
2018-07-02 17:30:07 +08:00
Announcements:
* Improve error message when the DB query is over the user's limits
2018-07-06 17:46:30 +08:00
* Updated cartodb-redis to 2.0.1
2018-07-23 23:03:41 +08:00
* Modify the COPY query limits:
- Instead of the generic timeout, it now uses a 5h timeout.
- For COPY FROM, the limit is size-based, up to the remaining DB quota
- The largest COPY FROM that can be made in a single POST request is limited to 2GB
2018-07-06 17:46:30 +08:00
2018-06-13 19:29:26 +08:00
2018-06-12 18:23:32 +08:00
## 2.1.0
2018-06-13 16:39:44 +08:00
Released 2018-06-13
2018-03-22 23:34:20 +08:00
Notice:
- This release changes the way that authentication works internally. You'll need to run `bundle exec rake carto:api_key:create_default` in your development environment to keep working.
2018-05-07 16:45:29 +08:00
New features:
2018-05-28 21:49:38 +08:00
* CI tests with Ubuntu Xenial + PostgreSQL 10.1 and Ubuntu Precise + PostgreSQL 9.5
* Making version 2.0.0 configuration parameters backwards compatible
2018-06-12 18:23:32 +08:00
* New endpoint for COPY commands
2018-05-28 21:49:38 +08:00
Announcements:
2018-06-06 21:05:47 +08:00
* Updated carto-psql to 0.12.0
2018-06-08 17:39:23 +08:00
* [Test] Update sqlite3 to 4.0.0
2018-05-07 16:45:29 +08:00
2018-03-22 23:34:20 +08:00
2018-03-22 19:06:18 +08:00
## 2.0.0
Released 2018-03-22
Breaking changes:
* Needs Redis v4
2018-02-27 18:22:40 +08:00
2018-02-28 18:20:59 +08:00
Features:
* Implemented middleware to authenticate users throug the new Authorization System.
2018-03-22 19:06:18 +08:00
* Upgrades cartodb-redis to 1.0.0
* Rate limit feature (disabled by default)
2018-02-27 18:22:40 +08:00
2018-02-12 23:04:47 +08:00
## 1.48.1
2018-02-27 18:20:21 +08:00
Released 2018-02-27
2018-02-12 23:04:47 +08:00
Announcements:
* Added `RESIZE=yes` param to gdal shapefile driver, wich optimizes size of exported shapefiles [#462](https://github.com/CartoDB/CartoDB-SQL-API/pull/462)
2018-02-12 23:04:47 +08:00
2018-02-12 23:02:15 +08:00
## 1.48.0
2018-02-12 23:04:47 +08:00
Released 2018-02-12
2017-08-13 23:52:35 +08:00
2017-09-20 23:23:06 +08:00
Announcements:
* Change work in progress jobs endpoint from `[..]/job/wip` to `[..]/jobs-wip`
* Documentation updates for Docs repo issue #840, GPKG Export.
2017-11-17 22:10:53 +08:00
* Fix SHP exports, now it uses "the_geom" column by default when a dataset has more than one geometry column.
2017-12-13 22:10:04 +08:00
* Logging all errors
2018-01-11 17:16:51 +08:00
* Fix Postgres version in travis
* Fix Python timeout error
2018-02-12 22:55:58 +08:00
* Upgrades redis-mpool to 0.5.0
* Upgrades cartodb-redis to 0.15.0
2017-09-20 23:23:06 +08:00
2017-08-13 23:52:35 +08:00
2017-08-11 00:20:40 +08:00
## 1.47.1
2017-08-13 23:50:09 +08:00
Released 2017-08-13
2017-07-03 17:24:23 +08:00
Announcements:
2017-08-13 22:13:26 +08:00
* Upgrade cartodb-psql to 0.10.1.
2017-08-13 23:50:09 +08:00
* Content edits to doc/version.md.
2017-07-03 17:24:23 +08:00
2017-08-10 23:28:21 +08:00
## 1.47.0
Released 2017-08-10
2017-08-10 23:28:21 +08:00
Announcements:
* Now export and query APIs respond with `429 You are over the limits` when a query or export command overcomes the pre-configured user's timeout.
2017-07-03 17:24:23 +08:00
2017-06-28 00:06:43 +08:00
## 1.46.1
2017-07-03 17:17:21 +08:00
Released 2017-07-01
Announcements:
* Now tableCache evicts keys based on their set time #244
2017-06-28 00:06:43 +08:00
2017-06-27 23:58:43 +08:00
## 1.46.0
Released 2017-06-27
2017-06-27 23:25:15 +08:00
2017-06-27 23:58:43 +08:00
Announcements:
* Disable tableCache in-memory LRU by default [#422](https://github.com/CartoDB/CartoDB-SQL-API/issues/422)
2017-06-27 23:25:15 +08:00
2017-04-18 20:46:41 +08:00
## 1.45.1
2017-06-27 23:16:03 +08:00
Released 2017-06-27
Bug fixes:
* Support special float values (NaN and ±Infinity) in query responses
2017-04-18 20:46:41 +08:00
2017-04-18 20:43:43 +08:00
## 1.45.0
Released 2017-04-18
Bug fixes:
* Add error callback to ogr command while spawning #419
Announcements:
* Make the zip command configurable #418
2017-04-04 23:02:07 +08:00
## 1.44.2
2017-04-05 21:05:29 +08:00
Released 2017-04-05
2017-04-04 23:02:07 +08:00
Bug fixes:
2017-04-18 20:43:43 +08:00
* Update queue index while enqueueing jobs to the top of queue.
2017-04-04 23:02:07 +08:00
2017-03-30 23:55:21 +08:00
## 1.44.1
2017-04-04 23:00:44 +08:00
Released 2017-04-04
Bug fixes:
2017-04-18 20:43:43 +08:00
* Avoid to scan the whole meta-database to discover active job queues. Now Batch Queries uses a set as index to know what queues are being processed #415
2017-03-30 23:55:21 +08:00
2017-03-30 23:53:58 +08:00
## 1.44.0
2017-03-30 23:54:49 +08:00
Released 2017-03-30
2017-01-16 21:30:26 +08:00
2017-03-30 23:53:58 +08:00
Announcements:
* Active GC interval for Node.js >=v6.
2017-01-16 21:30:26 +08:00
2017-01-16 17:38:43 +08:00
## 1.43.1
2017-01-16 21:29:46 +08:00
Released 2017-01-16
2017-01-16 17:38:43 +08:00
Announcements:
* Upgrade cartodb-psql to 0.7.1.
2017-01-16 17:38:43 +08:00
2017-01-16 17:35:36 +08:00
## 1.43.0
2017-01-16 17:37:39 +08:00
Released 2017-01-16
2017-01-12 19:40:32 +08:00
2017-01-16 17:35:36 +08:00
Announcements:
* Upgrade cartodb-psql to 0.7.0.
2017-01-12 19:40:32 +08:00
2016-12-19 23:12:32 +08:00
## 1.42.7
2017-01-12 19:39:47 +08:00
Released 2017-01-12
2016-12-19 23:12:32 +08:00
2017-01-12 19:39:10 +08:00
Enhancements:
* Avoid gpkg fid column #404.
2016-12-12 23:59:22 +08:00
2016-12-19 23:12:32 +08:00
2016-12-12 23:59:22 +08:00
## 1.42.6
2016-12-19 23:11:47 +08:00
Released 2016-12-19
2016-12-19 22:44:50 +08:00
Announcements:
2016-12-16 23:13:53 +08:00
* Upgrade cartodb-redis to 0.13.2.
2016-12-19 22:44:50 +08:00
* Upgrade redis-mpool to 0.4.1.
2016-12-16 23:13:34 +08:00
2016-12-12 23:59:22 +08:00
2016-11-30 23:36:53 +08:00
## 1.42.5
2016-12-12 23:58:30 +08:00
Released 2016-12-12
2016-11-30 23:36:25 +08:00
2016-12-12 23:58:17 +08:00
Enhancements:
* Improvements in testing environment/tests.
2016-11-30 23:36:53 +08:00
## 1.42.4
Released 2016-11-30
2016-11-08 00:04:25 +08:00
2016-11-30 23:08:23 +08:00
Enhancements:
* Include query status in batch queries log entries.
2016-11-08 00:04:25 +08:00
2016-11-30 23:36:53 +08:00
## 1.42.3
Released 2016-11-07
2016-11-07 22:04:58 +08:00
2016-11-08 00:00:59 +08:00
Announcements:
* Raise payload limit for batch-queries to 16kb.
2016-11-07 22:04:58 +08:00
2016-11-30 23:36:53 +08:00
## 1.42.2
Released 2016-11-07
2016-11-07 22:00:53 +08:00
Bug fixes:
* Improve error handling while registering jobs to be tracked.
2016-11-30 23:36:53 +08:00
## 1.42.1
Released 2016-11-03
2016-11-02 21:29:03 +08:00
2016-11-03 22:59:06 +08:00
Bug fixes:
* Avoid to use SCAN command to find work-in-progress queues.
2016-11-02 21:29:03 +08:00
2016-11-30 23:36:53 +08:00
## 1.42.0
Released 2016-11-02
2016-10-21 22:08:44 +08:00
2016-11-02 20:14:12 +08:00
Announcements:
* Adds endpoint to check running batch queries
2016-10-21 22:08:44 +08:00
2016-11-30 23:36:53 +08:00
## 1.41.0
Released 2016-10-21
2016-10-20 18:43:20 +08:00
2016-10-21 22:07:27 +08:00
Announcements:
* Stop migrating old queues by default.
2016-10-21 21:29:26 +08:00
Bug fixes:
* Fix some scenarios where batch queries got stuck waiting for available slots.
2016-10-20 18:43:20 +08:00
2016-11-30 23:36:53 +08:00
## 1.40.0
Released 2016-10-20
2016-10-17 22:35:10 +08:00
2016-10-20 16:20:51 +08:00
New features:
* Batch queries are handled per db host.
- There is an scheduler controlling how many queries and in what order they are run.
- Priority is based on: number of queries already ran, and oldest user in queue.
2016-10-20 16:20:51 +08:00
* Batch queries capacity: allow to configure how many jobs to run per db host.
2016-10-17 22:35:10 +08:00
2016-11-30 23:36:53 +08:00
## 1.39.1
Released 2016-10-17
2016-10-17 21:27:25 +08:00
2016-10-17 22:33:49 +08:00
Enhancements:
* Log creation and waiting time for fallback jobs' queries.
2016-10-17 21:27:25 +08:00
2016-11-30 23:36:53 +08:00
## 1.39.0
Released 2016-10-17
2016-10-13 21:20:38 +08:00
2016-10-17 21:04:48 +08:00
Enhancements:
* Use just one Redis pool across the whole application.
New features:
* Batch queries use per user-queues.
* Batch queries queues can limit the number of queued jobs per user.
2016-10-17 21:23:53 +08:00
- Default is 64 jobs.
- Configuration key `batch_max_queued_jobs` allows to modify the limit.
2016-10-17 21:04:48 +08:00
2016-10-13 21:20:38 +08:00
2016-11-30 23:36:53 +08:00
## 1.38.2
Released 2016-10-13
2016-10-13 16:17:35 +08:00
2016-10-13 21:18:48 +08:00
Bug fixes:
* Batch queries: release redis clients to pool from locker and seeker.
2016-10-13 16:17:35 +08:00
2016-11-30 23:36:53 +08:00
## 1.38.1
Released 2016-10-13
2016-10-11 14:59:00 +08:00
2016-10-13 16:08:44 +08:00
Enhancements:
* Batch queries: improvements over leader locking.
2016-10-11 14:59:00 +08:00
2016-11-30 23:36:53 +08:00
## 1.38.0
Released 2016-10-11
2016-08-30 20:52:30 +08:00
Announcements:
2016-10-10 18:11:21 +08:00
* Allow to set statement timeout per query in multi query batch queries.
* Batch queries default statement timeout set to 12 hours.
* Multiple queries jobs pushed as first job between queries.
2016-08-30 20:52:30 +08:00
2016-11-30 23:36:53 +08:00
## 1.37.1
Released 2016-10-05
2016-10-04 18:02:46 +08:00
2016-10-05 23:32:45 +08:00
Bug fixes:
* Body parser accepting multipart requests.
2016-10-04 18:02:46 +08:00
2016-11-30 23:36:53 +08:00
## 1.37.0
Released 2016-10-04
2016-10-03 19:36:04 +08:00
2016-10-04 18:01:08 +08:00
Enhancements:
* Migrate to Express.js 4.x series.
2016-10-03 19:36:04 +08:00
2016-11-30 23:36:53 +08:00
## 1.36.2
Released 2016-10-03
2016-10-01 00:48:13 +08:00
Bug fixes:
- Batch Queries logs: use path instead of stream to be able to reopen FD.
2016-11-30 23:36:53 +08:00
## 1.36.1
Released 2016-09-30
2016-09-30 23:13:50 +08:00
2016-10-01 00:46:34 +08:00
Enhancements:
* Tag fallback jobs logs.
2016-09-30 23:13:50 +08:00
2016-11-30 23:36:53 +08:00
## 1.36.0
Released 2016-09-30
2016-09-15 17:57:07 +08:00
2016-09-30 23:12:41 +08:00
New features:
* Log queries from batch fallback jobs.
Enhancements:
* assert.response following callback(err, obj) pattern.
2016-09-15 17:57:07 +08:00
2016-11-30 23:36:53 +08:00
## 1.35.0
Released 2016-09-15
2016-08-30 20:52:30 +08:00
New features:
* Allow to use `--config /path/to/config.js` to specify configuration file.
- Environment will be loaded from config file if `environment` key is present, otherwise it keeps current behaviour.
Bug fixes:
* Allow to use absolute paths for log files.
Announcements:
* Removes support for optional rollbar logging.
2016-08-30 20:52:30 +08:00
2016-11-30 23:36:53 +08:00
## 1.34.2
Released 2016-08-30
2016-07-12 00:15:52 +08:00
2016-07-13 22:18:00 +08:00
Announcements:
* Upgrades cartodb-redis to 0.13.1.
2016-08-30 20:50:17 +08:00
* Set TTL of finished job to 2h
2016-07-13 22:18:00 +08:00
2016-07-12 00:15:52 +08:00
2016-11-30 23:36:53 +08:00
## 1.34.1
Released 2016-07-11
2016-07-11 23:19:50 +08:00
2016-07-12 00:13:05 +08:00
Bug fixes:
* Fixed issue with redis connections in Batch API #326
2016-07-11 23:19:50 +08:00
2016-11-30 23:36:53 +08:00
## 1.34.0
Released 2016-07-11
2016-07-01 15:38:49 +08:00
New features:
* Skip tables with no updated_at registered in cdb_tablemetadata.
* Allow to setup more than one domain to validate oauth against.
2016-07-01 15:38:49 +08:00
2016-11-30 23:36:53 +08:00
## 1.33.0
Released 2016-07-01
New features:
* Add `<%= job_id %>` template support for onerror and onsuccess fallback queries.
2016-11-30 23:36:53 +08:00
## 1.32.0
Released 2016-06-30
2016-06-30 00:36:45 +08:00
2016-06-30 18:33:17 +08:00
New features:
2016-06-30 18:43:37 +08:00
* Broadcast after enqueueing jobs to improve query distribution load.
* Batch pub-sub channel handles its connections using `redis-mpool`.
2016-06-30 18:33:17 +08:00
2016-06-30 00:36:45 +08:00
2016-11-30 23:36:53 +08:00
## 1.31.0
Released 2016-06-29
2016-06-23 17:49:19 +08:00
New features:
* Adds start and end time for batch queries with fallback.
* Add `<%= error_message %>` template support for onerror fallback queries.
2016-06-23 17:49:19 +08:00
2016-11-30 23:36:53 +08:00
## 1.30.1
Released 2016-06-23
2016-06-14 22:42:42 +08:00
2016-06-23 17:06:04 +08:00
Bug fixes:
* Fixed issue with profiling in Batch API #318
2016-06-14 22:42:42 +08:00
2016-11-30 23:36:53 +08:00
## 1.30.0
Released 2016-06-14
2016-05-25 23:39:04 +08:00
2016-06-14 22:40:36 +08:00
Announcements:
* Now Batch API sends stats metrics to statsd server #312
* Now Batch API sets "skipped" instead of "pending" to queries that won't be performed #311
Bug fixes:
* Fixed issue with error handling in Batch API #316
2016-05-25 23:39:04 +08:00
2016-11-30 23:36:53 +08:00
## 1.29.2
Released 2016-05-25
2016-05-24 23:22:46 +08:00
2016-05-25 23:36:13 +08:00
Bug fixes:
* Fixed issue with status transition in fallback jobs #308
2016-05-24 23:22:46 +08:00
2016-11-30 23:36:53 +08:00
## 1.29.1
Released 2016-05-24
2016-05-24 18:41:09 +08:00
2016-05-24 22:57:06 +08:00
Announcements:
* Change Batch API size limit: 8kb per job.
2016-05-24 18:41:09 +08:00
2016-11-30 23:36:53 +08:00
## 1.29.0
Released 2016-05-24
2016-05-12 23:37:33 +08:00
2016-05-24 18:38:30 +08:00
New features:
* Add support for fallback-jobs in Batch API #296
Bug fixes:
* Fix issue in Batch API when a 'no longer running' job reports as 'running' before and after a job cancel #293
2016-05-12 23:37:33 +08:00
2016-11-30 23:36:53 +08:00
## 1.28.1
Released 2016-05-12
2016-05-11 17:46:53 +08:00
Bug fixes:
2016-05-24 18:38:30 +08:00
* OGR with _needSRS=true_ fails for empty tables #299
2016-05-11 17:46:53 +08:00
2016-11-30 23:36:53 +08:00
## 1.28.0
Released 2016-05-11
2016-04-18 23:02:11 +08:00
Announcements:
- Upgrades step-profiler to 0.3.0 to avoid dots in json keys #294
2016-05-11 00:50:24 +08:00
New features:
* Add support for geopackage format (`format=gpkg` at the URL) #291
2016-04-18 23:02:11 +08:00
2016-05-11 17:45:42 +08:00
2016-11-30 23:36:53 +08:00
## 1.27.1
Released 2016-04-18
2016-04-05 22:17:03 +08:00
2016-04-18 22:58:10 +08:00
Bug fixes:
* Size of queries in Batch API is limited to 4kb per job
2016-04-05 22:17:03 +08:00
2016-11-30 23:36:53 +08:00
## 1.27.0
Released 2016-04-05
2016-04-05 22:06:16 +08:00
New features:
* Add support for multiquery-jobs in Batch API #280
* Add queue discovering for Batch processing at service startup #282
Bug fixes:
* Fix issue in Batch API when after a period of inactivity it does not process jobs
2016-11-30 23:36:53 +08:00
## 1.26.0
Released 2016-03-08
2016-02-02 08:30:12 +08:00
2016-03-08 23:14:58 +08:00
New features:
* Add [Surrogate-Key](https://github.com/CartoDB/cartodb/wiki/CartoDB-Surrogate-Keys) headers to responses
2016-02-02 08:30:12 +08:00
2016-03-08 23:14:58 +08:00
Enhancements:
* Use new `node-cartodb-query-tables` library to obtain affected tables in queries
2016-04-05 22:06:16 +08:00
2016-11-30 23:36:53 +08:00
## 1.25.3
Released 2016-02-02
2016-02-02 00:59:12 +08:00
2016-02-02 08:25:58 +08:00
Enhancements:
* QueryTablesApi caches affected tables and retrieves last modification #269
2016-02-02 00:59:12 +08:00
2016-11-30 23:36:53 +08:00
## 1.25.2
Released 2016-02-01
2016-01-28 23:19:10 +08:00
2016-02-02 00:56:53 +08:00
Bug fixes:
* Skip query-tables-api for authenticated requests
2016-01-28 23:19:10 +08:00
2016-11-30 23:36:53 +08:00
## 1.25.1
Released 2016-01-28
2016-01-26 21:35:02 +08:00
2016-01-28 21:44:42 +08:00
Bug fixes:
* Fix X-Cache-Channel generation when request are not authenticated #266
2016-01-26 21:35:02 +08:00
2016-11-30 23:36:53 +08:00
## 1.25.0
Released 2016-01-26
2015-08-04 22:33:36 +08:00
2016-01-28 00:57:12 +08:00
Bug fixes:
* Stop adding X-Cache-Channel header when no tables involved #250
New features:
* Set `Last-Modified` header based on affected tables (#101)
2016-01-26 21:29:08 +08:00
* Batch API (#261):
- New endpoint to create, read, update and delete long-running queries (jobs).
- Batch service to process jobs.
2016-01-28 00:57:12 +08:00
* Set Last-Modified header based on affected tables #247
2016-01-26 21:29:08 +08:00
Announcements:
* Upgrades cartodb-psql to [0.6.1](https://github.com/CartoDB/node-cartodb-psql/releases/tag/0.6.1)
2015-08-04 22:33:36 +08:00
2016-11-30 23:36:53 +08:00
## 1.24.0
Released 2015-08-04
2015-06-16 23:36:26 +08:00
New features:
* Client is removed from pool after error happens. This help to avoid issues with transactions (#241).
2015-08-04 21:35:31 +08:00
Announcements:
* Upgrades cartodb-psql to [0.6.0](https://github.com/CartoDB/node-cartodb-psql/releases/tag/0.6.0)
2015-06-16 23:36:26 +08:00
2016-11-30 23:36:53 +08:00
## 1.23.0
Released 2015-06-16
2015-05-26 16:19:47 +08:00
2015-06-16 23:01:51 +08:00
Announcements:
* Reverts tables=<fake> for ogr2ogr commands
Ref https://github.com/CartoDB/CartoDB-SQL-API/commit/b6e53f732672369d7f9be26555ef412edc202727
2015-06-16 22:48:29 +08:00
Enhancements:
* Makes ogr2ogr command configurable so it's possible to change path/bin
2015-06-16 22:54:07 +08:00
* Uses :remote-addr instead of :req[X-Real-IP] \(#197)
2015-06-16 22:53:12 +08:00
New features:
* Adds SpatiaLite as export format (#226)
2015-06-16 22:48:29 +08:00
2015-05-26 16:19:47 +08:00
2016-11-30 23:36:53 +08:00
## 1.22.2
Released 2015-05-26
2015-05-14 19:18:58 +08:00
2015-05-25 22:38:07 +08:00
Bug fixes:
* Reintroduces tables= param in ogr2ogr exports (#204)
This will avoid running a heavy ogr2ogr query when the pg catalog is big
Ref https://github.com/CartoDB/CartoDB-SQL-API/commit/84c422c505391ef0e743aed2204214d4286d7e30
2015-05-14 19:18:58 +08:00
2015-05-26 16:17:56 +08:00
2016-11-30 23:36:53 +08:00
## 1.22.1
Released 2015-05-14
2015-04-09 16:50:30 +08:00
Bug fixes:
* Close stream responses on error (#219)
Enhancements:
* Format files split into pg and ogr directories
2015-04-09 16:50:30 +08:00
2016-11-30 23:36:53 +08:00
## 1.22.0
Released 2015-04-09
2015-03-02 21:35:59 +08:00
Announcements:
* Now health check only validates against a disabling file
* Supports user extraction from request params via base_url config
2015-03-02 21:35:59 +08:00
2016-11-30 23:36:53 +08:00
## 1.21.1
Released 2015-03-02
2015-03-02 19:57:16 +08:00
2015-03-02 21:34:01 +08:00
Enhancements:
* Improve row size limit error message
2015-03-02 19:57:16 +08:00
2016-11-30 23:36:53 +08:00
## 1.21.0
Released 2015-03-02
2015-02-26 23:30:07 +08:00
2015-03-02 19:49:25 +08:00
New features:
* Logs with console.error too large row errors
2015-02-26 23:30:07 +08:00
2016-11-30 23:36:53 +08:00
## 1.20.0
Released 2015-02-26
2014-12-15 23:26:41 +08:00
2015-02-19 21:54:49 +08:00
Announcements:
2015-02-20 22:01:07 +08:00
* Upgrades cartodb-psql to 0.5.1 for keep alive configuration
2015-02-19 21:54:49 +08:00
* Dependencies from npm registry when available
2014-12-15 23:26:41 +08:00
2016-11-30 23:36:53 +08:00
## 1.19.1
Released 2014-12-15
2014-11-21 20:45:55 +08:00
Bug fixes:
* Closes stream responses on error (#188)
* Closes fd for log files on `kill -HUP` (#187)
2014-11-21 20:45:55 +08:00
2016-11-30 23:36:53 +08:00
## 1.19.0
Released 2014-11-21
2014-10-14 21:39:25 +08:00
New features:
* Add more fields to error responses with hint, detail and context for SQL errors.
2014-10-23 22:49:04 +08:00
Enhancements:
* Don't loop twice over svg rows
* Improve statement timeout error messages
* Improve topojson output by streaming json
2014-10-23 22:49:04 +08:00
2014-10-14 21:39:25 +08:00
2016-11-30 23:36:53 +08:00
## 1.18.0
Released 2014-10-14
2014-09-23 18:41:38 +08:00
Announcements:
2014-10-14 21:17:05 +08:00
* Dropping support for npm <1.2.1
npm-shrinkwrap.json is incompatible when generated with npm >=1.2.1 and consumed by npm <1.2.1
2014-09-23 18:41:38 +08:00
2016-11-30 23:36:53 +08:00
## 1.17.1
Released 2014-09-23
Enhancements:
* Removes tables=fake wadus param in ogr2ogr command so it can go to geometry
columns view to retrieve the column data type. This requires to grant select
permission on geometry_columns and geography_columns to the public user.
2014-09-24 22:56:53 +08:00
* Removes query tables console.log
Bug fixes:
* Fixes "make check" on systems with non-default PostgreSQL superuser (#152)
2014-09-17 06:04:10 +08:00
2016-11-30 23:36:53 +08:00
## 1.17.0
Released 2014-09-17
2014-08-19 20:44:04 +08:00
Bug fixes:
* Returns 401 Unauthorized for queries without permission
New features:
* New header for database host serving the request
2014-08-27 00:40:58 +08:00
* Health check endpoint
2014-08-20 18:34:01 +08:00
Enhancements:
* Upgrades dependencies:
* cartodb-redis
* cartodb-psql
* log4js
2016-11-30 23:36:53 +08:00
## 1.16.0
Released 2014-08-19
2014-08-18 22:05:03 +08:00
Enhancements:
* Metrics revamp: removes and adds some metrics
2014-08-18 22:05:03 +08:00
2016-11-30 23:36:53 +08:00
## 1.15.0
Released 2014-08-18
2014-08-08 18:53:25 +08:00
2014-08-14 19:18:52 +08:00
Enhancements:
* Upgrades cartodb-redis
2014-08-14 20:23:41 +08:00
* Upgrades underscore, removes underscore.string dependency
2014-08-14 20:25:43 +08:00
* Uses https endpoints for dependencies
2014-08-14 19:18:52 +08:00
2016-11-30 23:36:53 +08:00
## 1.14.1
Released 2014-08-08
2014-08-07 22:47:25 +08:00
Other changes:
* Constraint for pg_ queries if request is non authenticated
2014-08-07 22:47:25 +08:00
2016-11-30 23:36:53 +08:00
## 1.14.0
Released 2014-08-07
2014-08-07 21:20:39 +08:00
2014-08-07 22:27:51 +08:00
Other changes:
* Removes sql statements restriction on pg_ queries
2016-11-30 23:36:53 +08:00
## 1.13.0
Released 2014-08-07
2014-08-05 07:03:56 +08:00
New features:
* New authentication mechanism: checks in advance if credentials are provided
in order to do a single request to redis to retrieve the required database
connection parameters.
* Retrieves OAuth hash values using new cartodb-redis method so it will reuse
the redis pool from cartodb-redis instead of using just one pool for oauth.
2016-11-30 23:36:53 +08:00
## 1.12.1
Released 2014-08-05
2014-08-04 20:51:54 +08:00
2014-08-05 07:02:10 +08:00
Bug fixes:
* Fixes GeoJSON stream error responses
* Fixes GeoJSON stream empty responses
* JSONP callbacks return with 200 status error code
Enhancements:
* Re-enables tests
2016-11-30 23:36:53 +08:00
## 1.12.0
Released 2014-08-04
2014-07-30 18:16:07 +08:00
2014-07-30 19:19:03 +08:00
New features:
* Add header for host serving the request
2014-08-04 20:51:01 +08:00
* Stream JSON/GeoJSON responses
2014-07-30 19:19:03 +08:00
2016-11-30 23:36:53 +08:00
## 1.11.0
Released 2014-07-30
2014-06-05 23:04:12 +08:00
2014-07-30 18:15:12 +08:00
New features:
* Support for different schemas and different public users
Enhancements:
* Profiler header sent as JSON string
Other changes:
* Revamped documentation
Bug fixes:
* Pick redis pool configuration values
2016-11-30 23:36:53 +08:00
## 1.10.1
Released 2014-06-05
2016-11-30 23:36:53 +08:00
Bug fixes:
* Backing out Stream JSON responses
2014-06-04 21:44:13 +08:00
2016-11-30 23:36:53 +08:00
## 1.10.0
Released 2014-06-04
2014-03-21 00:11:56 +08:00
New features:
* Order by and sort order through http query params
* Cancelling queries in Postgresql when HTTP request is aborted/closed
Enhancements:
* Stream JSON responses
* Pre-compiling may write regex
* Set default PostgreSQL application name to "cartodb_sqlapi"
Bug fixes:
* Support trailing semicolons (#147)
2016-11-30 23:36:53 +08:00
## 1.9.1
Released 2014-03-27
2014-03-27 20:01:51 +08:00
Bug fixes:
* Fix paging with queries starting with comments (#144)
2016-11-30 23:36:53 +08:00
## 1.9.0
Released 2014-03-20
2014-02-11 00:23:42 +08:00
New features:
2014-03-13 19:14:11 +08:00
* Add optional support for rollbar (#137)
* Add '/version' endpoint (#138)
2014-03-20 01:34:21 +08:00
* Add profiler support (#142)
2014-03-20 18:22:13 +08:00
* Add statsd support (#133)
Enhancements:
* Allow configuring log_format (#131)
2014-03-13 18:52:40 +08:00
* Use log4js for logging (#136)
2014-03-13 20:50:53 +08:00
* Include version in startup log
* Allow passing environment configuration name via NODE_ENV to app.js
* Print environment configuration name on app start
* Upgrade node-zipfile to ~0.5.0
* Add support for node-0.10 (#132)
* Fix lack of response on backend crash (#135)
* Reduce work on aborted requests (#129)
Other changes:
* Switch to 3-clause BSD license (#143)
2016-11-30 23:36:53 +08:00
## 1.8.3
Released 2014-02-10
2014-01-20 19:39:29 +08:00
Bug fixes:
* Honour the 'node_socket_timeout' configuration directive (#128)
Enhancements:
* Add support for error handling in assert.request
* Stop using ANSI colors in the logs (#130)
2016-11-30 23:36:53 +08:00
## 1.8.2
Released 2014-01-20
2014-01-10 18:32:48 +08:00
Bug fixes:
* Restore compatibility with 1.6.x configuration
2014-01-20 19:38:11 +08:00
* Use db_port in ogr2ogr
2016-11-30 23:36:53 +08:00
## 1.8.1
Released 2014-01-10
2013-12-18 19:38:10 +08:00
Bug fixes:
* Fix use of "SELECT .. INTO" with windowing params (#127)
2016-11-30 23:36:53 +08:00
## 1.8.0
Released 2013-12-18
2013-12-02 18:59:28 +08:00
2013-12-18 19:36:55 +08:00
New features:
* Add 'user_from_host' directive to generalize username extraction (#124)
2013-12-18 19:36:55 +08:00
Improvements:
* Enhance error message on unknown cartodb username (#126)
2016-11-30 23:36:53 +08:00
## 1.7.1
Released 2013-12-02
2013-11-19 19:14:19 +08:00
* Fix documentation for CSV export format: geoms are in hexewkb, not ewkt.
* Fix field types names lookup after PSQL model refactoring
NOTE: fixes missing .prj in shapefile export regression (#122)
2016-11-30 23:36:53 +08:00
## 1.7.0
Released 2013-11-19
2013-11-19 19:08:39 +08:00
New features:
* Optionally read user-specific database_host and database_password
from redis, as per CartoDB-2.5.0 model (#120, #121)
* Add warnings and notices to JSON response (#104)
2013-11-11 04:39:23 +08:00
2013-11-19 19:08:39 +08:00
Other changes:
* CartoDB redis interaction delegated to "cartodb-redis" module
2016-11-30 23:36:53 +08:00
## 1.6.3
Released 2013-11-10
2013-11-10 01:51:27 +08:00
* JSON format: correctly recognize "numeric" type columns (#119)
2013-11-08 00:54:31 +08:00
2016-11-30 23:36:53 +08:00
## 1.6.2
Released 2013-11-07
* JSON format: correctly recognize "date" type columns (#117)
* Allow access to tables whose name contains (but does not start with)
the "pg_" substring (#118)
2013-11-06 00:59:17 +08:00
2016-11-30 23:36:53 +08:00
## 1.6.1
Released 2013-11-05
* Still set a meaningful X-Cache-Channel with cache_policy=persist (#105)
* Fix wrong projection in KML exports for manually altered tables (#116)
* Set KML folder name to the requested filename (#115)
* Make public PostgreSQL user name a configuration parameter (#56)
2013-10-02 19:14:32 +08:00
2016-11-30 23:36:53 +08:00
## 1.6.0
Released 2013-10-02
* Fix shapefile export for non-linestring results starting with NULLs (#111)
* Fix missing .prj in shapefile export (#110)
* Improve recognition of non-standard field types names by db lookup (#112)
* Upgrade node-pg dependency to 2.6.2
2013-10-02 18:45:06 +08:00
* Drop support for cluster
2013-10-02 16:24:05 +08:00
2016-11-30 23:36:53 +08:00
## 1.5.4
Released 2013-10-01
* Honour skipfields in JSON schema response (#109)
2013-09-06 17:26:08 +08:00
2016-11-30 23:36:53 +08:00
## 1.5.3
Released yyyy-mm-dd
* Set Last-Modified header with cache_policy=persist
* Raise max-age to one year for all cacheable queries
2016-01-26 21:29:08 +08:00
* Set max-age to 0 for uncacheable (mutating) queries
* Add REINDEX to the list of uncacheable queries
2013-08-21 00:09:22 +08:00
* Support all parameters with POST as well as GET
* Ensure testsuite passes with both GDAL-0.9 and GDAL-0.10
* JSON output: report boolean types as boolean, not string (#106)
2013-07-10 13:59:13 +08:00
2016-11-30 23:36:53 +08:00
## 1.5.2
Released yyyy-mm-dd
* Keep numbers as such in JSON output (#100)
* Revert max-age=0 in Cache-Control when using no-cache
2013-07-09 16:47:42 +08:00
2016-11-30 23:36:53 +08:00
## 1.5.1
Released yyyy-mm-dd
* Improve cacheability of queries selecting "updated_at" fields (#99)
2013-07-05 21:31:21 +08:00
2016-11-30 23:36:53 +08:00
## 1.5.0
Released yyyy-mm-dd
* Add "fields" member in JSON return (#97)
* Add --skipfields switch to cdbsql
* Fix windowing with CTE
* Retain UTC offset in JSON date output
* Set max-age=0 in Cache-Control when using no-cache
2013-05-29 00:15:15 +08:00
2016-11-30 23:36:53 +08:00
## 1.4.1
Released yyyy-mm-dd
* Fix windowing support for non-uppercased SELECT queries
* Fix oAuth testcase
2016-11-30 23:36:53 +08:00
## 1.4.0
Released yyyy-mm-dd
2013-05-17 17:44:50 +08:00
* Add arraybuffer format
* Fix filesystem access conflict among clustered processes
* Fix discard of queued export requests on error
2013-05-29 23:43:01 +08:00
* Really fix problem identifying OAuth requests
2013-05-17 17:44:50 +08:00
2016-11-30 23:36:53 +08:00
## 1.3.10
Released yyyy-mm-dd
* Fixed problem identifying OAuth request protocol
* Make base url configurable
2016-01-26 21:29:08 +08:00
* Update underscore dependency
* Add munin plugin
* Make PostgreSQL client pooling settings configurable (#47)
* Do not execute queries on OPTIONS (#94)
* Survive postgresql connection losses (#95)
2013-05-10 18:18:27 +08:00
2016-11-30 23:36:53 +08:00
## 1.3.9
Released yyyy-mm-dd
* Do not choke on multiple `skipfields` parameter
* Do not request caching of TRUNCATE queries
2013-04-15 20:04:55 +08:00
2016-11-30 23:36:53 +08:00
## 1.3.8
Released yyyy-mm-dd
* Make using SET or querying system catalogues harder
* Allow sql queries to end with a semicolon (#90)
2013-04-11 19:37:47 +08:00
* Testsuite fixes, jenkins ready :)
2013-04-02 17:39:54 +08:00
2016-11-30 23:36:53 +08:00
## 1.3.7
Released yyyy-mm-dd
* Fix parsing of numeric arrays (#88)
2013-03-14 19:06:26 +08:00
* node-pool upgraded to 2.0.3
* Reduce memory use on KML export
* Fix concurrent request for KML and Shapefile exports
* Send an empty-like KML when exporting zero-rows queries
* Make temporary dir a configuration setting
* Use OGR for CSV output, reducing memory requirement
2013-02-28 22:03:42 +08:00
2016-11-30 23:36:53 +08:00
## 1.3.6
Released yyyy-mm-dd
* Do not confuse warnings with errors on shapefile output (#87)
2013-02-19 19:40:58 +08:00
2016-11-30 23:36:53 +08:00
## 1.3.5
Released 2013-02-19
* Fix skipfields use with SHP output format (#81)
* Fix Content-Disposition for error responses (#82)
* Add pid to /cachestatus (#83)
* Check CDB_QueryTable response before saving into cache (#83)
* Use an expiring LRU cache for query tables (#83)
* Fix X-Cache-Channel computation with paging parameters (#85)
2013-01-22 01:01:16 +08:00
2016-11-30 23:36:53 +08:00
## 1.3.4
Released 2013-01-21
* Improve mixed-geometry export error message (#78)
* Remove NULL the_geom features from topojson output (#80)
* Fix crash when issuing SQL "COPY" command
* Return an error when "the_geom" is in skipfield for SVG output (#73)
2013-01-11 20:57:47 +08:00
2016-11-30 23:36:53 +08:00
## 1.3.3
Released 2013-01-11
2012-12-08 00:10:55 +08:00
* Fix Date format in CSV output (#77)
2013-01-11 18:13:48 +08:00
* Add TopoJSON output format (#79)
2012-11-28 23:45:49 +08:00
2016-11-30 23:36:53 +08:00
## 1.3.2
Released 2012-11-30
* Fix KML export truncation (#70)
* Fix UTF8 in shapefile export (#66)
2012-11-15 01:24:26 +08:00
2016-11-30 23:36:53 +08:00
## 1.3.1
Released yyyy-mm-dd
2012-11-14 02:28:09 +08:00
* Support 'format' and 'filename' params in POST
* Fix oAuth bug introduced by 'skipfields' param in 1.3.0 (#69)
2012-11-13 18:42:18 +08:00
2016-11-30 23:36:53 +08:00
## 1.3.0
Released yyyy-mm-dd
* Support for specifying a filename for exports (#64)
* Support for specifying a list of fields to skip from output (#63)
* Add 'cache_policy' parameter (#62)
2012-11-12 19:27:37 +08:00
2016-11-30 23:36:53 +08:00
## 1.2.1
Released yyyy-mm-dd
2012-11-12 19:23:06 +08:00
* Added timeout default to 600 miliseconds in cluster.js
2012-11-02 22:38:24 +08:00
2016-11-30 23:36:53 +08:00
## 1.2.0
Released yyyy-mm-dd
* New output formats:
* ESRI Shapefile (format=shp)
* SVG (format=svg)
* KML (format=kml)
* Advertise header presence in CSV Content-Type
* Fix CSV output with no rows (#60)
* Use "attachment" Content-Disposition for all output formats (#61)
* Only use last format parameter when multiple are requested
* Return a 400 response on unsupported format request
2012-11-01 20:16:46 +08:00
* Added X-Prototype-Version, X-CSRF-Token to Access-Control-Allow-Headers
2012-10-31 01:56:11 +08:00
2016-11-30 23:36:53 +08:00
## 1.1.0
Released 2012-10-30
2012-10-04 18:03:34 +08:00
* Fixed problem in cluster2 with pidfile name
2012-10-31 01:56:11 +08:00
* SVG output format
2012-10-04 18:03:34 +08:00
* Enhancement to the cdbsql tool:
- New switches: --format, --key, --dp
- Interactive mode
* API documentation
* ./configure script
2012-10-30 20:11:34 +08:00
* Restrict listening to a node host
2012-10-04 14:38:44 +08:00
2016-11-30 23:36:53 +08:00
## 1.0.0
Released 2012-10-03
2012-10-03 22:53:17 +08:00
* Migrated to node 0.8 version
2016-11-30 23:36:53 +08:00
## 0.9.0
Released 2012-09-18
2012-09-18 23:04:29 +08:00
* Fix INSERT and UPDATE with RETURNING clause