Skip to content

fix: lower memory usage when rendering from large amounts of tiffs BM-1535#3605

Merged
blacha merged 4 commits intomasterfrom
fix/lower-memory-usage
Feb 23, 2026
Merged

fix: lower memory usage when rendering from large amounts of tiffs BM-1535#3605
blacha merged 4 commits intomasterfrom
fix/lower-memory-usage

Conversation

@blacha
Copy link
Copy Markdown
Member

@blacha blacha commented Feb 23, 2026

Motivation

When rendering low (z0-10) zoom scales from high resolution imagery, we sometimes request too many tiles at once, which can lead to all the memory of the server being eaten by the source data while they wait to be processed into output tiles

Modifications

Added some testing tools to help debug issues by loading configs directly from s3 and caching the data locally.

Limit the concurrent outstanding requests to 16 by default

Verification

Running locally, before the change on a 700 source tiff tile approx 3GB of memory was used, after the change 300MB is used

@blacha blacha requested a review from a team as a code owner February 23, 2026 07:28
@blacha blacha changed the title Fix/lower memory usage fix: lower memory usage when rendering huge tiles Feb 23, 2026
@blacha blacha changed the title fix: lower memory usage when rendering huge tiles fix: lower memory usage when rendering huge tiles BM-1535 Feb 23, 2026
@blacha blacha changed the title fix: lower memory usage when rendering huge tiles BM-1535 fix: lower memory usage when rendering from large amounts of tiffs BM-1535 Feb 23, 2026
@blacha blacha added this pull request to the merge queue Feb 23, 2026
Merged via the queue into master with commit 9dc711d Feb 23, 2026
15 of 16 checks passed
@blacha blacha deleted the fix/lower-memory-usage branch February 23, 2026 21:53
@linz-li-bot linz-li-bot mentioned this pull request Feb 23, 2026
Merged
github-merge-queue bot pushed a commit that referenced this pull request Mar 2, 2026
@linz-li-bot
release: v8.19.1 (#3606)
3745d3a 
🤖 I have created a release *beep* *boop*
---


<details><summary>bathymetry: 8.9.8</summary>

##
[8.9.8](bathymetry-v8.9.7...bathymetry-v8.9.8)
(2026-02-26)


### Dependencies

* The following workspace dependencies were updated
  * dependencies
    * @basemaps/shared bumped from ^8.9.7 to ^8.9.8
</details>

<details><summary>cli: 8.10.11</summary>

##
[8.10.11](cli-v8.10.10...cli-v8.10.11)
(2026-02-26)


### Dependencies

* The following workspace dependencies were updated
  * dependencies
    * @basemaps/cli-config bumped from ^8.11.5 to ^8.11.6
    * @basemaps/cli-raster bumped from ^8.11.6 to ^8.11.7
    * @basemaps/cli-vector bumped from ^8.10.7 to ^8.10.8
    * @basemaps/shared bumped from ^8.9.7 to ^8.9.8
</details>

<details><summary>cli-config: 8.11.6</summary>

##
[8.11.6](cli-config-v8.11.5...cli-config-v8.11.6)
(2026-02-26)


### Dependencies

* The following workspace dependencies were updated
  * dependencies
    * @basemaps/config-loader bumped from ^8.12.3 to ^8.12.4
    * @basemaps/shared bumped from ^8.9.7 to ^8.9.8
</details>

<details><summary>cli-raster: 8.11.7</summary>

##
[8.11.7](cli-raster-v8.11.6...cli-raster-v8.11.7)
(2026-02-26)


### Dependencies

* The following workspace dependencies were updated
  * devDependencies
    * @basemaps/config-loader bumped from ^8.12.3 to ^8.12.4
    * @basemaps/shared bumped from ^8.9.7 to ^8.9.8
</details>

<details><summary>cli-vector: 8.10.8</summary>

##
[8.10.8](cli-vector-v8.10.7...cli-vector-v8.10.8)
(2026-02-26)


### Dependencies

* The following workspace dependencies were updated
  * dependencies
    * @basemaps/shared bumped from ^8.9.7 to ^8.9.8
</details>

<details><summary>config-loader: 8.12.4</summary>

##
[8.12.4](config-loader-v8.12.3...config-loader-v8.12.4)
(2026-02-26)


### Dependencies

* The following workspace dependencies were updated
  * dependencies
    * @basemaps/shared bumped from ^8.9.7 to ^8.9.8
</details>

<details><summary>8.19.1</summary>

## [8.19.1](v8.19.0...v8.19.1)
(2026-02-26)


### Bug Fixes

* lower memory usage when rendering from large amounts of tiffs BM-1535
([#3605](#3605))
([9dc711d](9dc711d))
</details>

<details><summary>infra: 8.12.4</summary>

##
[8.12.4](infra-v8.12.3...infra-v8.12.4)
(2026-02-26)


### Dependencies

* The following workspace dependencies were updated
  * devDependencies
    * @basemaps/lambda-tiler bumped from ^8.13.0 to ^8.13.1
    * @basemaps/shared bumped from ^8.9.7 to ^8.9.8
</details>

<details><summary>lambda-analytic-cloudfront: 8.9.9</summary>

##
[8.9.9](lambda-analytic-cloudfront-v8.9.8...lambda-analytic-cloudfront-v8.9.9)
(2026-02-26)


### Dependencies

* The following workspace dependencies were updated
  * dependencies
    * @basemaps/shared bumped from ^8.9.7 to ^8.9.8
</details>

<details><summary>lambda-tiler: 8.13.1</summary>

##
[8.13.1](lambda-tiler-v8.13.0...lambda-tiler-v8.13.1)
(2026-02-26)


### Bug Fixes

* lower memory usage when rendering from large amounts of tiffs BM-1535
([#3605](#3605))
([9dc711d](9dc711d))


### Dependencies

* The following workspace dependencies were updated
  * dependencies
    * @basemaps/config-loader bumped from ^8.12.3 to ^8.12.4
    * @basemaps/shared bumped from ^8.9.7 to ^8.9.8
    * @basemaps/tiler-sharp bumped from ^8.11.4 to ^8.11.5
</details>

<details><summary>landing: 8.13.1</summary>

##
[8.13.1](landing-v8.13.0...landing-v8.13.1)
(2026-02-26)


### Dependencies

* The following workspace dependencies were updated
  * devDependencies
    * @basemaps/cli-config bumped from ^8.11.5 to ^8.11.6
    * @basemaps/shared bumped from ^8.9.7 to ^8.9.8
</details>

<details><summary>server: 8.10.13</summary>

##
[8.10.13](server-v8.10.12...server-v8.10.13)
(2026-02-26)


### Dependencies

* The following workspace dependencies were updated
  * devDependencies
    * @basemaps/config-loader bumped from ^8.12.3 to ^8.12.4
    * @basemaps/lambda-tiler bumped from ^8.13.0 to ^8.13.1
    * @basemaps/landing bumped from ^8.13.0 to ^8.13.1
    * @basemaps/shared bumped from ^8.9.7 to ^8.9.8
  * optionalDependencies
    * @basemaps/landing bumped from ^8.13.0 to ^8.13.1
</details>

<details><summary>shared: 8.9.8</summary>

##
[8.9.8](shared-v8.9.7...shared-v8.9.8)
(2026-02-26)


### Bug Fixes

* lower memory usage when rendering from large amounts of tiffs BM-1535
([#3605](#3605))
([9dc711d](9dc711d))
</details>

<details><summary>tiler-sharp: 8.11.5</summary>

##
[8.11.5](tiler-sharp-v8.11.4...tiler-sharp-v8.11.5)
(2026-02-26)


### Bug Fixes

* lower memory usage when rendering from large amounts of tiffs BM-1535
([#3605](#3605))
([9dc711d](9dc711d))
</details>

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Wentao-Kuang Wentao-Kuang Wentao-Kuang approved these changes

@ccbblin ccbblin Awaiting requested review from ccbblin ccbblin is a code owner automatically assigned from linz/proj-basemaps-dev

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@blacha @Wentao-Kuang