Skip to content

build: New github actions to publish vector mbtiles to ODR#1197

Open
Wentao-Kuang wants to merge 8 commits intomasterfrom
feat/publish-vector-odr
Open

build: New github actions to publish vector mbtiles to ODR#1197
Wentao-Kuang wants to merge 8 commits intomasterfrom
feat/publish-vector-odr

Conversation

@Wentao-Kuang
Copy link
Copy Markdown
Contributor

@Wentao-Kuang Wentao-Kuang commented Jun 24, 2025

Motivation

We need to publish our topographic-v2 mbtiles and topographic.json files into the ODR bucket. So that we can use the same way of linz/imagery publish workflow to submit an Argo workflow and copy the mbitles and topographic.json file into ODR bucket

Modifications

New publish workflow that checks if the file config/tileset/topographic-v2.json changed or not.
If changed, when merging to master, prepare and submit copy workflow for each projection.

Verification

Testing case: Submit and copy into s3://linz-basemaps-staging bucket.

@Wentao-Kuang Wentao-Kuang force-pushed the feat/publish-vector-odr branch from 225c315 to 5078bf3 Compare June 24, 2025 22:06
@github-actions
Copy link
Copy Markdown
Contributor

Vector Data Update

Vector data updates for ts_topographic-v2

Feature updates for ts_topographic-v2

🟦 50772-nz-primary-parcels - version: 415470 (from: 415167) features: 2756582 (+1279)

Tile SIZE Analyse Report

🟩 WebMercator 🟩

Zoom - 0

Biggest Tile

X Y Z Size
0 0 0 55.7KB

Distributions

Distribution Number Of Tiles Percentage
50-100KB 1 100.0%

Layers

Layer Name Number Of Features Total Geometry Sizes Total Attribute Sizes Total Sizes
public_transport 3 0.2KB 0.1KB 0.2KB
pois 27 1.1KB 0.6KB 1.7KB
land 2038 81.8KB 137.5KB 219.3KB
boundaries 8 0.3KB 5.2KB 5.4KB
water_polygons 1 0.1KB 0.1KB 0.2KB
streets 125 7.9KB 9.7KB 17.6KB

Zoom - 1

Biggest Tile

X Y Z Size
1 1 1 70.7KB

Distributions

Distribution Number Of Tiles Percentage
0-10KB 1 50.0%
50-100KB 1 50.0%

Layers

Layer Name Number Of Features Total Geometry Sizes Total Attribute Sizes Total Sizes
land 3449 138.4KB 151.0KB 289.3KB
streets 184 11.5KB 9.8KB 21.4KB
public_transport 3 0.2KB 0.1KB 0.2KB
water_polygons 32 1.8KB 4.2KB 5.9KB
pois 27 1.1KB 0.6KB 1.7KB
boundaries 12 0.4KB 4.0KB 4.5KB

Zoom - 2

Biggest Tile

X Y Z Size
3 2 2 168.4KB

Distributions

Distribution Number Of Tiles Percentage
0-10KB 2 66.7%
100-200KB 1 33.3%

Layers

Layer Name Number Of Features Total Geometry Sizes Total Attribute Sizes Total Sizes
land 4611 186.0KB 242.9KB 428.9KB
water_polygons 59 3.0KB 9.3KB 12.3KB
public_transport 3 0.2KB 0.1KB 0.2KB
pois 27 1.1KB 0.6KB 1.7KB
boundaries 11 0.4KB 4.1KB 4.5KB
place_labels 1 0.0KB 0.0KB 0.1KB
streets 1111 105.5KB 55.6KB 161.2KB
street_labels 887 48.6KB 41.5KB 90.2KB

Zoom - 3

Biggest Tile

X Y Z Size
7 4 3 141.1KB

Distributions

Distribution Number Of Tiles Percentage
0-10KB 4 66.7%
100-200KB 2 33.3%

Layers

Layer Name Number Of Features Total Geometry Sizes Total Attribute Sizes Total Sizes
land 7721 310.0KB 534.1KB 844.1KB
boundaries 20 0.7KB 7.5KB 8.2KB
water_polygons 92 4.6KB 19.8KB 24.4KB
public_transport 3 0.2KB 0.1KB 0.2KB
pois 27 1.1KB 0.6KB 1.8KB
place_labels 7 0.4KB 0.2KB 0.5KB
street_labels 1278 70.1KB 55.2KB 125.3KB
streets 1649 154.5KB 73.5KB 228.1KB

Zoom - 4

Biggest Tile

X Y Z Size
15 9 4 222.9KB

Distributions

Distribution Number Of Tiles Percentage
0-10KB 12 85.7%
200-500KB 2 14.3%

Layers

Layer Name Number Of Features Total Geometry Sizes Total Attribute Sizes Total Sizes
place_labels 19 1.0KB 0.4KB 1.4KB
land 11507 445.8KB 1173.7KB 1619.6KB
water_polygons 106 4.7KB 41.3KB 46.0KB
boundaries 59 1.7KB 27.6KB 29.3KB
dam_lines 1 0.0KB 0.0KB 0.1KB
public_transport 3 0.2KB 0.1KB 0.2KB
pois 28 1.2KB 0.6KB 1.8KB
street_labels 1501 82.0KB 73.8KB 155.9KB
streets 1982 183.3KB 104.3KB 287.5KB

Zoom - 5

Biggest Tile

X Y Z Size
31 19 5 324.5KB

Distributions

Distribution Number Of Tiles Percentage
0-10KB 26 89.7%
50-100KB 1 3.4%
200-500KB 2 6.9%

Layers

Layer Name Number Of Features Total Geometry Sizes Total Attribute Sizes Total Sizes
place_labels 27 1.3KB 0.6KB 1.9KB
land 19426 717.5KB 2535.0KB 3252.5KB
water_polygons 115 5.0KB 78.1KB 83.1KB
boundaries 69 2.0KB 37.0KB 39.1KB
dam_lines 1 0.0KB 0.0KB 0.1KB
public_transport 3 0.2KB 0.1KB 0.2KB
pois 28 1.2KB 0.6KB 1.8KB
street_polygons 3 0.2KB 0.3KB 0.4KB
street_labels 1599 87.4KB 92.3KB 179.7KB
streets 2120 195.4KB 134.5KB 329.9KB

Zoom - 6

Biggest Tile

X Y Z Size
63 39 6 580.3KB

Distributions

Distribution Number Of Tiles Percentage
0-10KB 39 79.6%
10-50KB 3 6.1%
100-200KB 2 4.1%
50-100KB 3 6.1%
>500KB 2 4.1%

Layers

Layer Name Number Of Features Total Geometry Sizes Total Attribute Sizes Total Sizes
place_labels 40 2.0KB 0.9KB 2.9KB
water_polygons 142 5.8KB 154.2KB 160.0KB
land 45739 1617.8KB 7129.1KB 8746.9KB
boundaries 136 3.9KB 93.0KB 96.9KB
dam_lines 1 0.0KB 0.0KB 0.1KB
public_transport 3 0.2KB 0.1KB 0.2KB
street_polygons 3 0.2KB 0.4KB 0.6KB
pois 27 1.1KB 0.6KB 1.8KB
street_labels 1709 93.2KB 149.9KB 243.1KB
streets 2292 210.2KB 227.9KB 438.0KB

Zoom - 7

Biggest Tile

X Y Z Size
126 78 7 429.2KB

Distributions

Distribution Number Of Tiles Percentage
0-10KB 66 79.5%
10-50KB 3 3.6%
100-200KB 5 6.0%
50-100KB 5 6.0%
200-500KB 4 4.8%

Layers

Layer Name Number Of Features Total Geometry Sizes Total Attribute Sizes Total Sizes
place_labels 71 3.5KB 1.6KB 5.1KB
boundaries 880 17.5KB 692.5KB 710.1KB
land 78001 2751.8KB 13358.0KB 16109.8KB
water_polygons 186 6.9KB 281.8KB 288.8KB
dam_lines 1 0.0KB 0.0KB 0.1KB
public_transport 3 0.2KB 0.1KB 0.2KB
pois 27 1.1KB 0.6KB 1.8KB
street_polygons 3 0.2KB 0.5KB 0.7KB
sites 1 0.0KB 0.1KB 0.1KB
street_labels 1751 95.4KB 187.1KB 282.5KB
streets 2365 216.5KB 285.4KB 501.9KB

Zoom - 8

Biggest Tile

X Y Z Size
252 156 8 399.7KB

Distributions

Distribution Number Of Tiles Percentage
0-10KB 96 67.6%
50-100KB 5 3.5%
10-50KB 13 9.2%
100-200KB 18 12.7%
200-500KB 10 7.0%

Layers

Layer Name Number Of Features Total Geometry Sizes Total Attribute Sizes Total Sizes
place_labels 157 7.7KB 3.5KB 11.2KB
boundaries 1904 29.5KB 1333.7KB 1363.2KB
land 139109 4815.0KB 27264.2KB 32079.2KB
water_lines 1763 28.2KB 131.3KB 159.5KB
pois 32697 537.9KB 735.3KB 1273.2KB
water_polygons 258 9.3KB 509.6KB 518.9KB
dam_lines 1 0.0KB 0.0KB 0.1KB
public_transport 3 0.2KB 0.1KB 0.2KB
street_polygons 3 0.2KB 0.8KB 1.0KB
sites 3 0.1KB 0.3KB 0.4KB
street_labels 2931 160.0KB 418.8KB 578.8KB
streets 3553 340.5KB 539.5KB 880.0KB

Zoom - 9

Biggest Tile

X Y Z Size
504 312 9 354.3KB

Distributions

Distribution Number Of Tiles Percentage
0-10KB 137 50.4%
50-100KB 14 5.1%
10-50KB 34 12.5%
100-200KB 64 23.5%
200-500KB 23 8.5%

Layers

Layer Name Number Of Features Total Geometry Sizes Total Attribute Sizes Total Sizes
place_labels 235 11.4KB 5.3KB 16.7KB
boundaries 7990 57.2KB 4065.9KB 4123.1KB
land 215944 7713.7KB 47181.5KB 54895.3KB
water_lines 207937 8393.1KB 10448.7KB 18841.8KB
water_polygons 64190 2062.4KB 12165.1KB 14227.5KB
contours 89 4.5KB 93.9KB 98.3KB
pois 32555 535.7KB 731.8KB 1267.5KB
dam_lines 1 0.0KB 0.1KB 0.1KB
public_transport 3 0.2KB 0.1KB 0.2KB
street_polygons 3 0.2KB 1.0KB 1.1KB
sites 3 0.1KB 0.4KB 0.5KB
buildings 1 0.0KB 0.1KB 0.1KB
street_labels 3048 166.6KB 592.7KB 759.4KB
streets 3735 356.9KB 762.2KB 1119.1KB

Zoom - 10

Biggest Tile

X Y Z Size
1009 625 10 1182.2KB

Distributions

Distribution Number Of Tiles Percentage
0-10KB 199 31.6%
50-100KB 143 22.7%
10-50KB 106 16.9%
100-200KB 133 21.1%
200-500KB 41 6.5%
>500KB 7 1.1%

Layers

Layer Name Number Of Features Total Geometry Sizes Total Attribute Sizes Total Sizes
place_labels 559 27.6KB 12.5KB 40.1KB
boundaries 10473 76.2KB 6653.6KB 6729.8KB
land 307367 11307.0KB 84582.9KB 95889.9KB
water_polygons 72178 2320.6KB 20884.5KB 23205.1KB
water_lines 212520 8527.2KB 13809.2KB 22336.3KB
contours 91 4.5KB 140.9KB 145.5KB
pois 35498 589.1KB 797.3KB 1386.4KB
streets 342768 23971.4KB 46997.9KB 70969.3KB
street_polygons 3512 64.3KB 458.2KB 522.5KB
public_transport 153 5.6KB 3.4KB 9.0KB
dam_lines 1 0.0KB 0.1KB 0.1KB
sites 3 0.1KB 0.4KB 0.5KB
buildings 7 0.3KB 0.7KB 1.1KB
street_labels 339594 11713.6KB 46566.4KB 58280.0KB
ferries 3 0.0KB 0.3KB 0.3KB

Zoom - 11

Biggest Tile

X Y Z Size
2018 1250 11 398.0KB

Distributions

Distribution Number Of Tiles Percentage
0-10KB 324 17.9%
10-50KB 266 14.7%
50-100KB 647 35.8%
100-200KB 551 30.5%
200-500KB 20 1.1%

Layers

Layer Name Number Of Features Total Geometry Sizes Total Attribute Sizes Total Sizes
place_labels 656 32.5KB 14.7KB 47.2KB
boundaries 12484 123.8KB 10167.0KB 10290.8KB
contours 212854 9787.5KB 436245.9KB 446033.4KB
land 333475 12299.1KB 269706.3KB 282005.4KB
water_polygons 73850 2378.8KB 29719.1KB 32097.9KB
water_lines 868095 25642.7KB 124666.8KB 150309.5KB
pois 35404 587.7KB 794.6KB 1382.3KB
streets 179355 12583.5KB 35841.3KB 48424.8KB
street_polygons 3544 65.0KB 493.7KB 558.8KB
public_transport 157 5.6KB 3.5KB 9.2KB
dam_lines 1 0.0KB 0.1KB 0.1KB
sites 3 0.1KB 0.5KB 0.6KB
buildings 22 1.0KB 2.2KB 3.2KB
street_labels 175961 6116.9KB 35205.0KB 41321.9KB
ferries 3 0.0KB 0.3KB 0.3KB

Zoom - 12

Biggest Tile

X Y Z Size
4036 2564 12 189.6KB

Distributions

Distribution Number Of Tiles Percentage
0-10KB 780 12.8%
10-50KB 4819 78.9%
50-100KB 481 7.9%
100-200KB 29 0.5%

Layers

Layer Name Number Of Features Total Geometry Sizes Total Attribute Sizes Total Sizes
place_labels 751 37.5KB 16.8KB 54.4KB
boundaries 17159 295.5KB 13237.6KB 13533.1KB
land 497438 15602.0KB 363250.9KB 378852.8KB
contours 239135 11110.5KB 527941.9KB 539052.4KB
water_polygons 78051 2510.7KB 37090.7KB 39601.4KB
water_lines 913627 26948.9KB 188857.4KB 215806.3KB
pois 70092 1859.1KB 1571.9KB 3431.0KB
aerialways 214 6.6KB 10.3KB 16.9KB
street_polygons 3653 67.6KB 542.4KB 610.0KB
streets 335049 21941.3KB 112307.8KB 134249.1KB
public_transport 348 14.3KB 7.8KB 22.1KB
pier_lines 101 2.1KB 9.2KB 11.3KB
dam_lines 338 6.9KB 19.5KB 26.4KB
sites 590 15.8KB 270.6KB 286.5KB
buildings 728 34.3KB 133.3KB 167.7KB
street_labels 186891 6533.4KB 49684.9KB 56218.3KB
ferries 4 0.1KB 0.3KB 0.4KB

Zoom - 13

Biggest Tile

X Y Z Size
8072 4999 13 82.8KB

Distributions

Distribution Number Of Tiles Percentage
0-10KB 8560 37.9%
10-50KB 13977 61.9%
50-100KB 27 0.1%

Layers

Layer Name Number Of Features Total Geometry Sizes Total Attribute Sizes Total Sizes
place_labels 1482 76.6KB 33.2KB 109.8KB
boundaries 33735 951.3KB 16611.9KB 17563.2KB
land 1725820 36760.4KB 475737.0KB 512497.4KB
contours 310023 14669.6KB 580085.9KB 594755.5KB
water_lines 1003336 29539.3KB 274948.4KB 304487.6KB
water_polygons 82771 2698.2KB 42132.2KB 44830.4KB
street_polygons 3933 73.6KB 626.1KB 699.7KB
pois 69905 1853.3KB 1567.8KB 3421.1KB
aerialways 236 7.1KB 12.3KB 19.4KB
streets 379190 24972.8KB 147323.9KB 172296.7KB
public_transport 348 14.2KB 7.8KB 22.0KB
pier_lines 109 2.3KB 10.3KB 12.6KB
dam_lines 342 6.9KB 21.1KB 28.0KB
sites 626 16.8KB 317.6KB 334.5KB
buildings 723 34.1KB 185.3KB 219.4KB
street_labels 210132 7428.5KB 69512.9KB 76941.5KB
ferries 4 0.1KB 0.4KB 0.4KB

Zoom - 14

Biggest Tile

X Y Z Size
16144 9998 14 439.9KB

Distributions

Distribution Number Of Tiles Percentage
0-10KB 85266 65.0%
10-50KB 44857 34.2%
50-100KB 454 0.3%
100-200KB 369 0.3%
200-500KB 246 0.2%

Layers

Layer Name Number Of Features Total Geometry Sizes Total Attribute Sizes Total Sizes
place_labels 1370 70.1KB 30.7KB 100.8KB
land 1991926 43752.8KB 531207.7KB 574960.5KB
pois 118283 4083.8KB 2653.9KB 6737.7KB
boundaries 97962 3508.9KB 24104.6KB 27613.6KB
parcel_boundaries 3705670 102085.5KB 1188962.6KB 1291048.1KB
contours 2142792 82280.3KB 3254325.9KB 3336606.2KB
streets 470086 31218.6KB 184844.9KB 216063.5KB
water_polygons 93394 3124.4KB 46358.7KB 49483.1KB
water_lines 1184052 34777.5KB 296995.7KB 331773.3KB
street_polygons 4535 86.9KB 747.1KB 833.9KB
aerialways 275 8.1KB 15.2KB 23.3KB
public_transport 341 13.9KB 7.6KB 21.6KB
dam_lines 342 6.9KB 22.8KB 29.7KB
pier_lines 113 2.4KB 11.1KB 13.5KB
sites 717 19.8KB 362.7KB 382.5KB
buildings 3586321 161990.1KB 560426.1KB 722416.2KB
street_labels 257410 9250.5KB 93939.9KB 103190.4KB
ferries 5 0.1KB 0.5KB 0.6KB

Zoom - 15

Biggest Tile

X Y Z Size
32291 19996 15 356.8KB

Distributions

Distribution Number Of Tiles Percentage
0-10KB 510195 98.3%
10-50KB 7123 1.4%
50-100KB 1271 0.2%
100-200KB 671 0.1%
200-500KB 6 0.0%

Layers

Layer Name Number Of Features Total Geometry Sizes Total Attribute Sizes Total Sizes
pois 118287 4084.4KB 2653.7KB 6738.1KB
land 2573257 60149.7KB 616475.6KB 676625.3KB
boundaries 349967 13578.8KB 49961.9KB 63540.7KB
parcel_boundaries 4717305 129332.6KB 1853608.3KB 1982940.9KB
contours 4495378 172301.7KB 3541867.6KB 3714169.3KB
streets 654529 43891.4KB 223907.8KB 267799.2KB
water_lines 1548865 45349.5KB 329224.6KB 374574.1KB
water_polygons 118176 4148.3KB 51874.3KB 56022.6KB
street_polygons 5835 116.0KB 989.2KB 1105.2KB
aerialways 336 9.7KB 20.1KB 29.8KB
addresses 2573237 53049.1KB 57728.8KB 110777.9KB
public_transport 344 14.1KB 7.7KB 21.8KB
dam_lines 356 7.4KB 24.5KB 31.9KB
pier_lines 134 2.8KB 12.7KB 15.5KB
sites 874 25.0KB 416.0KB 441.0KB
buildings 3642092 164514.3KB 579184.1KB 743698.3KB
street_labels 353441 12959.6KB 119847.5KB 132807.1KB
ferries 9 0.1KB 0.8KB 0.9KB

@linz linz deleted a comment from github-actions bot Jun 24, 2025
@linz linz deleted a comment from github-actions bot Jun 24, 2025
@linz linz deleted a comment from github-actions bot Jun 24, 2025
@linz linz deleted a comment from github-actions bot Jun 24, 2025
@linz linz deleted a comment from github-actions bot Jun 24, 2025
@linz linz deleted a comment from github-actions bot Jun 24, 2025
@linz linz deleted a comment from github-actions bot Jun 24, 2025
@linz linz deleted a comment from github-actions bot Jun 24, 2025
@linz linz deleted a comment from github-actions bot Jun 24, 2025
@linz linz deleted a comment from github-actions bot Jun 24, 2025
@linz linz deleted a comment from github-actions bot Jun 24, 2025
@linz linz deleted a comment from github-actions bot Jun 24, 2025
@linz linz deleted a comment from github-actions bot Jun 24, 2025
@linz linz deleted a comment from github-actions bot Jun 24, 2025
@linz linz deleted a comment from github-actions bot Jun 24, 2025
@linz linz deleted a comment from github-actions bot Jun 24, 2025
@linz linz deleted a comment from github-actions bot Jun 24, 2025
@linz linz deleted a comment from github-actions bot Jun 24, 2025
@Wentao-Kuang Wentao-Kuang marked this pull request as ready for review June 24, 2025 23:07
@Wentao-Kuang Wentao-Kuang requested a review from a team as a code owner June 24, 2025 23:07
@tawera-manaena tawera-manaena changed the title build: New github actions to publish vector mbtiles to ORD build: New github actions to publish vector mbtiles to ODR Jun 24, 2025
with:
fetch-depth: 0

- name: Check if topographic-v2.json changed
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This check looks similar to the one starting on line 19. Do we need both?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

2 participants