Skip to content

Instantly share code, notes, and snippets.

@do-me

do-me/download.sh

Created May 6, 2026 19:39
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save do-me/e602eb924d80096995f25ad48769d05d to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save do-me/e602eb924d80096995f25ad48769d05d to your computer and use it in GitHub Desktop.
Download ZIP
layercake download
Raw
download.sh
⏺ # 1. Pick a destination
DEST=~/data/osm_boundaries.parquet
# 2. Download with resume support (the server can stall mid-stream)
curl -SL -C - --max-time 2400 \
-o "$DEST" \
https://data.openstreetmap.us/layercake/boundaries.parquet
# 3. (optional) Verify it parses
duckdb -c "SELECT COUNT(*) FROM read_parquet('$DEST');"
Tips:
- Always include -C - — first try usually times out around 50 %; rerun the same command and it resumes.
- Country polygons live in rows where "ISO3166-1:alpha2" IS NOT NULL (admin levels 2/3/4 mixed; ~255 features → 246 unique ISO codes).
- Geometry column is geometry (WKB BLOB; DuckDB spatial reads it directly as GEOMETRY).
❯ file size of final file ?
Listed 1 directory (ctrl+o to expand)
⏺ 5.0 GB (places_work_augmented.parquet, 75,495,994 rows × 16 cols, zstd-compressed).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment