streaming-osm: A hand-written streaming byte parser for OpenStreetMap Protobuf data.

[ bsd3, library, streaming ] [ Propose Tags ]

A hand-written streaming byte parser for OpenStreetMap Protobuf data.


[Skip to Readme]
Versions [faq] 1.0.0, 1.0.0.1, 1.0.1, 1.0.2
Change log CHANGELOG.md
Dependencies attoparsec (==0.13.*), base (>=4.8 && <5), bytestring, containers, resourcet (==1.2.*), streaming (==0.2.*), streaming-attoparsec (==1.0.*), streaming-bytestring (==0.1.*), text (==1.2.*), transformers, vector (==0.12.*), zlib (==0.6.*) [details]
License BSD-3-Clause
Copyright Copyright (c) 2017 - 2020 Azavea
Author Colin Woodbury
Maintainer colin@fosskers.ca
Category Streaming
Home page https://github.com/fosskers/streaming-osm
Uploaded by fosskers at 2020-07-16T16:52:18Z
Distributions NixOS:1.0.2
Downloads 1240 total (6 in the last 30 days)
Rating (no votes yet) [estimated by Bayesian average]
Your Rating
  • λ
  • λ
  • λ
Status Hackage Matrix CI
Docs available [build log]
Last success reported on 2020-07-16 [all 1 reports]

Modules

[Index] [Quick Jump]

Downloads

Maintainer's Corner

For package maintainers and hackage trustees


Readme for streaming-osm-1.0.2

[back to package description]

streaming-osm

This library provides the ability to read and process OpenStreetMap data via the streaming ecosystem. Since streaming allows for very little RAM overhead despite file size, we can process very large OSM PBF files just by providing a file path:

import           Streaming
import           Streaming.Osm
import qualified Streaming.Prelude as S

-- | Count all nodes.
count :: IO ()
count = do
  len <- runResourceT . S.length_ . nodes . blocks $ blobs "yourfile.osm.pbf"
  print len