buffer-builder: Library for efficiently building up buffers, one piece at a time

[ bsd3, data, library ] [ Propose Tags ]
This version is deprecated.

Data.BufferBuilder is an efficient library for incrementally building up ByteStrings, one chunk at a time. Early benchmarks show it is over twice as fast as ByteString Builder, primarily because BufferBuilder is built upon an ST-style restricted monad and mutable state instead of ByteString Builder's monoidal AST.

Internally, BufferBuilder is backed by a few C functions. Examination of GHC's output shows nearly optimal code generation with no intermediate thunks -- and thus, continuation passing and its associated indirect jumps and stack traffic only occur when BufferBuilder is asked to append a non-strict ByteString.

I benchmarked four approaches with a URL encoding benchmark:

  • State monad, concatenating ByteStrings: 6.98 us

  • State monad, ByteString Builder: 2.48 us

  • Crazy explicit RealWorld baton passing with unboxed state: 28.94 us (GHC generated really awful code for this, but see the revision history for the technique)

  • C + FFI + ReaderT: 1.11 us

Using BufferBuilder is very simple:

import qualified Data.BufferBuilder as BB

let byteString = BB.runBufferBuilder $ do
      BB.appendBS "http"
      BB.appendChar8 '/'
      BB.appendBS "//"

This package also provides Data.BufferBuilder.Utf8 for generating UTF-8 buffers and Data.BufferBuilder.Json for encoding data structures into JSON.


[Last Documentation]

  • Data
    • Data.BufferBuilder
      • Data.BufferBuilder.Json
      • Data.BufferBuilder.Utf8


Note: This package has metadata revisions in the cabal description newer than included in the tarball. To unpack the package including the revisions, use 'cabal get'.

Maintainer's Corner

Package maintainers

For package maintainers and hackage trustees


Versions [RSS],,,,,,,,,,,,,,,,,, (info)
Dependencies base (<0), bytestring, mtl, text, unordered-containers, vector [details]
License BSD-3-Clause
Copyright IMVU Inc., Chad Austin, Andy Friesen
Author Chad Austin, Andy Friesen
Maintainer chad@chadaustin.me
Revised Revision 1 made by HerbertValerioRiedel at 2016-12-01T18:46:29Z
Category Data
Home page https://github.com/chadaustin/buffer-builder
Uploaded by chadaustin at 2015-02-22T01:29:27Z
Distributions LTSHaskell:, NixOS:, Stackage:
Reverse Dependencies 5 direct, 5 indirect [details]
Downloads 14107 total (0 in the last 30 days)
Rating (no votes yet) [estimated by Bayesian average]
Your Rating
  • λ
  • λ
  • λ
Status Docs not available [build log]
All reported builds failed as of 2016-12-01 [all 6 reports]