instana-haskell-trace-sdk: SDK for adding custom Instana tracing support to Haskell applications.

[ library, mit, monitoring, program ] [ Propose Tags ]

Please also see the README on Github at https://github.com/instana/haskell-trace-sdk#readme


[Skip to Readme]
Versions [faq] 0.1.0.0, 0.2.0.0, 0.3.0.0
Change log ChangeLog.md
Dependencies aeson, aeson-extra, base (>=4.7 && <5), binary, bytestring, containers, directory, ekg-core, exceptions, hslogger, http-client, http-client-tls, http-types, instana-haskell-trace-sdk, network, process, random, regex-base, regex-tdfa, retry, scientific, servant, servant-server, stm, sysinfo, text, time, transformers, unix, unordered-containers, wai, warp [details]
License MIT
Copyright 2018 Instana, Inc.
Author Bastian Krol
Maintainer bastian.krol@instana.com
Category Monitoring
Home page https://www.instana.com/
Bug tracker https://github.com/instana/haskell-trace-sdk/issues
Source repo head: git clone https://github.com/instana/haskell-trace-sdk
Uploaded by basti1302 at Wed May 8 07:07:27 UTC 2019
Distributions NixOS:0.3.0.0
Executables instana-haskell-test-wai-with-middleware-server, instana-haskell-test-wai-server, instana-haskell-agent-stub, instana-haskell-example-exe
Downloads 175 total (50 in the last 30 days)
Rating (no votes yet) [estimated by rule of succession]
Your Rating
  • λ
  • λ
  • λ
Status Hackage Matrix CI
Docs uploaded by user [build log]
All reported builds failed as of 2019-05-08 [all 2 reports]

Modules

[Index]

Flags

NameDescriptionDefaultType
dev

development mode - warnings let compilation fail

DisabledManual

Use -f <flag> to enable a flag, or -f -<flag> to disable that flag. More info

Downloads

Maintainer's Corner

For package maintainers and hackage trustees


Readme for instana-haskell-trace-sdk-0.3.0.0

[back to package description]

Instana Haskell Trace SDK   Build Status

Monitor your Haskell application with Instana! 🎉

Disclaimer

The Instana Haskell Trace SDK is a labor of love from some of our engineers and work on it is done in their spare time. Haskell is currently not a platform that we officialy support. The experience may differ from other programming languages and platforms that Instana actively supports (such as Java, .NET, Node.js, Python, Ruby, Go, PHP, ...). That said, the SDK is a fully functional piece of software, so don't let this disclaimer discourage you from using it. If you use Instana or consider using it and Haskell support is crucial for you, make sure to give us a ping and let's talk about it.

What The Haskell Trace SDK Is And What It Is Not

The Instana Haskell Trace SDK does not support automatic instrumentation/tracing in the way we support it in most other languages. Instead, the SDK enables you to create spans manually, much like the Instana Trace SDK for Java does. Besides offering a convenient API to create spans, the Haskell Trace SDK also takes care of establishing a connection to the Instana Agent and sending spans to the agent in an efficient way, that does not impede the performance of your production code. Last but not least, it collects runtime metrics and reports them to Instana.

Installation

To use the Instana Haskell Trace SDK in your application, add instana-haskell-trace-sdk to your dependencies (for example to the build-depends section of your cabal file). If you are using stack you might need to add the SDK (with the version number you want to use) to the extra-deps section in your stack.yaml file:

extra-deps:
- instana-haskell-trace-sdk-0.3.0.0

Usage

Initialization

Before using the SDK, you need to initialize it once, usually during application startup.

import qualified Instana.SDK.SDK as InstanaSDK

main :: IO ()
main = do
  -- ... initialize things ...

  -- initialize Instana
  instana <- InstanaSDK.initInstana

  -- ... initialize more things

The value instana :: Instana.SDK.InstanaContext that is returned by InstanaSDK.initInstana is required for all further calls, that is, for creating spans that will be send to the agent. The SDK will try to connect to an agent (asynchronous, in a a separate thread) as soon as it receives the initInstana call.

The SDK can be configured via environment variables or directly in the code by passing configuration parameters to the initialization function, or both.

If you would like to pass configuration parameters programatically, use initConfiguredInstana instead of initInstana:

import qualified Instana.SDK.SDK as InstanaSDK

main :: IO ()
main = do

  -- Example snippet for using the Instana SDK and providing a configuration
  -- (agent host, port, ...) directly in code. You only need to specify the
  -- configuration values you are interested in and can omit everything else
  -- (see https://www.yesodweb.com/book/settings-types).
  let
    config =
      InstanaSDK.defaultConfig
        { InstanaSDK.agentHost = Just "127.0.0.1"
        , InstanaSDK.agentPort = Just 42699
        , InstanaSDK.serviceName = Just "A Great Hakell Service"
        , InstanaSDK.forceTransmissionAfter = Just 1000
        , InstanaSDK.forceTransmissionStartingAt = Just 500
        , InstanaSDK.maxBufferedSpans = Just 1000
        }
  instana <- InstanaSDK.initConfiguredInstana config

For configuration parameters that are omitted when creating the config record or are set to Nothing, the SDK will fall back to environment variables (see below) and then to default values.

There are also bracket-style variants of the initialization function, called withInstana and withConfiguredInstana:

import qualified Instana.SDK.SDK as InstanaSDK

main :: IO ()
main = do
  InstanaSDK.withInstana runApp

runApp :: InstanaContext -> IO ()
runApp instana = do
  -- do your thing here :-)

or, with bracket style and a configuration record:

import qualified Instana.SDK.SDK as InstanaSDK

main :: IO ()
main = do
  let
    config =
      InstanaSDK.defaultConfig
        { InstanaSDK.agentHost = Just "127.0.0.1"
        , InstanaSDK.agentPort = Just 42699
        , InstanaSDK.serviceName = Just "A Great Hakell Service"
        , InstanaSDK.forceTransmissionAfter = Just 1000
        , InstanaSDK.forceTransmissionStartingAt = Just 500
        , InstanaSDK.maxBufferedSpans = Just 1000
        }

  InstanaSDK.withConfiguredInstana config runApp

runApp :: InstanaContext -> IO ()
runApp instana = do
  -- do your thing here :-)

Creating Spans

Trace HTTP Entries Automatically

You can let the SDK automatically create entry spans for all incoming HTTP requests in a WAI application by using it as a WAI middleware plug-in. Note that exit spans still need to be created manually via the withHttpExit or startHttpExit/completeExit functions (see below).

import qualified Instana.Wai.Middleware.Entry as InstanaWaiMiddleware

main = do
  Warp.run 3000 $ InstanaWaiMiddleware.traceHttpEntries instana $ app

Bracket Style (High Level API)

All functions starting with with accept (among other parameters) an IO action. The SDK will start a span before, then execute the given IO action and complete the span afterwards. Using this style is recommended over the low level API that requires you to start and complete spans yourself.

  • withRootEntry: Creates an entry span that is the root of a trace (it has no parent span).
  • withEntry: Creates an entry span that has a parent span.
  • withHttpEntry: A convenience function that examines an HTTP request for Instana tracing headers and creates an entry span. It will automatically add the correct metadata to the span. You do not need to handle incoming HTTP requests at all when using the Instana WAI middleware plug-in (see above).
  • withExit: Creates an exit span. This can only be called inside a withRootEntry or an withEntry call, as an exit span needs an entry span as its parent.
  • withHttpExit: Creates an exit span for a given HTTP client request. It will automatically add the correct metadata to the span so it should be preferred to withExit when tracing outgoing HTTP requests.

Low Level API/Explicit Start And Complete

  • startRootEntry: Starts an entry span that is the beginning of a trace (has no parent span). You will need to call completeEntry at some point.
  • startEntry: Starts an entry span. You will need to call completeEntry at some point.
  • startHttpEntry: Starts an entry span for an incoming HTTP request. It will automatically add the correct metadata to the span. You do not need to handle incoming HTTP requests at all when using the WAI middleware plug-in (see above). You will need to call completeEntry at some point.
  • startExit: Starts an exit span. You will need to call completeExit at some point.
  • startHttpExit: Starts an exit span for an outgoing HTTP request. It will automatically add the correct metadata to the span so it should be preferred to startExit when tracing outgoing HTTP requests. You will need to call completeExit at some point.
  • completeEntry: Finalizes an entry span. This will put the span into the SDK's span buffer for transmission to the Instana agent.
  • completeExit: Finalizes an exit span. This will put the span into the SDK's span buffer for transmission to the Instana agent.

Best Practices

Make sure you have read Instana's docs on custom tracing and in particular the best practices section. This documentation contains a lot of useful info for integrating Instana tracing into your code; among other things, it explains which metadata can be added to spans (via InstanaSDK.addTag and InstanaSDK.addTagAt).

Instana differentiates between so-called registered spans and SDK spans. Registered spans are usually created by automatic tracing and there is specialized handling for each registered in Instana's processing pipeline. SDK spans, in contrast, are the type of spans created by using a trace SDK (like the Haskell trace SDK or other, similar SDKs for other runtime platforms). SDK span are processed in a more generic fashion by Instana's processing pipeline.

Note that nearly all spans created with this SDK should be SDK spans. The are only two exceptions, for which this SDK creates registered spans:

  • HTTP/WAI entry (server) spans, and
  • HTTP exit (client) spans.

The SDK offers special functions to create these registered spans (withHttpEntry, withHttpExit as well as the corresponding lower level functions startHttpEntry and startHttpExit, see above).

Configuration Via Environment Variables

Instead of configuring the SDK programatically, as seen above, it can also be configured via environment variables:

  • INSTANA_AGENT_HOST: The IP or the host of the Instana agent to connect to. Default: 127.0.0.1.
  • INSTANA_AGENT_PORT: The port of the Instana agent to connect to. Default: 42699.
  • INSTANA_AGENT_NAME: When establishing a connection to the Instana agent, the SDK validates the Instana agent's Server HTTP response header. Should you have changed the Server name on the agent side, you can use this environment variable to provide the name to match that header against.
  • INSTANA_SERVICE_NAME: Override the default service name in Instana.
  • INSTANA_FORCE_TRANSMISSION_STARTING_AFTER: Spans are usually buffered before being transmitted to the agent. This setting forces the transmission of all buffered spans after the given amount of milliseconds. Default: 1000.
  • INSTANA_FORCE_TRANSMISSION_STARTING_AT: This setting forces the transmission of all buffered spans when the given number of spans has been buffered.
  • INSTANA_MAX_BUFFERED_SPANS: Limits the number of spans to buffer. When the limit is reached, spans will be dropped. This setting is a safe guard against memory leaks from buffering excessive amounts of spans. It must be larger than INSTANA_FORCE_TRANSMISSION_STARTING_AT.
  • INSTANA_LOG_LEVEL: See section "Configure Debug Logging".
  • INSTANA_LOG_LEVEL_STDOUT: See section "Configure Debug Logging".
  • INSTANA_OVERRIDE_HSLOGGER_ROOT_HANDLER: See section "Configure Debug Logging".

Configure Debug Logging

If required, the Instana Haskell SDK can produce logs via hslogger. Under normal circumstances, the SDK does not emit any log output at all. It will only output log messages when logging is explicitly enabled via certain environment variables. This can be useful to troubleshoot tracing in production settings or during development.

Logging Related Environment Variables

  • INSTANA_LOG_LEVEL: Sets the log level for the SDK's log file. The log file will be written to the system's temporary directory (in particular, whatever System.Directory.getTemporaryDirectory returns) as instana-haskell-sdk.{pid}.log.
  • INSTANA_LOG_LEVEL_STDOUT: Sets the level for emitting log messages to stdout.
  • INSTANA_OVERRIDE_HSLOGGER_ROOT_HANDLER: Controls whether the SDK sets an hslogger at the root logger level, see below.

When To Set INSTANA_OVERRIDE_HSLOGGER_ROOT_HANDLER

Setting up hslogger correctly inside a library like the Instana Haskell SDK (as opposed to an application which has full control) can be tricky. For the Instana Haskell SDK to be able to correctly configure hslogger, it is important to know whether the app in question (or some part of it) already uses hslogger. In particular, does some part of the code set a handler on hslogger's root logger? Is a call like the following executed somewhere in the application?

import System.Log.Logger (rootLoggerName, setHandlers, updateGlobalLogger)

updateGlobalLogger rootLoggerName $ setHandlers [...]

If this is the case, you can simply use INSTANA_LOG_LEVEL (or INSTANA_LOG_LEVEL_STDOUT) without further configuration. If the app in question does not use hslogger, that is, if no setHandler call on rootLoggerName is executed, you should also set INSTANA_OVERRIDE_HSLOGGER_ROOT_HANDLER to a non-empty string (for example, INSTANA_OVERRIDE_HSLOGGER_ROOT_HANDLER=true).

Troubleshooting Tracing In Production

If your app already uses hslogger, use:

  • INSTANA_LOG_LEVEL=DEBUG

Otherwise, use:

  • INSTANA_LOG_LEVEL=DEBUG INSTANA_OVERRIDE_HSLOGGER_ROOT_HANDLER=true

Development

During development (that is, when working on the Instana Haskell SDK), use either

  • INSTANA_LOG_LEVEL_STDOUT=DEBUG

or

  • INSTANA_LOG_LEVEL_STDOUT=DEBUG
  • INSTANA_OVERRIDE_HSLOGGER_ROOT_HANDLER=true

depending on whether the application already uses and configures hslogger. The application example-app that is contained in the Instana Haskell SDK's repo configures hslogger, so simply using INSTANA_LOG_LEVEL_STDOUT=DEBUG is correct.

Contributing

See CONTRIBUTING.md.