asif

[ library, mit, program, services ] [ Propose Tags ]

Please see the README on Github at https://github.com/packetloop/asif#readme


[Skip to Readme]
Versions 1.0.0, 2.0.0, 3.0.0, 3.1.0, 3.2.0
Change log ChangeLog.md
Dependencies asif, attoparsec, base (>=4.7 && <5), binary, bytestring, conduit, conduit-combinators, conduit-extra, containers, cpu, directory, either, exceptions, generic-lens, hw-bits, hw-ip, iproute, lens, network, old-locale, optparse-applicative, resourcet, temporary-resourcet, text, thyme, vector [details]
License MIT
Copyright Arbor Networks
Author Arbor Networks
Maintainer mayhem@arbor.net
Category Services
Home page https://github.com/packetloop/asif#readme
Bug tracker https://github.com/packetloop/asif/issues
Source repo head: git clone https://github.com/packetloop/asif
Uploaded by arbornetworks at Tue Nov 20 00:53:25 UTC 2018
Distributions NixOS:3.1.0, Stackage:3.1.0
Executables asif
Downloads 166 total (22 in the last 30 days)
Rating (no votes yet) [estimated by rule of succession]
Your Rating
  • λ
  • λ
  • λ
Status Docs available [build log]
Last success reported on 2018-11-20 [all 1 reports]
Hackage Matrix CI

Modules

[Index] [Quick Jump]

Downloads

Maintainer's Corner

For package maintainers and hackage trustees


Readme for asif-3.2.0

[back to package description]

Arbor Safe Intelligence Format (asif)

CircleCI

Library for creating and querying segmented feeds.

File Format Specification

Layer 0: Segments

+--------------------+
|Segmented OSI Model |
+--------------------+

 magic, where XXXX is a feed type
+---------------------+-------------+
| "seg:XXXX" [char:8] | ver: uint64 |
+---------------------+-------------+

c -- countries
a -- asns
n -- naics

 header
+-----------------+
| seg_num: uint64 |
+-----------------+

 segments
+-----------------------+-----------------------+
| segment_offset: int32 | segment_length: int32 |
+-----------------------+-----------------------+

 segment vector
+-------------+
| key: X, ... |
+-------------+

 segment vector
+-------------+
| val: Y, ... |
+-------------+

Vector keys are fixed-length values such as 4-byte IPv4 addresses, 2-byte country codes, or 4-byte NAIC IDs.

All values are little-endian.

Values are other ints or can be null-terminated strings.

Layer 1: Segment filenames

Segment 0 must contain a concatenated list of null terminated filenames.

The first filename must be .asif/filenames.

The n-th filename in the segment 0 describes the n-th segment in the file.

Layer 2: Additional metadata

The asif file may contain contain a named segment .asif/createtime. If it does, this segment concatenated Word64 numbers representing the create time of each file in microseconds since epoch. If the segment does not have a create time, it's create time entry will be 0 instead.

The asif file may contain contain a named segment .asif/formats. If it does, this segment concatenated null terminated strings representing the format of the data in the respective segments. The dump command will use this information to choose the most appropriate way to print the data in each segment.

CLI

CLI documentation