scrapbook

[ library, mit, program, web ] [ Propose Tags ] [ Report a vulnerability ]

Please see the README on Github at https://github.com/matsubara0507/scrapbook#readme

[Skip to Readme]

Modules

ScrapBook
- ScrapBook.Cmd
  - ScrapBook.Cmd.Options
  - ScrapBook.Cmd.Run
- ScrapBook.Collecter
- Data
  - ScrapBook.Data.Config
  - ScrapBook.Data.Format
  - ScrapBook.Data.Site
- ScrapBook.Feed
  - ScrapBook.Feed.Atom
  - ScrapBook.Feed.RSS
- ScrapBook.Fetch
- ScrapBook.Json
- ScrapBook.Write

Downloads

scrapbook-0.3.2.tar.gz [browse] (Cabal source package)
Package description (as included in the package)

Maintainer's Corner

Package maintainers

matsubara0507

For package maintainers and hackage trustees

edit package information

Candidates

No Candidates

Versions [RSS]	0.3.2, 0.3.3, 0.5.0
Change log	CHANGELOG.md
Dependencies	aeson, aeson-pretty, base (>=4.7 && <5), data-default, drinkery, extensible, feed, gitrev, req, rio, scrapbook, xml-conduit, xml-types, yaml [details]
License	MIT
Copyright	2018 MATSUBARA Nobutada
Author	MATSUBARA Nobutada
Maintainer	none
Uploaded	by matsubara0507 at 2019-02-01T04:21:35Z
Home page	https://github.com/matsubara0507/scrapbook#readme
Bug tracker	https://github.com/matsubara0507/scrapbook/issues
Source repo	head: git clone https://github.com/matsubara0507/scrapbook
Distributions
Executables	scrapbook
Downloads	1221 total (8 in the last 30 days)
Rating	(no votes yet) [estimated by Bayesian average]
Your Rating	λ λ λ
Status	Docs not available [build log] All reported builds failed as of 2019-02-01 [all 3 reports]

Readme for scrapbook-0.3.2

[back to package description]

scrapbook

This is cli tool that collect posts of site that is wrote in config yaml using feed or scraping.

Usage

clone this repository or add scrapbook package to extra-deps in stack.yaml
run stack install

e.g.

$ stack exec -- scrapbook -o "example" example/sites.yaml

Docker

$ docker run --rm -v `pwd`:/work matsubara0507/scrapbook bin/bash -c "cd work && scrapbook -o 'example' example/sites.yaml"

Command

scrapbook [options] [input-file]
  -o DIR                --output=DIR                 Write output to DIR instead of stdout.
  -t FORMAT, -w FORMAT  --to=FORMAT, --write=FORMAT  Specify output format. default is `feed`.
                        --version                    Show version

GHCi

>> import Control.Lens ((^.))
>> import Data.Maybe
>> conf <- fromJust <$> readConfig "example/sites.yaml"
>> (Right posts) <- collect . fmap concat $ mapM (fetch . toSite) (conf ^. #sites)
>> collect $ writeFeed "example" (fromJust $ conf ^. #feed) posts
Right ()

Example

see matsuara0507/scrapbook-example

Documentation

How to write config yaml file.

# configuration for generating Atom feed (Optional)
feed:
  ## write as site title to Atom feed
  title: "Sample Site Posts"
  ## write as site url to Atom feed
  baseUrl: "https://example.com"
  ## file name (Optional)
  ### if nothing, use same name from input file
  name: atom.xml

# Haskeller's site configuration
sites:
    ## Title of site
  - title: "ひげメモ"
    ## Author of site
    author: matsubara0507
    ## URL of site
    url: https://matsubara0507.github.io
    ## Feed url of site
    ### there are several field to set feed url
    ### `feed` is basic field. This field auto branch to Atom or RSS 2.0.
    feed: https://matsubara0507.github.io/feed
  - title: "Kuro's Blog"
    author: "Hiroyuki Kurokawa"
    url: http://kurokawh.blogspot.com/
    ### `atom` is for Atom feed.  
    atom:
      ### feed url of Atom
      url: http://kurokawh.blogspot.com/feeds/posts/default
      ### set attr as constraint for link on each entry of Atom feed (Optional)
      ### if nothing, choice head. if set multiple attr, conjunction.
      linkAttrs:
        rel: alternate
  - title: "あどけない話"
    author: "kazu-yamamoto"
    url: http://d.hatena.ne.jp/kazu-yamamoto
    ### `rss` is for RSS 2.0 feed.
    ### set feed url.
    rss: http://d.hatena.ne.jp/kazu-yamamoto/rss2