Data.Kanji

A library for analysing the density of Kanji in given texts, according to their Level classification, as defined by the Japan Kanji Aptitude Testing Foundation (日本漢字能力検定協会).

Kanji

class AsKanji a where

Anything that can be transformed into a list of Kanji.

Methods

_Kanji :: Traversal' a Kanji

Traverse into this type to find 0 or more Kanji.

Despite what the Haddock documentation says, this is part of the minimal complete definition.

asKanji :: a -> [Kanji]

Transform this string type into a list of Kanji. The source string and the resulting list might not have the same length, if there were Char in the source that did not fall within the legal UTF8 range for Kanji.

Instances

AsKanji Char

Methods

_Kanji :: Traversal' Char Kanji

asKanji :: Char -> [Kanji]

AsKanji Text

Methods

_Kanji :: Traversal' Text Kanji

asKanji :: Text -> [Kanji]

AsKanji Text

Methods

_Kanji :: Traversal' Text Kanji

asKanji :: Text -> [Kanji]

AsKanji [Char]

Methods

_Kanji :: Traversal' [Char] Kanji

asKanji :: [Char] -> [Kanji]

newtype Kanji

A single symbol of Kanji. Japanese Kanji were borrowed from China over several waves during the past millenium. Japan names 2136 of these as their standard set, with rarer characters being the domain of academia and esoteric writers.

Japanese has several Japan-only Kanji, including:

• 畑 (a type of rice field)
• 峠 (a narrow mountain pass)
• 働 (to do physical labour)

Constructors

Kanji

Fields

• _kanji :: Char

Instances

Eq Kanji

Methods

(==) :: Kanji -> Kanji -> Bool

(/=) :: Kanji -> Kanji -> Bool

Ord Kanji

Methods

compare :: Kanji -> Kanji -> Ordering

(<) :: Kanji -> Kanji -> Bool

(<=) :: Kanji -> Kanji -> Bool

(>) :: Kanji -> Kanji -> Bool

(>=) :: Kanji -> Kanji -> Bool

max :: Kanji -> Kanji -> Kanji

min :: Kanji -> Kanji -> Kanji

Show Kanji

Methods

showsPrec :: Int -> Kanji -> ShowS

show :: Kanji -> String

showList :: [Kanji] -> ShowS

allKanji :: [Set Kanji]

All Japanese Kanji, grouped by their Level (級) in ascending order. Here, ascending order means from the lowest to the highest level, meaning from 10 to 1.

isKanji :: Char -> Bool

Legal Kanji appear between UTF8 characters 19968 and 40959.

hasLevel :: Kanji -> Bool

Is the Level of a given Kanji known?

Levels

data Level

A Level or Kyuu (級) of Japanese Kanji ranking. There are 12 of these, from 10 to 1, including intermediate levels between 3 and 2, and 2 and 1.

Japanese students will typically have Level-5 ability by the time they finish elementary school. Level-5 accounts for 1006 characters.

By the end of middle school, they would have covered up to Level-3 (1607 Kanji) in their Japanese class curriculum.

While Level-2 (2136 Kanji) is considered "standard adult" ability, many adults could not pass the Level-2, or even the Level-Pre2 (1940 Kanji) exam without considerable study.

Level data for Kanji above Level-2 is currently not provided by this library.

Constructors

Level

Fields

• _allKanji :: Set Kanji
• _rank :: Rank

Instances

Eq Level

Methods

(==) :: Level -> Level -> Bool

(/=) :: Level -> Level -> Bool

Show Level

Methods

showsPrec :: Int -> Level -> ShowS

show :: Level -> String

showList :: [Level] -> ShowS

data Rank

A numeric representation of a Level.

Constructors

Ten

Nine

Eight

Seven

Six

Five

Four

Three

PreTwo

Two

PreOne

One

Instances

Enum Rank

Methods

succ :: Rank -> Rank

pred :: Rank -> Rank

toEnum :: Int -> Rank

fromEnum :: Rank -> Int

enumFrom :: Rank -> [Rank]

enumFromThen :: Rank -> Rank -> [Rank]

enumFromTo :: Rank -> Rank -> [Rank]

enumFromThenTo :: Rank -> Rank -> Rank -> [Rank]

Eq Rank

Methods

(==) :: Rank -> Rank -> Bool

(/=) :: Rank -> Rank -> Bool

Ord Rank

Methods

compare :: Rank -> Rank -> Ordering

(<) :: Rank -> Rank -> Bool

(<=) :: Rank -> Rank -> Bool

(>) :: Rank -> Rank -> Bool

(>=) :: Rank -> Rank -> Bool

max :: Rank -> Rank -> Rank

min :: Rank -> Rank -> Rank

Read Rank

Methods

readsPrec :: Int -> ReadS Rank

readList :: ReadS [Rank]

readPrec :: ReadPrec Rank

readListPrec :: ReadPrec [Rank]

Show Rank

Methods

showsPrec :: Int -> Rank -> ShowS

show :: Rank -> String

showList :: [Rank] -> ShowS

level :: Kanji -> Maybe Level

What Level does a Kanji belong to?

levels :: [Level]

All Levels, with all their Kanji, ordered from Level-10 to Level-2.

isKanjiInLevel :: Level -> Kanji -> Bool

Does a given Kanji belong to the given Level?

levelFromRank :: Rank -> Maybe Level

Is there a Level that corresponds with a given Rank value?

Analysis

percentSpread :: [Kanji] -> [(Kanji, Float)]

The distribution of each Kanji in a set of them. The distribution values must sum to 1.

levelDist :: [Kanji] -> [(Rank, Float)]

How much of each Level is represented by a group of Kanji?

averageLevel :: [Kanji] -> Float

Find the average Level of a given set of Kanji.

uniques :: [Kanji] -> [(Rank, [Kanji])]

Which Kanji appeared from each Level in the text?

Densities

kanjiDensity :: Int -> [Kanji] -> Float

What is the density d of Kanji characters in a given String-like type, where 0 <= d <= 1?

elementaryDen :: [(Rank, Float)] -> Float

How much of the Kanji found are learned in elementary school in Japan?

elementaryDen . levelDist :: [Kanji] -> Float

middleDen :: [(Rank, Float)] -> Float

How much of the Kanji found are learned by the end of middle school?

middleDen . levelDist :: [Kanji] -> Float

highDen :: [(Rank, Float)] -> Float

How much of the Kanji found are learned by the end of high school?

highDen . levelDist :: [Kanji] -> Float

adultDen :: [(Rank, Float)] -> Float

How much of the Kanji found should be able to read by the average person?

adultDen . levelDist :: [Kanji] -> Float