Module BatScanf

module BatScanf: sig .. end

Formatted input functions.
Author(s): Pierre Weis (Base module), David Teller

Introduction

Functional input with format strings

The module Scanf provides formatted input functions or scanners.

The formatted input functions can read from any kind of input, including strings, files, or anything that can return characters. The more general source of characters is named a scanning buffer and has type BatScanf.Scanning.scanbuf. The more general formatted input function reads from any scanning buffer and is named bscanf.

Generally speaking, the formatted input functions have 3 arguments:

the first argument is a source of characters for the input,
the second argument is a format string that specifies the values to read,
the third argument is a receiver function that is applied to the values read.

Hence, a typical call to the formatted input function Scanf.bscanf is bscanf ib fmt f, where:

ib is a source of characters (typically a scanning buffer with type BatScanf.Scanning.scanbuf),

fmt is a format string (the same format strings as those used to print material with module Printf or Format),

f is a function that has as many arguments as the number of values to read in the input.

A simple example

As suggested above, the expression bscanf ib "%d" f reads a decimal integer n from the source of characters ib and returns f n.

For instance,

if we use stdib as the source of characters (BatScanf.Scanning.stdib is the predefined input buffer that reads from standard input),

if we define the receiver f as let f x = x + 1,

then bscanf stdib "%d" f reads an integer n from the standard input and returns f n (that is n + 1). Thus, if we evaluate

bscanf stdib
    "%d" f

, and then enter 41 at the keyboard, we get 42 as the final result.

Formatted input as a functional feature

The Caml scanning facility is reminiscent of the corresponding C feature. However, it is also largely different, simpler, and yet more powerful: the formatted input functions are higher-order functionals and the parameter passing mechanism is just the regular function application not the variable assigment based mechanism which is typical for formatted input in imperative languages; the Caml format strings also feature useful additions to easily define complex tokens; as expected within a functional programming language, the formatted input functions also support polymorphism, in particular arbitrary interaction with polymorphic user-defined scanners. Furthermore, the Caml formatted input facility is fully type-checked at compile time.

module Scanning: sig .. end

Scanning buffers

Type of formatted input functions

type ('a, 'b, 'c, 'd) scanner = ('a, Scanning.scanbuf, 'b, 'c, 'a -> 'd, 'd) format6 -> 'c

The type of formatted input scanners: ('a, 'b, 'c, 'd) scanner is the type of a formatted input function that reads from some scanning buffer according to some format string; more precisely, if scan is some formatted input function, then scan ib fmt f applies f to the arguments specified by the format string fmt, when scan has read those arguments from the scanning input buffer ib.

For instance, the scanf function below has type ('a, 'b, 'c, 'd) scanner, since it is a formatted input function that reads from stdib: scanf fmt f applies f to the arguments specified by fmt, reading those arguments from stdin as expected.

If the format fmt has some %r indications, the corresponding input functions must be provided before the receiver f argument. For instance, if read_elem is an input function for values of type t, then bscanf ib "%r;" read_elem f reads a value v of type t followed by a ';' character, and returns f v.

exception Scan_failure of string

The exception that formatted input functions raise when the input cannot be read according to the given format.

The general formatted input function

val bscanf : Scanning.scanbuf -> ('a, 'b, 'c, 'd) scanner

bscanf ib fmt r1 ... rN f reads arguments for the function f, from the scanning buffer ib, according to the format string fmt, and applies f to these values. The result of this call to f is returned as the result of the entire bscanf call. For instance, if f is the function fun s i -> i + 1, then Scanf.sscanf "x= 1" "%s = %i" f returns 2.

Arguments r1 to rN are user-defined input functions that read the argument corresponding to a %r conversion.

Format string description

The format is a character string which contains three types of objects:

plain characters, which are simply matched with the characters of the input,
conversion specifications, each of which causes reading and conversion of one argument for the function f,
scanning indications to specify boundaries of tokens.

The space character in format strings

As mentioned above, a plain character in the format string is just matched with the characters of the input; however, one character is a special exception to this simple rule: the space character (ASCII code 32) does not match a single space character, but any amount of ``whitespace'' in the input. More precisely, a space inside the format string matches any number of tab, space, line feed and carriage return characters.

Matching any amount of whitespace, a space in the format string also matches no amount of whitespace at all; hence, the call bscanf ib "Price = %d $" (fun p -> p) succeds and returns 1 when reading an input with various whitespace in it, such as Price = 1 $, Price = 1 $, or even Price=1$.

Conversion specifications in format strings

Conversion specifications consist in the % character, followed by an optional flag, an optional field width, and followed by one or two conversion characters. The conversion characters and their meanings are:

d: reads an optionally signed decimal integer.
i: reads an optionally signed integer (usual input formats for hexadecimal (0x[d]+ and 0X[d]+), octal (0o[d]+), and binary 0b[d]+ notations are understood).
u: reads an unsigned decimal integer.
x or X: reads an unsigned hexadecimal integer.
o: reads an unsigned octal integer.
s: reads a string argument that spreads as much as possible, until the following bounding condition holds: a whitespace has been found, a scanning indication has been encountered, or the end-of-input has been reached. Hence, this conversion always succeeds: it returns an empty string, if the bounding condition holds when the scan begins.
S: reads a delimited string argument (delimiters and special escaped characters follow the lexical conventions of Caml).
c: reads a single character. To test the current input character without reading it, specify a null field width, i.e. use specification %0c. Raise Invalid_argument, if the field width specification is greater than 1.
C: reads a single delimited character (delimiters and special escaped characters follow the lexical conventions of Caml).
f, e, E, g, G: reads an optionally signed floating-point number in decimal notation, in the style dddd.ddd e/E+-dd.
F: reads a floating point number according to the lexical conventions of Caml (hence the decimal point is mandatory if the exponent part is not mentioned).
B: reads a boolean argument (true or false).
b: reads a boolean argument (for backward compatibility; do not use in new programs).
ld, li, lu, lx, lX, lo: reads an int32 argument to the format specified by the second letter (decimal, hexadecimal, etc).
nd, ni, nu, nx, nX, no: reads a nativeint argument to the format specified by the second letter.
Ld, Li, Lu, Lx, LX, Lo: reads an int64 argument to the format specified by the second letter.
[ range ]: reads characters that matches one of the characters mentioned in the range of characters range (or not mentioned in it, if the range starts with ^). Reads a string that can be empty, if the next input character does not match the range. The set of characters from c1 to c2 (inclusively) is denoted by c1-c2. Hence, %[0-9] returns a string representing a decimal number or an empty string if no decimal digit is found; similarly, %[\\048-\\057\\065-\\070] returns a string of hexadecimal digits. If a closing bracket appears in a range, it must occur as the first character of the range (or just after the ^ in case of range negation); hence []] matches a ] character and [^]] matches any character that is not ].
r: user-defined reader. Takes the next ri formatted input function and applies it to the scanning buffer ib to read the next argument. The input function ri must therefore have type Scanning.scanbuf -> 'a and the argument read has type 'a.
{ fmt %}: reads a format string argument. The format string read must have the same type as the format string specification fmt. For instance, "%{%i%}" reads any format string that can read a value of type int; hence Scanf.sscanf "fmt:\\\"number is %u\\\"" "fmt:%{%i%}" succeeds and returns the format string "number is %u".
$ fmt %$: scanning format substitution. Reads a format string to replace fmt. The format string read must have the same type as the format string specification fmt. For instance, "%$ %i% $" reads any format string that can read a value of type int; hence Scanf.sscanf "\\\"%4d\\\"1234.00" "%$%i%$" is equivalent to Scanf.sscanf "1234.00" "%4d".
l: returns the number of lines read so far.
n: returns the number of characters read so far.
N or L: returns the number of tokens read so far.
!: matches the end of input condition.
%: matches one % character in the input.

Following the % character that introduces a conversion, there may be the special flag _: the conversion that follows occurs as usual, but the resulting value is discarded. For instance, if f is the function fun i -> i + 1, then Scanf.sscanf "x = 1" "%_s = %i" f returns 2.

The field width is composed of an optional integer literal indicating the maximal width of the token to read. For instance, %6d reads an integer, having at most 6 decimal digits; %4f reads a float with at most 4 characters; and %8[\\000-\\255] returns the next 8 characters (or all the characters still available, if fewer than 8 characters are available in the input).

Notes:

as mentioned above, a %s convertion always succeeds, even if there is nothing to read in the input: it simply returns "".

in addition to the relevant digits, '_' characters may appear inside numbers (this is reminiscent to the usual Caml lexical conventions). If stricter scanning is desired, use the range conversion facility instead of the number conversions.

the scanf facility is not intended for heavy duty lexical analysis and parsing. If it appears not expressive enough for your needs, several alternative exists: regular expressions (module Str), stream parsers, ocamllex-generated lexers, ocamlyacc-generated parsers.

Scanning indications in format strings

Scanning indications appear just after the string conversions %s and %[ range ] to delimit the end of the token. A scanning indication is introduced by a @ character, followed by some constant character c. It means that the string token should end just before the next matching c (which is skipped). If no c character is encountered, the string token spreads as much as possible. For instance, "%s@\t" reads a string up to the next tab character or to the end of input. If a scanning indication @c does not follow a string conversion, it is treated as a plain c character.

Note:

the scanning indications introduce slight differences in the syntax of Scanf format strings, compared to those used for the Printf module. However, the scanning indications are similar to those used in the Format module; hence, when producing formatted text to be scanned by !Scanf.bscanf, it is wise to use printing functions from the Format module (or, if you need to use functions from Printf, banish or carefully double check the format strings that contain '@' characters).

Exceptions during scanning

Scanners may raise the following exceptions when the input cannot be read according to the format string:

Raise Scanf.Scan_failure if the input does not match the format.

Raise Failure if a conversion to a number is not possible.

Raise End_of_file if the end of input is encountered while some more characters are needed to read the current conversion specification.

Raise Invalid_argument if the format string is invalid.

Note:

as a consequence, scanning a %s conversion never raises exception End_of_file: if the end of input is reached the conversion succeeds and simply returns the characters read so far, or "" if none were read.

Specialized formatted input functions

val fscanf : Pervasives.in_channel -> ('a, 'b, 'c, 'd) scanner

Same as Scanf.bscanf, but reads from the given channel.

Warning: since all formatted input functions operate from a scanning buffer, be aware that each fscanf invocation will operate with a scanning buffer reading from the given channel. This extra level of bufferization can lead to strange scanning behaviour if you use low level primitives on the channel (reading characters, seeking the reading position, and so on).

As a consequence, never mixt direct low level reading and high level scanning from the same input channel.

val sscanf : string -> ('a, 'b, 'c, 'd) scanner

Same as Scanf.bscanf, but reads from the given string.

val scanf : ('a, 'b, 'c, 'd) scanner

Same as Scanf.bscanf, but reads from the predefined scanning buffer Scanf.Scanning.stdib that is connected to stdin.

val kscanf : Scanning.scanbuf ->
       (Scanning.scanbuf -> exn -> 'a) -> ('b, 'c, 'd, 'a) scanner

Same as Scanf.bscanf, but takes an additional function argument ef that is called in case of error: if the scanning process or some conversion fails, the scanning function aborts and calls the error handling function ef with the scanning buffer and the exception that aborted the scanning process.

Reading format strings from input

val bscanf_format : Scanning.scanbuf ->
       ('a, 'b, 'c, 'd, 'e, 'f) format6 ->
       (('a, 'b, 'c, 'd, 'e, 'f) format6 -> 'g) -> 'g

bscanf_format ib fmt f reads a format string token from the scannning buffer ib, according to the given format string fmt, and applies f to the resulting format string value. Raise Scan_failure if the format string value read does not have the same type as fmt.

val sscanf_format : string ->
       ('a, 'b, 'c, 'd, 'e, 'f) format6 ->
       (('a, 'b, 'c, 'd, 'e, 'f) format6 -> 'g) -> 'g

Same as Scanf.bscanf_format, but reads from the given string.

val format_from_string : string ->
       ('a, 'b, 'c, 'd, 'e, 'f) format6 -> ('a, 'b, 'c, 'd, 'e, 'f) format6

format_from_string s fmt converts a string argument to a format string, according to the given format string fmt. Raise Scan_failure if s, considered as a format string, does not have the same type as fmt.