Module NS.Iter

Simple and Efficient Iterators

Version of Iterator with labels

type +'a t = ('a -> unit) -> unit

An iterator of values of type 'a. If you give it a function 'a -> unit it will be applied to every element of the iterator successively.

module Import : sig ... end
include module type of Import
type +'a iter = 'a t

NOTE Type ('a, 'b) t2 = ('a -> 'b -> unit) -> unit has been removed and subsumed by ('a * 'b) t

type 'a equal = 'a -> 'a -> bool
type 'a hash = 'a -> int

Creation

val from_iter : (('a -> unit) -> unit) -> 'a t

Build an iterator from a iter function

val from_labelled_iter : (f:('a -> unit) -> unit) -> 'a t

Build an iterator from a labelled iter function

  • since 1.2
val from_fun : (unit -> 'a option) -> 'a t

Call the function repeatedly until it returns None. This iterator is transient, use persistent if needed!

val empty : 'a t

Empty iterator. It contains no element.

val singleton : 'a -> 'a t

Singleton iterator, with exactly one element.

val doubleton : 'a -> 'a -> 'a t

Iterator with exactly two elements

val init : f:(int -> 'a) -> 'a t

init ~f is the infinite iterator f 0; f 1; f 2; ….

  • since 0.9
val cons : 'a -> 'a t -> 'a t

cons x l yields x, then yields from l. Same as append (singleton x) l

val snoc : 'a t -> 'a -> 'a t

Same as cons but yields the element after iterating on l

val return : 'a -> 'a t

Synonym to singleton

val pure : 'a -> 'a t

Synonym to singleton

val repeat : 'a -> 'a t

Infinite iterator of the same element. You may want to look at take and the likes if you iterate on it.

val iterate : 'a -> f:('a -> 'a) -> 'a t

iterate ~f x is the infinite iterator x, f(x), f(f(x)), ...

val forever : f:(unit -> 'b) -> 'b t

Iterator that calls the given function to produce elements. The iterator may be transient (depending on the function), and definitely is infinite. You may want to use take and persistent.

val cycle : 'a t -> 'a t

Cycle forever through the given iterator. Assume the given iterator can be traversed any amount of times (not transient). This yields an infinite iterator, you should use something like take not to loop forever.

Consumption

val iter : 'a t -> f:('a -> unit) -> unit

Consume the iterator, passing all its arguments to the function. Basically iter ~f seq is just seq f.

val iteri : 'a t -> f:(int -> 'a -> unit) -> unit

Iterate on elements and their index in the iterator

val for_each : 'a t -> ('a -> unit) -> unit

Consume the iterator, passing all its arguments to the function. for_each seq f is the same as iter ~f seq, i.e., iter with arguments reversed.

  • since 1.4
val for_eachi : 'a t -> (int -> 'a -> unit) -> unit

Iterate on elements and their index in the iterator. for_eachi seq f is the same as iteri ~f seq, i.e., iteri with arguments reversed.

  • since 1.4
val fold : 'a t -> 's -> f:('a -> 's -> 's) -> 's

Fold over elements of the iterator, consuming it

val foldi : 'a t -> 's -> f:(int -> 'a -> 's -> 's) -> 's

Fold over elements of the iterator and their index, consuming it

val reduce : 'a t -> f:('a -> 'a -> 'a) -> 'a option

Like fold but use the first element as the initial accumulator.

val reduce_exn : 'a t -> f:('a -> 'a -> 'a) -> 'a

Like fold but use the first element as the initial accumulator.

  • raises Invalid_argument

    if the iterator is empty

val fold_map : 'a t -> 's -> f:('a -> 's -> 'b * 's) -> 's * 'b t

fold_map seq s ~f is like map, but it carries some state as in fold. The final state is returned.

val folding_map : 'a t -> 's -> f:('a -> 's -> 'b * 's) -> 'b t

folding_map seq s ~f is like map, but it carries some state as in fold. The state is not returned, it is just used to thread some information to the map function.

  • since 0.9
val fold_filter_map : 'a t -> 's -> f:('a -> 's -> 'b option * 's) -> 'b t

fold_filter_map seq s ~f is a fold_map-like function, but the function can choose to skip an element by retuning None.

  • since 0.9
val map : 'a t -> f:('a -> 'b) -> 'b t

Map objects of the iterator into other elements, lazily

val mapi : 'a t -> f:(int -> 'a -> 'b) -> 'b t

Map objects, along with their index in the iterator

val map_by_2 : 'a t -> f:('a -> 'a -> 'a) -> 'a t

Map objects two by two. lazily. The last element is kept in the iterator if the count is odd.

  • since 0.7
val for_all : 'a t -> f:('a -> bool) -> bool

Do all elements satisfy the predicate?

val exists : 'a t -> f:('a -> bool) -> bool

Exists there some element satisfying the predicate?

val mem : 'a -> 'a t -> eq:('a -> 'a -> bool) -> bool

Is the value a member of the iterator?

  • parameter eq

    the equality predicate to use

  • since 0.5
val find : 'a t -> f:('a -> bool) -> 'a option

find seq ~f finds the first element of seq that satisfies f, or returns None if no element satisfies f

  • since 0.9
val find_exn : 'a t -> f:('a -> bool) -> 'a

Unsafe version of find

  • raises Not_found

    if no such element is found

  • since 0.9
val find_map : 'a t -> f:('a -> 'b option) -> 'b option

Find the first element on which the function doesn't return None

  • since 0.10
val findi : 'a t -> f:(int -> 'a -> bool) -> 'a option

Indexed version of find

  • since 0.9
val find_mapi : 'a t -> f:(int -> 'a -> 'b option) -> 'b option

Indexed version of find_map

  • since 0.10
val length : 'a t -> int

How long is the iterator? Forces the iterator.

val is_empty : 'a t -> bool

Is the iterator empty? Forces the iterator.

Transformation

val filter : 'a t -> f:('a -> bool) -> 'a t

Filter on elements of the iterator

val append : 'a t -> 'a t -> 'a t

Append two iterators. Iterating on the result is like iterating on the first, then on the second.

val append_l : 'a t list -> 'a t

Append iterators. Iterating on the result is like iterating on the each iterator of the list in order.

  • since 0.11
val concat : 'a t t -> 'a t

Concatenate an iterator of iterators into one iterator.

val flatten : 'a t t -> 'a t

Alias for concat

val flat_map : 'a t -> f:('a -> 'b t) -> 'b t

Monadic bind. Intuitively, it applies the function to every element of the initial sequence, and calls concat.

val flat_map_l : 'a t -> f:('a -> 'b list) -> 'b t

Convenience function combining flat_map and of_list

  • since 0.9
val seq_list : 'a t list -> 'a list t

seq_list l returns all the ways to pick one element in each sub-iterator in l. Assumes the sub-iterators can be iterated on several times.

  • since 0.11
val seq_list_map : 'a list -> f:('a -> 'b t) -> 'b list t

seq_list_map f l maps f over every element of l, then calls seq_list

  • since 0.11
val filter_map : 'a t -> f:('a -> 'b option) -> 'b t

Map and only keep non-None elements Formerly fmap

val filter_mapi : 'a t -> f:(int -> 'a -> 'b option) -> 'b t

Map with indices, and only keep non-None elements

  • since 0.11
val filter_count : 'a t -> f:('a -> bool) -> int

Count how many elements satisfy the given predicate

  • since 1.0
val intersperse : 'a -> 'a t -> 'a t

Insert the single element between every element of the iterator

val keep_some : 'a option t -> 'a t

filter_some l retains only elements of the form Some x. Same as filter_map (fun x->x)

  • since 1.0
val keep_ok : ('a, _) Stdlib.result t -> 'a t

keep_ok l retains only elements of the form Ok x.

  • since 1.0
val keep_error : (_, 'e) Stdlib.result t -> 'e t

keep_error l retains only elements of the form Error x.

  • since 1.0

Caching

val persistent : 'a t -> 'a t

Iterate on the iterator, storing elements in an efficient internal structure.. The resulting iterator can be iterated on as many times as needed. Note: calling persistent on an already persistent iterator will still make a new copy of the iterator!

val persistent_lazy : 'a t -> 'a t

Lazy version of persistent. When calling persistent_lazy s, a new iterator s' is immediately returned (without actually consuming s) in constant time; the first time s' is iterated on, it also consumes s and caches its content into a inner data structure that will back s' for future iterations.

warning: on the first traversal of s', if the traversal is interrupted prematurely (take, etc.) then s' will not be memorized, and the next call to s' will traverse s again.

Misc

val sort : 'a t -> cmp:('a -> 'a -> int) -> 'a t

Sort the iterator. Eager, O(n) ram and O(n ln(n)) time. It iterates on elements of the argument iterator immediately, before it sorts them.

val sort_uniq : 'a t -> cmp:('a -> 'a -> int) -> 'a t

Sort the iterator and remove duplicates. Eager, same as sort

val sorted : 'a t -> cmp:('a -> 'a -> int) -> bool

Checks whether the iterator is sorted. Eager, same as sort.

  • since 0.9
val group_succ_by : 'a t -> eq:('a -> 'a -> bool) -> 'a list t

Group equal consecutive elements. Formerly synonym to group.

  • since 0.6
val group_by : 'a t -> hash:('a -> int) -> eq:('a -> 'a -> bool) -> 'a list t

Group equal elements, disregarding their order of appearance. The result iterator is traversable as many times as required. precondition: for any x and y, if eq x y then hash x=hash y must hold.

  • since 0.6
val count : 'a t -> hash:('a -> int) -> eq:('a -> 'a -> bool) -> ('a * int) t

Map each distinct element to its number of occurrences in the whole seq. Similar to group_by seq |> map (fun l->List.hd l, List.length l)

  • since 0.10
val uniq : 'a t -> eq:('a -> 'a -> bool) -> 'a t

Remove consecutive duplicate elements. Basically this is like fun seq -> map List.hd (group seq).

val contains_dup : 'a t -> cmp:('a -> 'a -> int) -> bool

Holds if there exist (not necessarily consecutive) duplicate elements.

val product : 'a t -> 'b t -> ('a * 'b) t

Cartesian product of the iterators. When calling product a b, the caller MUST ensure that b can be traversed as many times as required (several times), possibly by calling persistent on it beforehand.

val diagonal_l : 'a list -> ('a * 'a) t

All pairs of distinct positions of the list. diagonal l will return the iterator of all List.nth i l, List.nth j l if i < j.

  • since 0.9
val diagonal : 'a t -> ('a * 'a) t

All pairs of distinct positions of the iterator. Iterates only once on the iterator, which must be finite.

  • since 0.9
val join : 'a t -> 'b t -> f:('a -> 'b -> 'c option) -> 'c t

join ~f:join_row a b combines every element of a with every element of b using join_row. If join_row returns None, then the two elements do not combine. Assume that b allows for multiple iterations.

val join_by : 'a t -> 'b t -> key1:('a -> 'key) -> key2:('b -> 'key) -> eq:'key equal -> hash:'key hash -> f:('key -> 'a -> 'b -> 'c option) -> 'c t

join key1 key2 ~f:merge is a binary operation that takes two iterators a and b, projects their elements resp. with key1 and key2, and combine values (x,y) from (a,b) with the same key using merge. If merge returns None, the combination of values is discarded. precondition: for any x and y, if eq x y then hash x=hash y must hold.

  • since 0.10
val join_all_by : 'a t -> 'b t -> key1:('a -> 'key) -> key2:('b -> 'key) -> eq:'key equal -> hash:'key hash -> f:('key -> 'a list -> 'b list -> 'c option) -> 'c t

join_all_by key1 key2 ~f:merge is a binary operation that takes two iterators a and b, projects their elements resp. with key1 and key2, and, for each key k occurring in at least one of them:

  • compute the list l1 of elements of a that map to k
  • compute the list l2 of elements of b that map to k
  • call merge k l1 l2. If merge returns None, the combination of values is discarded, otherwise it returns Some c and c is inserted in the result.
  • since 0.10
val group_join_by : 'a t -> 'b t -> eq:'a equal -> hash:'a hash -> f:('b -> 'a) -> ('a * 'b list) t

group_join_by ~f:key associates to every element x of the first iterator, all the elements y of the second iterator such that eq x (key y). Elements of the first iterators without corresponding values in the second one are mapped to [] precondition: for any x and y, if eq x y then hash x=hash y must hold.

  • since 0.10
val inter : eq:'a equal -> hash:'a hash -> 'a t -> 'a t -> 'a t

Intersection of two collections. Each element will occur at most once in the result. Eager. precondition: for any x and y, if eq x y then hash x=hash y must hold.

  • since 0.10
val union : eq:'a equal -> hash:'a hash -> 'a t -> 'a t -> 'a t

Union of two collections. Each element will occur at most once in the result. Eager. precondition: for any x and y, if eq x y then hash x=hash y must hold.

  • since 0.10
val diff : eq:'a equal -> hash:'a hash -> 'a t -> 'a t -> 'a t

Set difference. Eager.

  • since 0.10
val subset : eq:'a equal -> hash:'a hash -> 'a t -> 'a t -> bool

subset a b returns true if all elements of a belong to b. Eager. precondition: for any x and y, if eq x y then hash x=hash y must hold.

  • since 0.10
val unfoldr : 'b -> f:('b -> ('a * 'b) option) -> 'a t

unfoldr ~f b will apply f to b. If it yields Some (x,b') then x is returned and unfoldr recurses with b'.

val scan : 'a t -> 'b -> f:('a -> 'b -> 'b) -> 'b t

Iterator of intermediate results

val max : 'a t -> lt:('a -> 'a -> bool) -> 'a option

Max element of the iterator, using the given comparison function.

  • returns

    None if the iterator is empty, Some m where m is the maximal element otherwise

val max_exn : 'a t -> lt:('a -> 'a -> bool) -> 'a

Unsafe version of max

  • raises Not_found

    if the iterator is empty

  • since 0.10
val min : 'a t -> lt:('a -> 'a -> bool) -> 'a option

Min element of the iterator, using the given comparison function. see max for more details.

val min_exn : 'a t -> lt:('a -> 'a -> bool) -> 'a

Unsafe version of min

  • raises Not_found

    if the iterator is empty

  • since 0.10
val sum : int t -> int

Sum of elements

  • since 0.11
val sumf : float t -> float

Sum of elements, using Kahan summation

  • since 0.11
val head : 'a t -> 'a option

First element, if any, otherwise None

  • since 0.5.1
val head_exn : 'a t -> 'a

First element, if any, fails

  • raises Invalid_argument

    if the iterator is empty

  • since 0.5.1
val pop : 'a t -> ('a * 'a t) option

First element and the remainder of the iterator

val take : int -> 'a t -> 'a t

Take at most n elements from the iterator. Works on infinite iterators.

val take_while : 'a t -> f:('a -> bool) -> 'a t

Take elements while they satisfy the predicate, then stops iterating. Will work on an infinite iterator s if the predicate is false for at least one element of s.

val fold_while : 'b t -> 'a -> f:('b -> 'a -> [ `Stop | `Continue ] * 'a) -> 'a

Folds over elements of the iterator, stopping early if the accumulator returns ('a, `Stop)

  • since 0.5.5
val fold_opt : 'a t -> 's -> f:('a -> 's -> 's option) -> 's option

Folds over elements of the iterator, stopping early if the accumulator returns None.

val fold_result : 'a t -> 's -> f:('a -> 's -> ('s, 'e) Stdlib.result) -> ('s, 'e) Stdlib.result

Folds over elements of the iterator, stopping early if the accumulator returns Error.

val fold_until : 'a t -> 's -> f:('a -> 's -> [ `Continue of 's | `Stop of 'b ]) -> finish:('s -> 'b) -> 'b

Folds over elements of the iterator, stopping early if the accumulator returns `Stop b, and using finish to transform the final state if the end of the iterator is reached.

val drop : int -> 'a t -> 'a t

Drop the n first elements of the iterator. Lazy.

val drop_while : 'a t -> f:('a -> bool) -> 'a t

Predicate version of drop

val rev : 'a t -> 'a t

Reverse the iterator. O(n) memory and time, needs the iterator to be finite. The result is persistent and does not depend on the input being repeatable.

val zip_i : 'a t -> (int * 'a) t

Zip elements of the iterator with their index in the iterator.

  • since 1.0 Changed type to just give an iterator of pairs
val fold2 : ('a * 'b) t -> 'c -> f:('a -> 'b -> 'c -> 'c) -> 'c
val iter2 : ('a * 'b) t -> f:('a -> 'b -> unit) -> unit
val map2 : ('a * 'b) t -> f:('a -> 'b -> 'c) -> 'c t
val map2_2 : ('a * 'b) t -> f:('a -> 'b -> 'c) -> g:('a -> 'b -> 'd) -> ('c * 'd) t

map2_2 ~f ~g seq2 maps each x, y of seq2 into f x y, g x y

Data structures converters

val to_list : 'a t -> 'a list

Convert the iterator into a list. Preserves order of elements. This function is tail-recursive, but consumes 2*n memory. If order doesn't matter to you, consider to_rev_list.

val to_rev_list : 'a t -> 'a list

Get the list of the reversed iterator (more efficient than to_list)

val of_list : 'a list -> 'a t
val on_list : 'a list -> f:('a t -> 'b t) -> 'b list

on_list f l is equivalent to to_list @@ f @@ of_list l.

  • since 0.5.2
val pair_with_idx : 'a t -> (int * 'a) t

Similar to zip_i but returns a normal iterator of tuples

  • since 0.11
val to_opt : 'a t -> 'a option

Alias to head

  • since 0.5.1
val to_array : 'a t -> 'a array

Convert to an array. Currently not very efficient because an intermediate list is used.

val of_array : 'a array -> 'a t
val of_array_i : 'a array -> (int * 'a) t

Elements of the array, with their index

val array_slice : 'a array -> int -> int -> 'a t

array_slice a i j Iterator of elements whose indexes range from i to j

val of_opt : 'a option -> 'a t

Iterate on 0 or 1 values.

  • since 0.5.1
val of_seq : 'a Stdlib.Seq.t -> 'a t

Iterator of elements of a Seq.t.

  • since 1.5
val to_seq_persistent : 'a t -> 'a Stdlib.Seq.t

Convert to a Seq. Linear in memory and time (a copy is made in memory). This does not work on infinite iterators.

  • since 1.5
val to_stack : 'a Stdlib.Stack.t -> 'a t -> unit

Push elements of the iterator on the stack

val of_stack : 'a Stdlib.Stack.t -> 'a t

Iterator of elements of the stack (same order as Stack.iter)

val to_queue : 'a Stdlib.Queue.t -> 'a t -> unit

Push elements of the iterator into the queue

val of_queue : 'a Stdlib.Queue.t -> 'a t

Iterator of elements contained in the queue, FIFO order

val hashtbl_add : ('a, 'b) Stdlib.Hashtbl.t -> ('a * 'b) t -> unit

Add elements of the iterator to the hashtable, with Hashtbl.add

val hashtbl_replace : ('a, 'b) Stdlib.Hashtbl.t -> ('a * 'b) t -> unit

Add elements of the iterator to the hashtable, with Hashtbl.replace (erases conflicting bindings)

val to_hashtbl : ('a * 'b) t -> ('a, 'b) Stdlib.Hashtbl.t

Build a hashtable from an iterator of key/value pairs

val of_hashtbl : ('a, 'b) Stdlib.Hashtbl.t -> ('a * 'b) t

Iterator of key/value pairs from the hashtable

val hashtbl_keys : ('a, 'b) Stdlib.Hashtbl.t -> 'a t
val hashtbl_values : ('a, 'b) Stdlib.Hashtbl.t -> 'b t
val of_str : string -> char t
val to_str : char t -> string
val concat_str : string t -> string

Concatenate strings together, eagerly. Also see intersperse to add a separator.

  • since 0.5
exception OneShotSequence

Raised when the user tries to iterate several times on a transient iterator

val of_in_channel : Stdlib.in_channel -> char t

Iterates on characters of the input (can block when one iterates over the iterator). If you need to iterate several times on this iterator, use persistent.

  • raises OneShotIterator

    when used more than once.

val to_buffer : char t -> Stdlib.Buffer.t -> unit

Copy content of the iterator into the buffer

val int_range : start:int -> stop:int -> int t

Iterator on integers in start...stop by steps 1. Also see (--) for an infix version.

val int_range_dec : start:int -> stop:int -> int t

Iterator on decreasing integers in stop...start by steps -1. See (--^) for an infix version

val int_range_by : step:int -> start:int -> stop:int -> int t

int_range_by ~step ~start:i ~stop:j is the range starting at i, including j, where the difference between successive elements is step. use a negative step for a decreasing iterator.

  • since 0.9
  • raises Invalid_argument

    if step=0

val bools : bool t

Iterates on true and false

  • since 0.9
module type Iterable = sig ... end
val of_set : (module Iterable with type elt = 'a and type t = 'b) -> 'b -> 'a t

Convert the given set to an iterator. The set module must be provided.

module type Addable = sig ... end
val to_set : (module Addable with type elt = 'a and type t = 'b) -> 'a t -> 'b

Convert the iterator to a set, given the proper set module

type 'a gen = unit -> 'a option
val of_gen : 'a gen -> 'a t

Traverse eagerly the generator and build an iterator from it

val of_gen_once : 'a gen -> 'a t

One shot iterator using this generator. It must not be traversed twice.

  • since 1.5
val to_gen : 'a t -> 'a gen

Make the iterator persistent (O(n)) and then iterate on it. Eager.

Sets

module Set : sig ... end

Maps

module Map : sig ... end

Random iterators

val random_int : int -> int t

Infinite iterator of random integers between 0 and the given higher bound (see Random.int)

val random_bool : bool t

Infinite iterator of random bool values

val random_float : float -> float t
val random_array : 'a array -> 'a t

Iterator of choices of an element in the array

val random_list : 'a list -> 'a t

Infinite iterator of random elements of the list. Basically the same as random_array.

val shuffle : 'a t -> 'a t

shuffle seq returns a perfect shuffle of seq. Uses O(length seq) memory and time. Eager.

  • since 0.7
val shuffle_buffer : int -> 'a t -> 'a t

shuffle_buffer n seq returns an iterator of element of seq in random order. The shuffling is not uniform. Uses O(n) memory.

The first n elements of the iterator are consumed immediately. The rest is consumed lazily.

  • since 0.7

Sampling

val sample : int -> 'a t -> 'a array

sample n seq returns k samples of seq, with uniform probability. It will consume the iterator and use O(n) memory.

It returns an array of size min (length seq) n.

  • since 0.7

Infix functions

module Infix : sig ... end
include module type of Infix
val (--) : int -> int -> int t

a -- b is the range of integers from a to b, both included, in increasing order. It will therefore be empty if a > b.

val (--^) : int -> int -> int t

a --^ b is the range of integers from b to a, both included, in decreasing order (starts from a). It will therefore be empty if a < b.

val (>>=) : 'a t -> ('a -> 'b t) -> 'b t

Monadic bind (infix version of flat_map

  • since 0.5
val (>|=) : 'a t -> ('a -> 'b) -> 'b t

Infix version of map

  • since 0.5
val (<*>) : ('a -> 'b) t -> 'a t -> 'b t

Applicative operator (product+application)

  • since 0.5
val (<+>) : 'a t -> 'a t -> 'a t

Concatenation of iterators

  • since 0.5

Pretty printing

val pp_seq : ?sep:string -> (Stdlib.Format.formatter -> 'a -> unit) -> Stdlib.Format.formatter -> 'a t -> unit

Pretty print an iterator of 'a, using the given pretty printer to print each elements. An optional separator string can be provided.

val pp_buf : ?sep:string -> (Stdlib.Buffer.t -> 'a -> unit) -> Stdlib.Buffer.t -> 'a t -> unit

Print into a buffer

val to_string : ?sep:string -> ('a -> string) -> 'a t -> string

Print into a string

Basic IO

Very basic interface to manipulate files as iterator of chunks/lines. The iterators take care of opening and closing files properly; every time one iterates over an iterator, the file is opened/closed again.

Example: copy a file "a" into file "b", removing blank lines:

Iterator.(IO.lines_of "a" |> filter (fun l -> l <> "") |> IO.write_lines "b")

By chunks of 4096 bytes:

Iterator.IO.(chunks_of ~size:4096 "a" |> write_to "b")

Read the lines of a file into a list:

Iterator.IO.lines "a" |> Iterator.to_list
module IO : sig ... end