How to Start

To start the binary, you can run the following command:

_bin/crawlori config.json

To use crawlori as a lib, you may want to have a look at file src/crawler/unix/main.ml. To get access to the crawler's data in this case, you should provide an implementation for the following hooks as follows:

Hooks.set_operation <operation_handler> ;
Hooks.set_block <block_handler> ;
Hooks.set_main <main_handler> ;

The first one is a callback for (relevant) operations encountered by the crawler, the second one is for blocks, and the last one is used to set/unset blocks that are considered to be in the main chain.