HORNET is designed as a modular and extendable system. The core of HORNET provides common utilities and plugin loading. Through configuration, we dynamically chose which plugins to use.
Plugins must subclass hornet.plugin.Plugin.
The hornet.plugin namespace is reserved for officially supported or provided plugins. Third party plugins should utilize their own namespace in order to avoid any future name collisions with official HORNET plugins. In order to use third party plugins, you should add them to the sys.path.
HORNET has the stated goal of being fast for handling large datasets. As part of accomplishing this goal, HORNET provides a job queue to which plugins can submit tasks.