|
crawlserv++
[under development]
Application for crawling and analyzing textual content of websites.
|
Configuration for parsers. More...
#include <Config.hpp>


Classes | |
| struct | Entries |
| Configuration entries for parser threads. More... | |
| class | Exception |
| Class for parser configuration exceptions. More... | |
Configuration Loader | |
| void | loadConfig (const std::string &configJson, LogQueue &warningsTo) |
| Loads a configuration. More... | |
Parsing Options | |
| enum | StringParsingOption { Default = 0, SQL, SubURL, URL, Trim } |
| Options for parsing strings. More... | |
| enum | CharParsingOption { FromNumber = 0, FromString } |
Options for parsing char's. More... | |
Configuration Parsing | |
| void | category (const std::string &category) |
| Sets the category of the subsequent configuration items to be checked for. More... | |
| void | option (const std::string &name, bool &target) |
Checks for a configuration option of type bool. More... | |
| void | option (const std::string &name, std::vector< bool > &target) |
Checks for a configuration option of type array of bool's. More... | |
| void | option (const std::string &name, char &target, CharParsingOption opt) |
Checks for a configuration option of type char. More... | |
| void | option (const std::string &name, std::vector< char > &target, CharParsingOption opt) |
Checks for a configuration option of type array of char's. More... | |
| void | option (const std::string &name, std::int16_t &target) |
| Checks for a configuration option of type 16-bit integer. More... | |
| void | option (const std::string &name, std::vector< std::int16_t > &target) |
| Checks for a configuration option of type array of 16-bit integers. More... | |
| void | option (const std::string &name, std::int32_t &target) |
| Checks for a configuration option of type 32-bit integer. More... | |
| void | option (const std::string &name, std::vector< std::int32_t > &target) |
| Checks for a configuration option of type array of 32-bit integers. More... | |
| void | option (const std::string &name, std::int64_t &target) |
| Checks for a configuration option of type 64-bit integer. More... | |
| void | option (const std::string &name, std::vector< std::int64_t > &target) |
| Checks for a configuration option of type array of 64-bit integers. More... | |
| void | option (const std::string &name, std::uint8_t &target) |
| Checks for a configuration option of type unsigned 8-bit integer. More... | |
| void | option (const std::string &name, std::vector< std::uint8_t > &target) |
| Checks for a configuration option of type array of unsigned 8-bit integers. More... | |
| void | option (const std::string &name, std::uint16_t &target) |
| Checks for a configuration option of type unsigned 16-bit integer. More... | |
| void | option (const std::string &name, std::vector< std::uint16_t > &target) |
| Checks for a configuration option of type array of unsigned 16-bit integers. More... | |
| void | option (const std::string &name, std::uint32_t &target) |
| Checks for a configuration option of type unsigned 32-bit integer. More... | |
| void | option (const std::string &name, std::vector< std::uint32_t > &target) |
| Checks for a configuration option of type array of unsigned 32-bit integers. More... | |
| void | option (const std::string &name, std::uint64_t &target) |
| Checks for a configuration option of type unsigned 64-bit integer. More... | |
| void | option (const std::string &name, std::vector< std::uint64_t > &target) |
| Checks for a configuration option of type array of unsigned 64-bit integers. More... | |
| void | option (const std::string &name, float &target) |
| Checks for a configuration option of type floating-point number. More... | |
| void | option (const std::string &name, std::vector< float > &target) |
| Checks for a configuration option of type array of floating-point numbers. More... | |
| void | option (const std::string &name, std::string &target, StringParsingOption opt=Default) |
| Checks for a configuration option of type string. More... | |
| void | option (const std::string &name, std::vector< std::string > &target, StringParsingOption opt=Default) |
| Checks for a configuration option of type array of strings. More... | |
| void | warning (const std::string &warning) |
| Adds a warning to the logging queue. More... | |
Module-specific Configuration Parsing | |
| virtual void | parseBasicOption () |
| Parses a basic option. More... | |
| virtual void | resetBase () |
| Resets basic options. More... | |
Configuration | |
| struct crawlservpp::Module::Parser::Config::Entries | config |
| Configuration of the parser. More... | |
Parser-Specific Configuration Parsing | |
| void | parseOption () override |
| Parses an parser-specific configuration option. More... | |
| void | checkOptions () override |
| Checks the parser-specific configuration options. More... | |
| void | reset () override |
| Resets the parser-specific configuration options. More... | |
Configuration for parsers.
|
protectedinherited |
|
protectedinherited |
|
inlineprotectedinherited |
Sets the category of the subsequent configuration items to be checked for.
| category | Constant reference to a string containing the name of the category. |
References crawlservpp::Struct::ConfigItem::category.
Referenced by crawlservpp::Module::Analyzer::Algo::TermsOverTime::parseAlgoOption(), crawlservpp::Module::Analyzer::Algo::Assoc::parseAlgoOption(), crawlservpp::Module::Analyzer::Algo::AssocOverTime::parseAlgoOption(), crawlservpp::Module::Analyzer::Algo::AllTokens::parseAlgoOption(), crawlservpp::Module::Analyzer::Algo::SentimentOverTime::parseAlgoOption(), crawlservpp::Module::Analyzer::Algo::TopicModelling::parseAlgoOption(), crawlservpp::Network::Config::parseBasicOption(), parseOption(), crawlservpp::Module::Analyzer::Config::parseOption(), crawlservpp::Module::Crawler::Config::parseOption(), crawlservpp::Module::Extractor::Config::parseOption(), and crawlservpp::Module::Analyzer::Algo::SentimentOverTime::resetAlgo().
|
inlineoverrideprotectedvirtual |
Checks the parser-specific configuration options.
| Module::Extractor::Config::Exception | if no target table has been specified. |
Implements crawlservpp::Module::Config.
References config, crawlservpp::Module::Parser::Config::Entries::generalResultTable, crawlservpp::Module::Parser::Config::Entries::parsingDateTimeFormats, crawlservpp::Module::Parser::Config::Entries::parsingDateTimeLocales, crawlservpp::Module::Parser::Config::Entries::parsingDateTimeQueries, crawlservpp::Module::Parser::Config::Entries::parsingDateTimeSources, crawlservpp::Module::Parser::Config::Entries::parsingFieldDateTimeFormats, crawlservpp::Module::Parser::Config::Entries::parsingFieldDateTimeLocales, crawlservpp::Module::Parser::Config::Entries::parsingFieldDelimiters, crawlservpp::Module::Parser::Config::Entries::parsingFieldIgnoreEmpty, crawlservpp::Module::Parser::Config::Entries::parsingFieldJSON, crawlservpp::Module::Parser::Config::Entries::parsingFieldNames, crawlservpp::Module::Parser::Config::Entries::parsingFieldQueries, crawlservpp::Module::Parser::Config::Entries::parsingFieldSources, crawlservpp::Module::Parser::Config::Entries::parsingFieldTidyTexts, crawlservpp::Module::Parser::Config::Entries::parsingFieldWarningsEmpty, crawlservpp::Module::Parser::Config::Entries::parsingIdQueries, crawlservpp::Module::Parser::Config::Entries::parsingIdSources, and crawlservpp::Module::Config::warning().
|
inlineinherited |
Loads a configuration.
| configJson | Constant reference to a string containing the configuration as JSON. |
| warningsTo | Reference to a queue to which warnings will be added that occur during the parsing of the configuration, also known as the "logging queue". |
| Module::Config::Exception | if the configuration JSON cannot be parsed. |
References crawlservpp::Struct::ConfigItem::category, crawlservpp::Module::Config::checkOptions(), crawlservpp::Struct::ConfigItem::name, crawlservpp::Module::Config::parseBasicOption(), crawlservpp::Helper::Json::parseRapid(), crawlservpp::Struct::ConfigItem::str(), crawlservpp::Struct::ConfigItem::value, and crawlservpp::Main::Exception::view().
Referenced by crawlservpp::Module::Analyzer::Thread::cleanUpQueries(), crawlservpp::Module::Parser::Thread::onReset(), crawlservpp::Module::Extractor::Thread::onReset(), and crawlservpp::Module::Crawler::Thread::onReset().
|
inlineprotectedinherited |
Checks for a configuration option of type bool.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a boolean variable into which the value of the configuration entry will be written if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
Referenced by crawlservpp::Module::Analyzer::Algo::Assoc::parseAlgoOption(), crawlservpp::Module::Analyzer::Algo::AssocOverTime::parseAlgoOption(), crawlservpp::Module::Analyzer::Algo::AllTokens::parseAlgoOption(), crawlservpp::Module::Analyzer::Algo::SentimentOverTime::parseAlgoOption(), crawlservpp::Module::Analyzer::Algo::TopicModelling::parseAlgoOption(), crawlservpp::Network::Config::parseBasicOption(), parseOption(), crawlservpp::Module::Analyzer::Config::parseOption(), crawlservpp::Module::Crawler::Config::parseOption(), and crawlservpp::Module::Extractor::Config::parseOption().
|
inlineprotectedinherited |
Checks for a configuration option of type array of bool's.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a vector of bool's into which the value of the configuration entry will be written if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type char.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a variable of the type char into which the value of the configuration entry will be written if it is encountered. |
| opt | Parsing options used for the configuration option. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Module::Config::FromNumber, crawlservpp::Module::Config::FromString, crawlservpp::Helper::Strings::getFirstOrEscapeChar(), crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type array of char's.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a vector of char's into which the value of the configuration entry will be written if it is encountered. |
| opt | Parsing options used for the configuration option. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Module::Config::FromNumber, crawlservpp::Module::Config::FromString, crawlservpp::Helper::Strings::getFirstOrEscapeChar(), crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type 16-bit integer.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a variable into which the value of the configuration entry will be written if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type array of 16-bit integers.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a vector into which the value of the configuration entry will be stored if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type 32-bit integer.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a variable into which the value of the configuration entry will be written if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type array of 32-bit integers.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a vector into which the value of the configuration entry will be stored if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type 64-bit integer.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a variable into which the value of the configuration entry will be written if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type array of 64-bit integers.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a vector into which the value of the configuration entry will be stored if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type unsigned 8-bit integer.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a variable into which the value of the configuration entry will be written if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type array of unsigned 8-bit integers.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a vector into which the value of the configuration entry will be stored if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type unsigned 16-bit integer.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a variable into which the value of the configuration entry will be written if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type array of unsigned 16-bit integers.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a vector into which the value of the configuration entry will be stored if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type unsigned 32-bit integer.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a variable into which the value of the configuration entry will be written if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type array of unsigned 32-bit integers.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a vector into which the value of the configuration entry will be stored if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type unsigned 64-bit integer.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a variable into which the value of the configuration entry will be written if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type array of unsigned 64-bit integers.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a vector into which the value of the configuration entry will be stored if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type floating-point number.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a variable into which the value of the configuration entry will be written if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type array of floating-point numbers.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a vector into which the value of the configuration entry will be stored if it is encountered. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Struct::ConfigItem::name, crawlservpp::Struct::ConfigItem::str(), and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type string.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a string into which the value of the configuration entry will be stored if it is encountered. |
| opt | Parsing option for the configuration entry. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Helper::Strings::checkSQLName(), crawlservpp::Module::Config::Default, crawlservpp::Struct::ConfigItem::name, crawlservpp::Module::Config::SQL, crawlservpp::Struct::ConfigItem::str(), crawlservpp::Module::Config::SubURL, crawlservpp::Helper::Strings::trim(), crawlservpp::Module::Config::Trim, crawlservpp::Module::Config::URL, and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedinherited |
Checks for a configuration option of type array of strings.
Ignores the option and adds a warning to the warnings queue, if the requested type does not match the data type in the configuration JSON.
| name | Constant reference to a string containing the name of the option to check for. |
| target | Reference to a vector into which the value of the configuration entry will be stored if it is encountered. |
| opt | Parsing option for the configuration entry. |
| Module::Config::Exception | if no category has been set. |
References crawlservpp::Helper::Strings::checkSQLName(), crawlservpp::Module::Config::Default, crawlservpp::Struct::ConfigItem::name, crawlservpp::Module::Config::SQL, crawlservpp::Struct::ConfigItem::str(), crawlservpp::Module::Config::SubURL, crawlservpp::Helper::Strings::trim(), crawlservpp::Module::Config::Trim, crawlservpp::Module::Config::URL, and crawlservpp::Struct::ConfigItem::value.
|
inlineprotectedvirtualinherited |
Parses a basic option.
Might be overridden by child classes.
Can be used by abstract classes to add additional configuration entries without being the final implementation, as in Network::Config.
Reimplemented in crawlservpp::Network::Config.
References crawlservpp::Module::Config::parseOption().
Referenced by crawlservpp::Module::Config::loadConfig().
|
inlineoverrideprotectedvirtual |
Parses an parser-specific configuration option.
Implements crawlservpp::Module::Config.
References crawlservpp::Module::Config::category(), config, crawlservpp::Module::Parser::Config::Entries::generalCacheSize, crawlservpp::Module::Parser::Config::Entries::generalDbTimeOut, crawlservpp::Module::Parser::Config::Entries::generalLogging, crawlservpp::Module::Parser::Config::Entries::generalMaxBatchSize, crawlservpp::Module::Parser::Config::Entries::generalNewestOnly, crawlservpp::Module::Parser::Config::Entries::generalParseCustom, crawlservpp::Module::Parser::Config::Entries::generalReParse, crawlservpp::Module::Parser::Config::Entries::generalResultTable, crawlservpp::Module::Parser::Config::Entries::generalSkip, crawlservpp::Module::Parser::Config::Entries::generalSleepIdle, crawlservpp::Module::Parser::Config::Entries::generalSleepMySql, crawlservpp::Module::Parser::Config::Entries::generalTiming, crawlservpp::Module::Config::option(), crawlservpp::Module::Parser::Config::Entries::parsingContentIgnoreQueries, crawlservpp::Module::Parser::Config::Entries::parsingDateTimeFormats, crawlservpp::Module::Parser::Config::Entries::parsingDateTimeLocales, crawlservpp::Module::Parser::Config::Entries::parsingDateTimeQueries, crawlservpp::Module::Parser::Config::Entries::parsingDateTimeSources, crawlservpp::Module::Parser::Config::Entries::parsingDateTimeWarningEmpty, crawlservpp::Module::Parser::Config::Entries::parsingFieldDateTimeFormats, crawlservpp::Module::Parser::Config::Entries::parsingFieldDateTimeLocales, crawlservpp::Module::Parser::Config::Entries::parsingFieldDelimiters, crawlservpp::Module::Parser::Config::Entries::parsingFieldIgnoreEmpty, crawlservpp::Module::Parser::Config::Entries::parsingFieldJSON, crawlservpp::Module::Parser::Config::Entries::parsingFieldNames, crawlservpp::Module::Parser::Config::Entries::parsingFieldQueries, crawlservpp::Module::Parser::Config::Entries::parsingFieldSources, crawlservpp::Module::Parser::Config::Entries::parsingFieldTidyTexts, crawlservpp::Module::Parser::Config::Entries::parsingFieldWarningsEmpty, crawlservpp::Module::Parser::Config::Entries::parsingIdIgnore, crawlservpp::Module::Parser::Config::Entries::parsingIdQueries, crawlservpp::Module::Parser::Config::Entries::parsingIdSources, crawlservpp::Module::Parser::Config::Entries::parsingRemoveXmlInstructions, crawlservpp::Module::Parser::Config::Entries::parsingRepairCData, crawlservpp::Module::Parser::Config::Entries::parsingRepairComments, crawlservpp::Module::Parser::Config::Entries::parsingTidyErrors, and crawlservpp::Module::Parser::Config::Entries::parsingTidyWarnings.
|
inlineoverrideprotectedvirtual |
Resets the parser-specific configuration options.
Implements crawlservpp::Module::Config.
References config.
|
inlineprotectedvirtualinherited |
Resets basic options.
Might be overridden by child classes.
Can be used by abstract classes to reset additional configuration entries without being the final implementation, as in Network::Config.
Reimplemented in crawlservpp::Network::Config.
References crawlservpp::Module::protocols, and crawlservpp::Module::Config::reset().
Referenced by crawlservpp::Module::Analyzer::Thread::onReset(), and crawlservpp::Module::Parser::Thread::onReset().
|
inlineprotectedinherited |
Adds a warning to the logging queue.
| warning | Constant reference to a string containing the warning. |
| Module::Config::Exception | if no log queue is active. |
Referenced by crawlservpp::Module::Analyzer::Algo::Assoc::checkAlgoOptions(), crawlservpp::Module::Analyzer::Algo::AssocOverTime::checkAlgoOptions(), crawlservpp::Module::Analyzer::Algo::SentimentOverTime::checkAlgoOptions(), checkOptions(), crawlservpp::Module::Analyzer::Config::checkOptions(), crawlservpp::Module::Crawler::Config::checkOptions(), crawlservpp::Module::Extractor::Config::checkOptions(), and crawlservpp::Network::Config::parseBasicOption().
| struct crawlservpp::Module::Parser::Config::Entries crawlservpp::Module::Parser::Config::config |
Configuration of the parser.
Referenced by checkOptions(), crawlservpp::Module::Parser::Thread::onReset(), crawlservpp::Module::Parser::Thread::onTick(), parseOption(), and reset().