|
crawlserv++
[under development]
Application for crawling and analyzing textual content of websites.
|
Namespace for the different modules run by threads. More...
Namespaces | |
| Analyzer | |
| Namespace for analyzer classes. | |
| Crawler | |
| Namespace for crawler classes. | |
| Extractor | |
| Namespace for extractor classes. | |
| Parser | |
| Namespace for parser classes. | |
Classes | |
| class | Config |
| Abstract class as base for module-specific configurations. More... | |
| class | Database |
| Class handling database access for threads. More... | |
| class | Thread |
| Abstract class providing module-independent thread functionality. More... | |
Constants | |
| constexpr std::array | protocols |
Protocols supported by the libcurl library. More... | |
| constexpr auto | sqlArg1 {1} |
| First argument in a SQL query. More... | |
| constexpr auto | sqlArg2 {2} |
| Second argument in a SQL query. More... | |
| constexpr auto | sqlArg3 {3} |
| Third argument in a SQL query. More... | |
| constexpr auto | sleepOnConnectionErrorS {10} |
| Number of seconds to sleep on connection errors. More... | |
| constexpr auto | sleepMs {800} |
| Number of milliseconds to sleep before checking whether the thread is still running. More... | |
| constexpr auto | statusPrefixInterrupted {"INTERRUPTED "sv} |
| Status message prefix for interrupted threads. More... | |
| constexpr auto | statusPrefixPaused {"PAUSED "sv} |
| Status message prefix for paused threads. More... | |
Namespace for the different modules run by threads.
|
inline |
Protocols supported by the libcurl library.
Referenced by crawlservpp::Module::Config::resetBase().
|
inline |
Number of milliseconds to sleep before checking whether the thread is still running.
Referenced by crawlservpp::Module::Thread::sleep().
|
inline |
Number of seconds to sleep on connection errors.
Referenced by crawlservpp::Module::Thread::log().
|
inline |
First argument in a SQL query.
Referenced by crawlservpp::Module::Database::setThreadLast(), crawlservpp::Module::Database::setThreadProgress(), and crawlservpp::Module::Database::setThreadStatusMessage().
|
inline |
Second argument in a SQL query.
Referenced by crawlservpp::Module::Database::setThreadLast(), crawlservpp::Module::Database::setThreadProgress(), and crawlservpp::Module::Database::setThreadStatusMessage().
|
inline |
Third argument in a SQL query.
Referenced by crawlservpp::Module::Database::setThreadLast(), crawlservpp::Module::Database::setThreadProgress(), and crawlservpp::Module::Database::setThreadStatusMessage().
|
inline |
Status message prefix for interrupted threads.
Referenced by crawlservpp::Module::Thread::Thread().
|
inline |
Status message prefix for paused threads.
Referenced by crawlservpp::Module::Thread::Thread().