crawlserv++  [under development]
Application for crawling and analyzing textual content of websites.
AllTokens.hpp File Reference
#include "../Thread.hpp"
#include "../../../Data/Corpus.hpp"
#include "../../../Data/Data.hpp"
#include "../../../Helper/Memory.hpp"
#include "../../../Main/Database.hpp"
#include "../../../Struct/StatusSetter.hpp"
#include "../../../Struct/TextMap.hpp"
#include "../../../Struct/ThreadOptions.hpp"
#include "../../../Struct/ThreadStatus.hpp"
#include "../../../Timer/Simple.hpp"
#include <cstddef>
#include <cstdint>
#include <map>
#include <string>
#include <string_view>
#include <utility>
Include dependency graph for AllTokens.hpp:
This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes

class  crawlservpp::Module::Analyzer::Algo::AllTokens
 Counts all tokens in a corpus. More...
 

Namespaces

 crawlservpp::Module::Analyzer::Algo
 Namespace for algorithm classes.
 

Constants

constexpr auto crawlservpp::Module::Analyzer::Algo::allTokensColumns {2}
 The number of columns in the tokens table. More...
 
constexpr auto crawlservpp::Module::Analyzer::Algo::allTokensUpdateEveryDate {100U}
 Indicates after how many dates the status will be updated, if a date map is available. More...
 
constexpr auto crawlservpp::Module::Analyzer::Algo::allTokensUpdateEveryArticle {1000U}
 Indicates after how many articles the status will be updated, if no date map, but an article map is available. More...
 
constexpr auto crawlservpp::Module::Analyzer::Algo::allTokensUpdateEveryToken {10000U}
 Indicates after how many tokens the status will be updated, if no date and no article map is available. More...
 
constexpr auto crawlservpp::Module::Analyzer::Algo::allTokensUpdateEveryRow {1000U}
 Indicates after how many rows the status will be updated while saving the results to the database. More...