0.9.8.10
 All Classes Namespaces Files Functions Variables Typedefs Enumerations Enumerator Friends Macros Modules Pages
Namespaces | Functions
TokenizerTools.cc File Reference

Definitions for TokenizerTools. More...

#include <Common/Compat.h>
#include "TokenizerTools.h"
#include <Common/Logger.h>
#include <cctype>
#include <cerrno>
#include <climits>
#include <cstdlib>
#include <map>
#include <stack>
Include dependency graph for TokenizerTools.cc:

Go to the source code of this file.

Namespaces

 Hypertable
 Hypertable definitions
 
 Hypertable::ClusterDefinitionFile
 Cluster definition file translation definitions.
 
 Hypertable::ClusterDefinitionFile::TokenizerTools
 Tools to help cluster definition file tokenization.
 

Functions

bool Hypertable::ClusterDefinitionFile::TokenizerTools::is_identifier_start_character (char c)
 Checks if character is valid bash identifier start character. More...
 
bool Hypertable::ClusterDefinitionFile::TokenizerTools::is_identifier_character (char c)
 Checks if character is valid bash identifier character. More...
 
bool Hypertable::ClusterDefinitionFile::TokenizerTools::is_valid_identifier (const string &name)
 Checks if name is a valid bash identifier. More...
 
bool Hypertable::ClusterDefinitionFile::TokenizerTools::is_number (const string &str)
 Checks if string is an ASCII number. More...
 
bool Hypertable::ClusterDefinitionFile::TokenizerTools::find_token (const string &token, const char *base, const char *end, size_t *offsetp)
 Finds a string token in a block of code. More...
 
bool Hypertable::ClusterDefinitionFile::TokenizerTools::find_next_token (const char *base, size_t *offsetp, size_t *lengthp)
 Finds next bash identifier token in a block of text. More...
 
bool Hypertable::ClusterDefinitionFile::TokenizerTools::find_end_char (const char *base, const char **endp, size_t *linep=nullptr)
 Skips to end of block or quoted string in code. More...
 
bool Hypertable::ClusterDefinitionFile::TokenizerTools::skip_control_flow_statement (const char **basep)
 Skips over bash control flow statement. More...
 
size_t Hypertable::ClusterDefinitionFile::TokenizerTools::count_newlines (const char *base, const char *end)
 Counts number of newlines in text. More...
 
bool Hypertable::ClusterDefinitionFile::TokenizerTools::skip_to_newline (const char **endp)
 Skips to next newline character in text. More...
 
bool Hypertable::ClusterDefinitionFile::TokenizerTools::substitute_variables (const string &input, string &output, map< string, string > &vmap)
 Does variable sustitution in a block of text. More...
 

Detailed Description

Definitions for TokenizerTools.

This file contains type definitions for TokenizerTools, a namespace containing utility functions to assist in cluster definition file tokenization.

Definition in file TokenizerTools.cc.