0.9.8.10
 All Classes Namespaces Files Functions Variables Typedefs Enumerations Enumerator Friends Macros Modules Pages
Public Member Functions | Protected Member Functions | Protected Attributes | List of all members
Hypertable::LoadDataSourceFileLocal Class Reference

#include <LoadDataSourceFileLocal.h>

Inheritance diagram for Hypertable::LoadDataSourceFileLocal:
Inheritance graph
[legend]
Collaboration diagram for Hypertable::LoadDataSourceFileLocal:
Collaboration graph
[legend]

Public Member Functions

 LoadDataSourceFileLocal (const std::string &fname, const std::string &header_fname, int row_uniquify_chars=0, int load_flags=0)
 
 ~LoadDataSourceFileLocal ()
 
uint64_t incr_consumed ()
 
- Public Member Functions inherited from Hypertable::LoadDataSource
 LoadDataSource (const std::string &header_fname, int row_uniquify_chars=0, int load_flags=0)
 
virtual ~LoadDataSource ()
 
bool has_timestamps ()
 
virtual bool next (KeySpec *keyp, uint8_t **valuep, uint32_t *value_lenp, bool *is_deletep, uint32_t *consumedp)
 
virtual void init (const std::vector< String > &key_columns, const std::string &timestamp_column, char field_separator)
 
int64_t get_current_lineno ()
 
unsigned long get_source_size () const
 

Protected Member Functions

void init_src ()
 
- Protected Member Functions inherited from Hypertable::LoadDataSource
bool get_next_line (String &line)
 
virtual void parse_header (const String &header, const std::vector< String > &key_columns, const std::string &timestamp_column)
 
bool should_skip (int idx, const uint32_t *masks)
 
std::string get_header ()
 
bool parse_date_format (const char *str, int64_t &timestamp)
 
bool parse_sec (const char *str, char **end_ptr, int64_t &ns)
 
bool add_row_component (int index)
 

Protected Attributes

boost::iostreams::file_source m_source
 
std::string m_fname
 
std::string m_header_fname
 
- Protected Attributes inherited from Hypertable::LoadDataSource
std::vector< ColumnInfom_column_info
 
std::vector< const char * > m_values
 
std::vector< KeyComponentInfom_key_comps
 
uint32_t * m_type_mask
 
size_t m_next_value
 
boost::iostreams::filtering_istream m_fin
 
int64_t m_cur_line
 
DynamicBuffer m_line_buffer
 
DynamicBuffer m_row_key_buffer
 
bool m_hyperformat
 
bool m_leading_timestamps
 
int m_timestamp_index
 
int64_t m_timestamp
 
size_t m_limit
 
uint64_t m_offset
 
bool m_zipped
 
FixedRandomStringGeneratorm_rsgen
 
std::string m_header_fname
 
int m_row_uniquify_chars
 
int m_load_flags
 
std::string m_first_line
 
unsigned long m_source_size
 
bool m_first_line_cached
 
char m_field_separator
 

Additional Inherited Members

- Protected Types inherited from Hypertable::LoadDataSource
enum  TypeMask { ROW_KEY = (1 << 0), TIMESTAMP = (1 << 1) }
 

Detailed Description

Definition at line 44 of file LoadDataSourceFileLocal.h.

Constructor & Destructor Documentation

LoadDataSourceFileLocal::LoadDataSourceFileLocal ( const std::string &  fname,
const std::string &  header_fname,
int  row_uniquify_chars = 0,
int  load_flags = 0 
)

Definition at line 56 of file LoadDataSourceFileLocal.cc.

Hypertable::LoadDataSourceFileLocal::~LoadDataSourceFileLocal ( )
inline

Definition at line 50 of file LoadDataSourceFileLocal.h.

Member Function Documentation

uint64_t LoadDataSourceFileLocal::incr_consumed ( )
virtual

Implements Hypertable::LoadDataSource.

Definition at line 83 of file LoadDataSourceFileLocal.cc.

void LoadDataSourceFileLocal::init_src ( )
protectedvirtual

Implements Hypertable::LoadDataSource.

Definition at line 73 of file LoadDataSourceFileLocal.cc.

Member Data Documentation

std::string Hypertable::LoadDataSourceFileLocal::m_fname
protected

Definition at line 57 of file LoadDataSourceFileLocal.h.

std::string Hypertable::LoadDataSourceFileLocal::m_header_fname
protected

Definition at line 58 of file LoadDataSourceFileLocal.h.

boost::iostreams::file_source Hypertable::LoadDataSourceFileLocal::m_source
protected

Definition at line 56 of file LoadDataSourceFileLocal.h.


The documentation for this class was generated from the following files: