data pre_processing

[shoaib-intro]

Hi @zbchern, @zhujiem @JinYang88 @zbchern

First of all Thanks your work looks great!

• I observed in processed folder you've structured data in json and pkl format only for HDFS logs and for this you've used load_sessions could you please tell me if this works different dataset of logs parsed by log_parser like Drain ?

• Log parser generates structured_log file which has EventTemplate, LogKey, Date, Time, Parameters etc. How can I directly used parsed logs by Drain parser to apply your models?