Агент Kinesis не может разобрать файл
У меня есть файлы журналов (WEB1_access_log_20170913-154844.log
). Но когда я настроил агента, он не смог разобрать ни одной записи. Вот часть журнала ошибок:
2017-09-18 16:32:13.122+0000 ip-172-31-32-44 (Agent STOPPING) com.amazon.kinesis.streaming.agent.Agent [INFO] Agent: Shutting down...
2017-09-18 16:32:13.126+0000 ip-172-31-32-44 (FileTailer[fh:web-log-ingestion-stream:/tmp/WEB1*.log].MetricsEmitter STOPPING) com.amazon.kinesis.streaming.agent.tailing.FileTailer [INFO] FileTailer[fh:we$
2017-09-18 16:32:13.132+0000 ip-172-31-32-44 (Agent STOPPING) com.amazon.kinesis.streaming.agent.Agent [INFO] Agent: Shut down completed in 10 ms. Uptime: 57023 ms
2017-09-18 16:32:13.133+0000 ip-172-31-32-44 (Agent.MetricsEmitter STOPPING) com.amazon.kinesis.streaming.agent.Agent [INFO] Agent: Progress: 0 records parsed (0 bytes), and 0 records sent successfully t$
2017-09-18 16:32:15.030+0000 ip-172-31-32-44 (main) com.amazon.kinesis.streaming.agent.Agent [INFO] Reading configuration from file: /etc/aws-kinesis/agent.json
2017-09-18 16:32:15.054+0000 ip-172-31-32-44 (main) com.amazon.kinesis.streaming.agent.Agent [INFO] null: Agent will use up to 12 threads for sending data.
2017-09-18 16:32:15.142+0000 ip-172-31-32-44 (main) com.amazon.kinesis.streaming.agent.tailing.checkpoints.SQLiteFileCheckpointStore [INFO] Deleted 0 old checkpoints.
2017-09-18 16:32:15.151+0000 ip-172-31-32-44 (Agent STARTING) com.amazon.kinesis.streaming.agent.Agent [INFO] Agent: Starting up...
2017-09-18 16:32:15.156+0000 ip-172-31-32-44 (Agent STARTING) com.amazon.kinesis.streaming.agent.Agent [INFO] Agent: Starting tailer for file fh:web-log-ingestion-stream:/tmp/WEB1*.log
2017-09-18 16:32:15.174+0000 ip-172-31-32-44 (Agent STARTING) com.amazon.kinesis.streaming.agent.Agent [INFO] Agent: Startup completed in 22 ms.
Вот мой файл agent.json:
{
"cloudwatch.endpoint": "monitoring.us-east-1.amazonaws.com",
"cloudwatch.emitMetrics": true,
"firehose.endpoint": "firehose.us-east-1.amazonaws.com",
"log.level": "TRACE",
"flows": [
{
"filePattern": "/tmp/WEB1*.log",
"deliveryStream": "web-log-ingestion-stream",
"initialPosition": "START_OF_FILE"
}
]
}
Полный путь к файлу, который я хочу проанализировать: /tmp/WEB1_access_log_20170913-154844.log
и вот часть этого:
196.131.83.172 - - [13/Sep/2017:15:52:23 -0500] "GET /wp-content HTTP/1.0" 200 5035 "http://west-vaughn.org/home/" "Mozilla/5.0 (Windows CE) AppleWebKit/5352 (KHTML, like Gecko) Chrome/13.0.802.0 Safari/5352"
183.194.208.232 - - [13/Sep/2017:15:55:09 -0500] "GET /explore HTTP/1.0" 200 4971 "http://www.bell-sullivan.net/register/" "Mozilla/5.0 (X11; Linux i686; rv:1.9.7.20) Gecko/2010-09-15 04:44:44 Firefox/3.6.4"