Filebeat Error

5/31/2018 - 12:53 PM
c:\Program Files (x86)\ELK\filebeat>filebeat -e --modules=apache2 --setup -M "apache2.access.var.paths=[‪D:\EKL\examples-master\examples-master\Common Data Formats\apache_logs\apache_logs]"
2018-05-31T16:50:35.105+0530    INFO    instance/beat.go:468    Home path: [c:\Program Files (x86)\ELK\filebeat] Config path: [c:\Program Files (x86)\ELK\filebeat] Data path: [c:\Program Files (x86)\ELK\filebeat\data] Logs path: [c:\Program Files (x86)\ELK\filebeat\logs]
2018-05-31T16:50:35.106+0530    INFO    instance/beat.go:475    Beat UUID: 4f256bbb-e649-4518-a5ae-63f0e7b349c3
2018-05-31T16:50:35.106+0530    INFO    instance/beat.go:213    Setup Beat: filebeat; Version: 6.2.4
2018-05-31T16:50:35.107+0530    INFO    elasticsearch/client.go:145     Elasticsearch url: http://localhost:9200
2018-05-31T16:50:35.107+0530    INFO    pipeline/module.go:76   Beat name: HarshitWin10
2018-05-31T16:50:35.110+0530    INFO    beater/filebeat.go:62   Enabled modules/filesets: apache2 (access, error)
2018-05-31T16:50:35.111+0530    INFO    [monitoring]    log/log.go:97   Starting metrics logging every 30s
2018-05-31T16:50:35.111+0530    INFO    elasticsearch/client.go:145     Elasticsearch url: http://localhost:9200
2018-05-31T16:50:35.120+0530    INFO    elasticsearch/client.go:690     Connected to Elasticsearch version 6.2.4
2018-05-31T16:50:35.120+0530    INFO    kibana/client.go:69     Kibana url: http://localhost:5601
2018-05-31T16:51:02.457+0530    INFO    instance/beat.go:583    Kibana dashboards successfully loaded.
2018-05-31T16:51:02.457+0530    INFO    elasticsearch/client.go:145     Elasticsearch url: http://localhost:9200
2018-05-31T16:51:02.459+0530    INFO    elasticsearch/client.go:690     Connected to Elasticsearch version 6.2.4
2018-05-31T16:51:02.460+0530    WARN    fileset/modules.go:459  Xpack Machine Learning is not enabled
2018-05-31T16:51:02.463+0530    WARN    fileset/modules.go:459  Xpack Machine Learning is not enabled
2018-05-31T16:51:02.463+0530    INFO    instance/beat.go:301    filebeat start running.
2018-05-31T16:51:02.464+0530    INFO    registrar/registrar.go:110      Loading registrar data from c:\Program Files (x86)\ELK\filebeat\data\registry
2018-05-31T16:51:02.464+0530    INFO    registrar/registrar.go:121      States Loaded from registrar: 0
2018-05-31T16:51:02.464+0530    INFO    crawler/crawler.go:48   Loading Prospectors: 3
2018-05-31T16:51:02.465+0530    INFO    log/prospector.go:111   Configured paths: [c:\Program Files (x86)\ELK\filebeat\‪D:\EKL\examples-master\examples-master\Common Data Formats\apache_logs\apache_logs]
2018-05-31T16:51:02.465+0530    INFO    log/prospector.go:111   Configured paths: [C:\tools\Apache\httpd-2.*\Apache24\logs\error.log* C:\Program Files\Apache Software Foundation\Apache2.*\logs\error.log*]
2018-05-31T16:51:02.469+0530    INFO    log/prospector.go:111   Configured paths: [C:\tools\Apache\httpd-2.*\Apache24\logs\access.log* C:\Program Files\Apache Software Foundation\Apache2.*\logs\access.log*]
2018-05-31T16:51:02.469+0530    INFO    log/prospector.go:111   Configured paths: [C:\tools\Apache\httpd-2.*\Apache24\logs\error.log* C:\Program Files\Apache Software Foundation\Apache2.*\logs\error.log*]
2018-05-31T16:51:02.470+0530    INFO    crawler/crawler.go:82   Loading and starting Prospectors completed. Enabled prospectors: 2
2018-05-31T16:51:02.470+0530    INFO    cfgfile/reload.go:127   Config reloader started
2018-05-31T16:51:02.472+0530    INFO    log/prospector.go:111   Configured paths: [C:\tools\Apache\httpd-2.*\Apache24\logs\access.log* C:\Program Files\Apache Software Foundation\Apache2.*\logs\access.log*]
2018-05-31T16:51:02.473+0530    INFO    log/prospector.go:111   Configured paths: [C:\tools\Apache\httpd-2.*\Apache24\logs\error.log* C:\Program Files\Apache Software Foundation\Apache2.*\logs\error.log*]
2018-05-31T16:51:02.473+0530    INFO    cfgfile/reload.go:258   Starting 1 runners ...
2018-05-31T16:51:02.473+0530    INFO    elasticsearch/client.go:145     Elasticsearch url: http://localhost:9200
2018-05-31T16:51:02.476+0530    INFO    elasticsearch/client.go:690     Connected to Elasticsearch version 6.2.4
2018-05-31T16:51:02.494+0530    ERROR   fileset/factory.go:93   Error loading pipeline: Error loading pipeline for fileset apache2/access: This module requires the following Elasticsearch plugins: ingest-user-agent, ingest-geoip. You can install them by running the following commands on all the Elasticsearch nodes:
    sudo bin/elasticsearch-plugin install ingest-user-agent
    sudo bin/elasticsearch-plugin install ingest-geoip
2018-05-31T16:51:02.494+0530    INFO    cfgfile/reload.go:219   Loading of config files completed.
2018-05-31T16:51:05.279+0530    INFO    [monitoring]    log/log.go:124  Non-zero metrics in the last 30s        {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":109,"time":109},"total":{"ticks":218,"time":218,"value":218},"user":{"ticks":109,"time":109}},"info":{"ephemeral_id":"46791b8c-f15c-437c-b98f-f9c5754e4d51","uptime":{"ms":30048}},"memstats":{"gc_next":4194304,"memory_alloc":2292000,"memory_total":10668496,"rss":20762624}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":1,"starts":1},"reloads":1},"output":{"type":"elasticsearch"},"pipeline":{"clients":6,"events":{"active":0}}},"registrar":{"states":{"current":0}},"system":{"cpu":{"cores":4}}}}}
2018-05-31T16:51:35.113+0530    INFO    [monitoring]    log/log.go:124  Non-zero metrics in the last 30s        {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":109,"time":109},"total":{"ticks":218,"time":218,"value":218},"user":{"ticks":109,"time":109}},"info":{"ephemeral_id":"46791b8c-f15c-437c-b98f-f9c5754e4d51","uptime":{"ms":60049}},"memstats":{"gc_next":4194304,"memory_alloc":2366296,"memory_total":10742792,"rss":2314240}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":1}},"pipeline":{"clients":6,"events":{"active":0}}},"registrar":{"states":{"current":0}}}}}
2018-05-31T16:52:05.112+0530    INFO    [monitoring]    log/log.go:124  Non-zero metrics in the last 30s        {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":109,"time":109},"total":{"ticks":218,"time":218,"value":218},"user":{"ticks":109,"time":109}},"info":{"ephemeral_id":"46791b8c-f15c-437c-b98f-f9c5754e4d51","uptime":{"ms":90048}},"memstats":{"gc_next":4194304,"memory_alloc":2416104,"memory_total":10792600,"rss":-98304}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":1}},"pipeline":{"clients":6,"events":{"active":0}}},"registrar":{"states":{"current":0}}}}}
2018-05-31T16:52:35.111+0530    INFO    [monitoring]    log/log.go:124  Non-zero metrics in the last 30s        {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":109,"time":109},"total":{"ticks":218,"time":218,"value":218},"user":{"ticks":109,"time":109}},"info":{"ephemeral_id":"46791b8c-f15c-437c-b98f-f9c5754e4d51","uptime":{"ms":120048}},"m
Cacher is the code snippet organizer for pro developers

We empower you and your team to get more done, faster

Filebeat Error
