Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rollup fails with: ElasticsearchParseException: failed to parse date field #33048

Closed
cawoodm opened this issue Aug 22, 2018 · 5 comments
Closed

Comments

@cawoodm
Copy link
Contributor

cawoodm commented Aug 22, 2018

ELK 6.3, Windows

We are using the RollUp API to process tomcat access logs. The logs have a "timestamp" field formatted as follows (mapping):

"timestamp": {
    "type": "date",
    "format": "date_time"
}

The Rollup fails with the following message:

ElasticsearchParseException: failed to parse date field [0] with format [date_time]

We don't have any other problems with the field timestamp (e.g. in Kibana).

Rollup Job (/accessPerformance5):

{
    "index_pattern": "access-test",
    "rollup_index": "rollup-test",
    "cron": "0 * * * * ? *",
    "page_size": 100,
    "groups":  {
      "date_histogram": {
        "field": "timestamp",
        "interval": "1d"
      },
      "terms": {
        "fields": ["category", "subcategory", "method"]
      }
    },
    "metrics": [
        {
            "field": "timeTaken",
            "metrics": ["min", "max", "avg"]
        }
    ]
}

Index:

    "mappings": {
            "doc": {
                "properties": {
                    "category": {
                        "type": "keyword"
                    },
                    "method": {
                        "type": "keyword"
                    },
                    "subcategory": {
                        "type": "keyword"
                    },
                    "timeTaken": {
                        "type": "long"
                    },
                    "timestamp": {
                        "type": "date",
                        "format": "date_time"
                    },
                    "url": {
                        "type": "text"
                    },
                    "userAgent": {
                        "type": "text"
                    }
                }
            }
        }

elasticsearch.log

@jimczi
Copy link
Contributor

jimczi commented Aug 22, 2018

Thanks @cawoodm , this is fixed by #31890 which will be part of the next release (6.4.0).

@jimczi jimczi closed this as completed Aug 22, 2018
@polyfractal
Copy link
Contributor

Thanks for the confirmation @jimczi. This was originally asked on the forums and I was thinking it was #31890, but wanted @cawoodm to post here with more details so we could check for sure.

Thanks @cawoodm for following up!

@cawoodm
Copy link
Contributor Author

cawoodm commented Aug 28, 2018

Yaaay, it works in 6.4.1!

@jimczi
Copy link
Contributor

jimczi commented Aug 28, 2018

@cawoodm did you mean 6.4.0 ?

@cawoodm
Copy link
Contributor Author

cawoodm commented Aug 28, 2018

Oh yes! 6.4.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants