elasticsearch 读取elasticsearch索引时日期格式错误,elasticsearch,pyspark,elasticsearch,Pyspark" /> elasticsearch 读取elasticsearch索引时日期格式错误,elasticsearch,pyspark,elasticsearch,Pyspark" />

elasticsearch 读取elasticsearch索引时日期格式错误

elasticsearch 读取elasticsearch索引时日期格式错误,elasticsearch,pyspark,elasticsearch,Pyspark,我正在从elactisearch索引中读取数据。我有日期格式问题1501545600000,应该是yyyy/mm/dd格式 from pyspark import SparkConf from pyspark.sql import SQLContext q ="""{ "query": { "match_all": {} } }""" es_read_conf = {

我正在从elactisearch索引中读取数据。我有日期格式问题1501545600000,应该是yyyy/mm/dd格式

from pyspark import SparkConf
from pyspark.sql import SQLContext

q ="""{
  "query": {
    "match_all": {}
  }  
}"""

es_read_conf = {
    "es.nodes" : "localhost",
    "es.port" : "9200",
    "es.resource" : "sub1",
    "es.query" : q
}

es_rdd = sc.newAPIHadoopRDD(
    inputFormatClass="org.elasticsearch.hadoop.mr.EsInputFormat",
    keyClass="org.apache.hadoop.io.NullWritable", 
    valueClass="org.elasticsearch.hadoop.mr.LinkedMapWritable", 
    conf=es_read_conf)

 df2 = [convert_ts(doc) for doc in df]
这曾经奏效;不再是因为我改变了密码

    try:
        ts_from_doc = get('Refill_Bar_End_Date_and_Time', None)

        if not ts_from_doc:
            raise ValueError('`Refill_Bar_End_Date_and_Time` not found')

        # incoming as millisec so convert to sec
        as_date = dt.fromtimestamp(
            int(ts_from_doc / 1000.0)
        ).strftime('%Y-%m-%d %H:%M:%S')

        hit['Refill_Bar_End_Date_and_Time'] = as_date

    except Exception as e:
        print(e)
        pass
我需要修改什么才能使它工作