Warning: file_get_contents(/data/phpspider/zhask/data//catemap/9/google-cloud-platform/3.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Google bigquery BigQuery:无法用科学记数法保存数字_Google Bigquery_Google Cloud Platform - Fatal编程技术网

Google bigquery BigQuery:无法用科学记数法保存数字

Google bigquery BigQuery:无法用科学记数法保存数字,google-bigquery,google-cloud-platform,Google Bigquery,Google Cloud Platform,我们在UTC 22:00和5:00之间在BigQuery上保存数据时遇到问题。 该问题始于2017年2月7日午夜,至今仍在发生 在这个时间范围内,每天都有大量的插入数据的失败。 故障数量急剧减少,直到在接下来的几个小时内消失 我们插入的数据格式一整天都是相同的 这是我们在insert请求的响应中发现的“n”错误之一: {"debugInfo":"generic::invalid_argument: Cannot convert value to integer (bad value):8.316

我们在UTC 22:00和5:00之间在BigQuery上保存数据时遇到问题。 该问题始于2017年2月7日午夜,至今仍在发生

在这个时间范围内,每天都有大量的插入数据的失败。 故障数量急剧减少,直到在接下来的几个小时内消失

我们插入的数据格式一整天都是相同的

这是我们在insert请求的响应中发现的“n”错误之一:

{"debugInfo":"generic::invalid_argument: Cannot convert value to integer (bad value):8.3163161541138022e+17","location":"id","message":"Cannot convert value to integer (bad value):8.3163161541138022e+17","reason":"invalid"}
这个问题似乎与使用科学记数法的数字有关。如上所述,我们整天都在使用此类数字执行保存操作,但自2017年2月7日起,我们只在一天的时间范围内遇到问题

这是与上述错误相关的行(TableDataInsertAllRequest.Rows)的打印输出

{insertId=831631615411380224, json={in_reply_to_status_id_str=null, in_reply_to_status_id=null, created_at_timestamp=2017-02-14 22:30:02, created_a
t=Tue Feb 14 22:30:02 +0000 2017, in_reply_to_user_id_str=null, source=<a href="http://twitter.com/download/iphone" rel="nofollow">Twitter for iPhone</a>, retweeted_status={in_reply_to_status_id_str=null, in_reply_to_status_id=null, cr
eated_at=Tue Feb 14 15:56:07 +0000 2017, in_reply_to_user_id_str=null, source=<a href="http://www.keyakizaka46.com/" rel="nofollow">bot</a>, retweet_count=2.0, retweeted=false, geo=null, filter_level=low, in_reply_to_screen_name
=null, is_quote_status=false, id_str=831532483447488513, in_reply_to_user_id=null, favorite_count=25.0, id=8.3153248344748851E17, text=2017/02/15 00:48, place=null, lang=ja, favorited=fal
se, possibly_sensitive=false, coordinates=null, truncated=false, entities={urls=[{display_url=google.com/g0lSa9, indices=[31.0, 54.0], expanded_url=https://google.com/g0lSa9, url=https://twitter.com/W2Vpuwrq1F}], hashtags=[], user_mentions=[], symbol
s=[]}, contributors=null, user={utc_offset=null, friends_count=5.0, profile_image_url_https=https://pbs.twimg.com/profile_images/665843786015113217/126-R8pG_normal.jpg, listed_count=91.0, profile_background_image_url=http://abs.twimg.c
om/images/themes/theme1/bg.png, default_profile_image=false, favourites_count=0.0, description=abc, created_at=Sat Nov 14 
10:18:54 +0000 2015, is_translator=false, profile_background_image_url_https=https://abs.twimg.com/images/themes/theme1/bg.png, protected=false, screen_name=keyaki_blog, id_str=4233385392, profile_link_color=1DA1F2, id=4.233385392E9, g
eo_enabled=false, profile_background_color=C0DEED, lang=ja, profile_sidebar_border_color=C0DEED, profile_text_color=333333, verified=false, profile_image_url=http://pbs.twimg.com/profile_images/665843786015113217/126-R8pG_normal.jpg, t
ime_zone=null, url=http://www.keyakizaka46.com/mob/news/diarShw.php?site=k46o&ima=2757&cd=member, contributors_enabled=false, profile_background_tile=false, profile_banner_url=https://pbs.twimg.com/profile_banners/4233385392/1447584504
, statuses_count=22077.0, follow_request_sent=null, followers_count=11669.0, profile_use_background_image=true, default_profile=true, following=null, name=bot, location=tokyo, profile_sidebar_fill_color=DDEEF6, notifications=null}}, retweet_count=0.0, retweeted=false, geo=null, filter_level=low, in_reply_to_screen_name=null, is_quote_status=false, id_str=831631615411380224, in_reply_to_user_id=null, favorite_count=0.0, id=8.3163161541138022E+17, text=RT @keyaki_blog: 2017/02/15 00:48 https://twitter.co/W2Vpuwrq1F, place=null, lang=ja, favorited=false, possibly_sensitive=false, coordinates=null, truncated=false, timestamp_ms=1487111402739, entities={urls=[{display_url=google.com/g0lSa9, indices=[48.0, 71.0], expanded_url=https://google.com/g0lSa9, url=https://twitter.co/W2Vpuwrq1F}], hashtags=[], user_mentions=[{indices=[3.0, 15.0], screen_name=keyaki_blog, id_str=4233385392, name=bot, id=4.233385392E9}], symbols=[]}, process_instance_id=user-twitter-listener-st-1, contributors=null, user={utc_offset=-28800.0, friends_count=328.0, profile_image_url_https=https://pbs.twimg.com/profile_images/601593430666412032/PQioR336_normal.jpg, listed_count=26.0, profile_background_image_url=http://abs.twimg.com/images/themes/theme1/bg.png, default_profile_image=false, favourites_count=49710.0, description=null, created_at=Fri May 22 01:28:04 +0000 2015, is_translator=false, profile_background_image_url_https=https://abs.twimg.com/images/themes/theme1/bg.png, protected=false, screen_name=tonton_gash1, id_str=3222825788, profile_link_color=1DA1F2, id=3.222825788E9, geo_enabled=true, profile_background_color=C0DEED, lang=ja, profile_sidebar_border_color=C0DEED, profile_text_color=333333, verified=false, profile_image_url=http://pbs.twimg.com/profile_images/601593430666412032/PQioR336_normal.jpg, time_zone=Pacific Time (US & Canada), url=null, contributors_enabled=false, profile_background_tile=false, statuses_count=113901.0, follow_request_sent=null, followers_count=404.0, profile_use_background_image=true, default_profile=true, following=null, name=bb@Onlooker, location=aaa, profile_sidebar_fill_color=DDEEF6, notifications=null}}}
14/02/2017 22:30:33 [ERROR] [95] [saveBulk] [Thread: Thread-1] ERROR BigQueryDataSaver: {insertId=831631616057425921, json={quoted_status={in_reply_to_status_id_str=null, in_reply_to_status_id=null, coordinates=null, created_at=Tue Feb 14 22:17:50 +0000 2017, truncated=false, in_reply_to_user_id_str=null, source=<a href="http://twitter.com/download/iphone" rel="nofollow">Twitter for iPhone</a>, retweet_count=0.0, retweeted=false, geo=null, filter_level=low, in_reply_to_screen_name=null, is_quote_status=false, entities={urls=[], hashtags=[], user_mentions=[], symbols=[]}, id_str=831628543281025024, in_reply_to_user_id=null, favorite_count=0.0, id=8.3162854328102502E17, text=kaitlyn's baby pictures?, place=null, contributors=null, lang=en, user={utc_offset=-18000.0, friends_count=505.0, profile_image_url_https=https://pbs.twimg.com/profile_images/813191388967960577/Q6Wh4HyC_normal.jpg, listed_count=36.0, profile_background_image_url=http://pbs.twimg.com/profile_background_images/720373579259351041/mPcBv5UA.jpg, default_profile_image=false, favourites_count=48248.0, description=▽ liar, monster, snappy dresser ▽ → kaitlyn // 18 // she/her // antifa // studies history + sociology in scotland // #FreePalestine #AllBlackLivesMatter, created_at=Sun Apr 26 16:05:35 +0000 2009, is_translator=false, profile_background_image_url_https=https://pbs.twimg.com/profile_background_images/720373579259351041/mPcBv5UA.jpg, protected=false, screen_name=ghostcommie, id_str=35495052, profile_link_color=F5ABB5, id=3.5495052E7, geo_enabled=false, profile_background_color=89C9FA, lang=en, profile_sidebar_border_color=FFFFFF, profile_text_color=CE7834, verified=false, profile_image_url=http://pbs.twimg.com/profile_images/813191388967960577/Q6Wh4HyC_normal.jpg, time_zone=Quito, url=null, contributors_enabled=false, profile_background_tile=false, profile_banner_url=https://pbs.twimg.com/profile_banners/35495052/1471561647, statuses_count=59269.0, follow_request_sent=null, followers_count=836.0, profile_use_background_image=true, default_profile=false, following=null, name=a nearby galaxy, location=a few light years away, profile_sidebar_fill_color=78C0A8, notifications=null}, favorited=false}, in_reply_to_status_id_str=null, in_reply_to_status_id=null, created_at_timestamp=2017-02-14 22:30:02, created_at=Tue Feb 14 22:30:02 +0000 2017, in_reply_to_user_id_str=null, source=<a href="http://twitter.com/download/iphone" rel="nofollow">Twitter for iPhone</a>, quoted_status_id=8.3162854328102502E+17, retweet_count=0.0, retweeted=false, geo=null, filter_level=low, in_reply_to_screen_name=null, is_quote_status=true, id_str=831631616057425921, in_reply_to_user_id=null, favorite_count=0.0, id=8.3163161605742592E+17, text=The people have spoken https://twitter.co/8yPASyGyww, place=null, lang=en, favorited=false, possibly_sensitive=false, coordinates=null, truncated=false, timestamp_ms=1487111402893, entities={urls=[{display_url=twitter.com/ghostcommie/st…, indices=[23.0, 46.0], expanded_url=https://twitter.com/ghostcommie/status/831628543281025024, url=https://twitter.co/8yPASyGyww}], hashtags=[], user_mentions=[], symbols=[]}, process_instance_id=user-twitter-listener-st-1, display_text_range=[0.0, 22.0], quoted_status_id_str=831628543281025024, contributors=null, user={utc_offset=-18000.0, friends_count=505.0, profile_image_url_https=https://pbs.twimg.com/profile_images/813191388967960577/Q6Wh4HyC_normal.jpg, listed_count=36.0, profile_background_image_url=http://pbs.twimg.com/profile_background_images/720373579259351041/mPcBv5UA.jpg, default_profile_image=false, favourites_count=48248.0, description=▽ liar, monster, snappy dresser ▽ → kaitlyn // 18 // she/her // antifa // studies history + sociology in scotland // #FreePalestine #AllBlackLivesMatter, created_at=Sun Apr 26 16:05:35 +0000 2009, is_translator=false, profile_background_image_url_https=https://pbs.twimg.com/profile_background_images/720373579259351041/mPcBv5UA.jpg, protected=false, screen_name=ghostcommie, id_str=35495052, profile_link_color=F5ABB5, id=3.5495052E7, geo_enabled=false, profile_background_color=89C9FA, lang=en, profile_sidebar_border_color=FFFFFF, profile_text_color=CE7834, verified=false, profile_image_url=http://pbs.twimg.com/profile_images/813191388967960577/Q6Wh4HyC_normal.jpg, time_zone=Quito, url=null, contributors_enabled=false, profile_background_tile=false, profile_banner_url=https://pbs.twimg.com/profile_banners/35495052/1471561647, statuses_count=59270.0, follow_request_sent=null, followers_count=836.0, profile_use_background_image=true, default_profile=false, following=null, name=a nearby galaxy, location=a few light years away, profile_sidebar_fill_color=78C0A8, notifications=null}}}
{insertId=831631615411380224,json={in_reply_to_status_id_str=null,in_reply_to_status_id=null,创建时间戳=2017-02-14 22:30:02,创建
t=2017年2月14日星期二22:30:02+0000,在对用户的回复中\u id\u str=null,源=,转发的\u状态={在对状态的回复中\u id\u str=null,在对状态的回复中\u id=null,cr
2017年2月14日星期二15:56:07+0000,在回复用户时,在回复屏幕名称时,在回复用户时,源代码为空,转发次数为2.0,转发次数为假,地理位置为空,过滤级别为低
=null,是指状态为false,id为str=831532483447488513,回复用户时id为null,收藏夹计数为25.0,id=8.315324834748851e17,text=2017/02/15 00:48,place=null,lang=ja,favorited=fal
se,可能是敏感的=false,坐标=null,截断的=false,实体={url=[{display\u url=google.com/g0lSa9,索引=[31.0,54.0],扩展的\u url=https://google.com/g0lSa9,网址=https://twitter.com/W2Vpuwrq1F}],hashtags=[],用户提到=[],符号
s=[]},贡献者=null,用户={utc\u offset=null,好友数=5.0,配置文件\u图像\u url\u https=https://pbs.twimg.com/profile_images/665843786015113217/126-R8pG_normal.jpg,列出的\u计数=91.0,配置文件\u背景\u图像\u url=http://abs.twimg.c
om/images/themes/theme1/bg.png,默认配置文件\u image=false,收藏夹\u count=0.0,description=abc,在11月14日周六创建
10:18:54+0000 2015,is_translator=false,profile_background_image_url_https=https://abs.twimg.com/images/themes/theme1/bg.png,protected=false,screen\u name=keyaki\u blog,id\u str=4233385392,profile\u link\u color=1DA1F2,id=4.233385392E9,g
eo_enabled=false,profile_background_color=c0dedit,lang=ja,profile_边栏_border_color=c0dedit,profile_text_color=333333,verified=false,profile_image_url=http://pbs.twimg.com/profile_images/665843786015113217/126-R8pG_normal.jpgT
ime\u zone=null,url=http://www.keyakizaka46.com/mob/news/diarShw.php?site=k46o&ima=2757&cd=member,contributors\u enabled=false,profile\u background\u tile=false,profile\u banner\u url=https://pbs.twimg.com/profile_banners/4233385392/1447584504
,status_count=22077.0,follow_request_sent=null,followers_count=11669.0,profile_use_background_image=true,default_profile=true,follower=null,name=bot,location=tokyo,profile_侧栏_fill_color=DDEEF6,notifications=null},retweet_count=0.0,retweet=false,geo=null,filter_level=low,in_reply_to_screen_name=null,is_quote_status=false,id_str=831631615411380224,in_reply_to_user_id=null,favority_count=0.0,id=8.3163161541138022E+17,text=RT@keyaki_博客:2017/02/15 00:48https://twitter.co/W2Vpuwrq1F,place=null,lang=ja,favorited=false,可能是_-sensitive=false,坐标=null,截断=false,时间戳=1487111402739,实体={url=[{display\u url=google.com/g0lSa9,索引=[48.0,71.0],扩展的url=https://google.com/g0lSa9,网址=https://twitter.co/W2Vpuwrq1F}],hashtags=[],用户提到=[{index=[3.0,15.0],屏幕名称=keyaki_博客,id_str=4233385392,name=bot,id=4.233385392E9}],符号=[],process_instance_id=user-twitter-listener-st-1,contributors=null,user={utc_offset=-28800.0,friends_count=328.0,profile_image_url_https=https://pbs.twimg.com/profile_images/601593430666412032/PQioR336_normal.jpg,列出的\u计数=26.0,配置文件\u背景\u图像\u url=http://abs.twimg.com/images/themes/theme1/bg.png,默认配置文件图片=false,收藏夹数量=49710.0,描述=null,创建时间=Fri May 22 01:28:04+0000 2015,is_translator=false,配置文件\u背景\u图像\u url\u https=https://abs.twimg.com/images/themes/theme1/bg.png,protected=false,screen\u name=tonton\u gash1,id\u str=32222825788,profile\u link\u color=1DA1F2,id=3.222825788E9,geo\u enabled=true,profile\u background\u color=c0dect,lang=ja,profile\u侧栏\u border\u color=c0dect,profile\u text\u color=333333,verified=false,配置文件\图像\ url=http://pbs.twimg.com/profile_images/601593430666412032/PQioR336_normal.jpg,时区=太平洋时间(美国和加拿大),url=null,贡献者启用=false,配置文件\U背景\U磁贴=false,状态\U计数=113901.0,跟随请求\U发送=null,跟随者\U计数=404.0,配置文件\U使用\U背景\U图像=true,默认\U配置文件=true,跟随者=null,名称=bb@Onlooker,位置=aaa,配置文件\侧栏\填充\颜色=DDEEF6,通知=null}
2017年2月14日22:30:33[ERROR][95][saveBulk][Thread:Thread-1]ERROR BigQueryDataSaver:{insertId=8316316057425921,json={quoted_status={in_reply_to_status_id_str=null,in_reply_to_status_id=null,coordinates=null,created_at=Tue Feb 14 22:17:50+0000 2017,truncated=false,in_reply_to_user_id_str=null,source=,retweet_count=0.0,retweeted=false,geo=null,filter_level=low=low,in_to_screen_name=null,is_reply_to_screen=null,is_status=false,is_status=false,enties=[],symbols=[]},id_str=831628543281025024,in_reply_to_user_id=null,favorite_count=0.0,id=8.31628543282102502e17,text=kaitlyn's baby pictures?,place=null,contributors=null,lang=en,user={utc_offset=-18000.0,friends_count=505.0,profile_image_url_https=https://pbs.twimg.com/profile_images/813191388967960577/Q6Wh4HyC_normal.jpg,列出的\u计数=36.0,配置文件\u背景\u图像\u url=http://pbs.twimg.com/profile_background_images/720373579259351041/mPcBv5UA.jpg,默认_profile_image=false,