Google bigquery Bigquery查找条目所属的表
我正在清理我的生产数据集,我正在寻找一些无用的条目Google bigquery Bigquery查找条目所属的表,google-bigquery,Google Bigquery,我正在清理我的生产数据集,我正在寻找一些无用的条目 SELECT count(pid_like) FROM TABLE_DATE_RANGE(DATASET.TABLE_PRODUCTION_, DATE_ADD(CURRENT_TIMESTAMP(), -30, 'DAY'),CURRENT_TIMESTAMP()) where c1 is null and c2 is null and c3 is null and c4 is null 所以我想删除c1、c2、c3和c4为空的条目 在我对
SELECT count(pid_like) FROM TABLE_DATE_RANGE(DATASET.TABLE_PRODUCTION_, DATE_ADD(CURRENT_TIMESTAMP(), -30, 'DAY'),CURRENT_TIMESTAMP()) where c1 is null and c2 is null and c3 is null and c4 is null
所以我想删除c1、c2、c3和c4为空的条目
在我对最后30张桌子进行清洁之前:
# done for each last 30 tables
DELETE FROM DATASET.TABLE_PRODUCTION_YYYYMMDD where c1 is null and c2 is null and c2 is null and c4 is null.
但是在清理之后,一些无用的条目仍然存在,但我无法在哪个表中找到它们。尝试此操作以查找哪些表中的行为空:
#standardSQL
SELECT
_TABLE_SUFFIX AS suffix,
COUNT(*) AS null_count
FROM `DATASET.TABLE_PRODUCTION_*`
WHERE _TABLE_SUFFIX BETWEEN
FORMAT_DATE('%Y%m%d', DATE_SUB(CURRENT_DATE(), INTERVAL 30 DAY)) AND
FORMAT_DATE('%Y%m%d', CURRENT_DATE()) AND
c1 IS NULL AND
c2 IS NULL AND
c3 IS NULL AND
c4 IS NULL
GROUP BY suffix
HAVING null_count > 0
ORDER BY null_count DESC;
它将返回带有空行的后缀(日期)和计数。尝试此操作以查找哪些表具有空行:
#standardSQL
SELECT
_TABLE_SUFFIX AS suffix,
COUNT(*) AS null_count
FROM `DATASET.TABLE_PRODUCTION_*`
WHERE _TABLE_SUFFIX BETWEEN
FORMAT_DATE('%Y%m%d', DATE_SUB(CURRENT_DATE(), INTERVAL 30 DAY)) AND
FORMAT_DATE('%Y%m%d', CURRENT_DATE()) AND
c1 IS NULL AND
c2 IS NULL AND
c3 IS NULL AND
c4 IS NULL
GROUP BY suffix
HAVING null_count > 0
ORDER BY null_count DESC;
它将返回带有空行和计数的后缀(日期)。可能是这个。这是FORMAT_DATE,但您也可以在这里找到其他函数:可能是这个。这里是FORMAT_DATE,但您也可以在这里找到其他函数: