Macros 使用dbt_utils.union_关系错误,但不知道如何/为什么?

Macros 使用dbt_utils.union_关系错误,但不知道如何/为什么?,macros,union,dbt,Macros,Union,Dbt,所以我是一个新的DBT用户,超级酷的东西,但我遇到了一个关于union_relations宏的问题。我正在将关系馈送到此函数,但编译/运行查询没有从关系中找到任何列 以下是我正在运行的代码: {{dbt_utils.union_relations(relations=[ref('transform_hist_ca_map_stu_obj_assessment'), ref('transform_hist_sc_map_stu_obj_assessment')])}} ) select *

所以我是一个新的DBT用户,超级酷的东西,但我遇到了一个关于union_relations宏的问题。我正在将关系馈送到此函数,但编译/运行查询没有从关系中找到任何列

以下是我正在运行的代码:


{{dbt_utils.union_relations(relations=[ref('transform_hist_ca_map_stu_obj_assessment'), ref('transform_hist_sc_map_stu_obj_assessment')])}}


)
select *
from conformed_obj_assessment
where student_assessment_identifier is not null
and assessment_identifier is not null
and identification_code is not null
and student_unique_id is not null
and performance_level is not null
这就是我收到的错误: 第1706行或第1706行附近的语法错误:来自u_dbt__CTE__转换u hist_ca_map_stu obj_a…^在目标/运行/拉力赛/符合/符合学生目标/评估时编译SQL.SQL

基本上,第一列是DBT生成的列,之后的关系中应该有列,但由于某些原因,这些列没有被拉入。我想知道这是否是因为我想从中得到的关系目前只是昙花一现,所以没有具体化,所以我想知道这是否导致了一个问题。这里是编译后的SQL,CTE返回数据,但由于某些原因,它没有被拉入最后一个CTE



  create  table "dashboarding"."dev_em_conformed"."conformed_student_objective_assessment__dbt_tmp"
  as (
    
with  __dbt__CTE__historical_ca_map_stu_obj_assessment as (

with hist_ca_map_stu_obj_assess as (
    select * from "dashboarding"."raw_ea"."historical_ca_map_student_obj_assessment"
),
cleaned as (
    select distinct
        source_org,
        assessment_id as assessment_identifier,
        student_assessment_identifier,
        student_unique_id,
        performance_levels  as performance_level,
        scale_score as score,
        assessment_id,
        to_date(test_date, 'YYYY-MM-DD') as test_date,
        identification_code,
        null as parent_objective_assessment_name
    from hist_ca_map_stu_obj_assess
)
select * from cleaned
),  __dbt__CTE__transform_hist_ca_map_stu_obj_assessment as (

with hist_ca_stu_obj_assess as (
    select * from __dbt__CTE__historical_ca_map_stu_obj_assessment
),
final as(
select
    null as source_org,
    student_assessment_identifier,
    assessment_id as assessment_identifier,
    identification_code as identification_code,
    null as school_year,
    student_unique_id,
    null as student_grade_level,
    null as assessment_grade_level,
    NULL as administration_date,
    null as administration_end_date,
    null as objective_assessment_name,
    score,
    performance_level,
    parent_objective_assessment_name,
    null as parent_objective_assessment_id
from hist_ca_stu_obj_assess

)
select * from final
), __dbt__CTE__historical_sc_map_stu_obj_assessment as (

with hist_sc_map_soa as (
    select * from "dashboarding"."raw_ea"."historical_sc_map_student_obj_assessment"
),
cleaned as (
    select distinct
        source_org,
        assessment_id as assessment_identifier,
        student_assessment_identifier,
        student_unique_id,
        performance_levels as performance_level,
        scale_score as score,
        assessment_id,
        to_date(test_date, 'YYYY-MM-DD') as test_date,
        identification_code,
        null as parent_objective_assessment_name
    from hist_sc_map_soa
)
select * from cleaned
),  __dbt__CTE__transform_hist_sc_map_stu_obj_assessment as (

with hist_sc_stu_obj_assess as (
    select * from __dbt__CTE__historical_sc_map_stu_obj_assessment
),
final as(
select
    null as source_org,
    student_assessment_identifier,
    assessment_id as assessment_identifier,
    identification_code as identification_code,
    null as school_year,
    student_unique_id,
    null as student_grade_level,
    null as assessment_grade_level,
    NULL as administration_date,
    null as administration_end_date,
    null as objective_assessment_name,
    score,
    performance_level,
    parent_objective_assessment_name,
    null as parent_objective_assessment_id
from hist_sc_stu_obj_assess

)
select * from final
),  conformed_obj_assessment as(



        (
            select

                cast('__dbt__CTE__transform_hist_ca_map_stu_obj_assessment' as 
    varchar
) as _dbt_source_relation,
                ---NO MORE COLUMNS???

            from __dbt__CTE__transform_hist_ca_map_stu_obj_assessment
        )

        union all
        

        (
            select

                cast('__dbt__CTE__transform_hist_sc_map_stu_obj_assessment' as 
    varchar
) as _dbt_source_relation,
                 ---NO MORE COLUMNS??

            from __dbt__CTE__transform_hist_sc_map_stu_obj_assessment
        )

        


)
select *
from conformed_obj_assessment
where student_assessment_identifier is not null
and assessment_identifier is not null
and identification_code is not null
and student_unique_id is not null
and performance_level is not null

  );
任何想法都将不胜感激,谢谢

union_relations宏依赖于了解存储在信息架构中的关系表/视图中的列。由于此模型是短暂的,因此信息模式中没有任何记录,这就是为什么会有这样的SQL:

选择 将“dbt、CTE、转换、历史、地图、目标评估”转换为 瓦尔查尔 作为(dbt)源(source)关系,, 从dbt、CTE、变换、历史、地图、目标评估 我注意到您使用的是一个稍旧的dbt utils版本——虽然我们还没有解决这个问题,但我们已经在v0.5.0中发布了

更新版本的dbt utils将有助于您了解以下信息:

Compilation Error in model test_ephemeral (models/test_ephemeral.sql)

  The `union_relations` macro cannot be used with ephemeral models, as it relies on the information schema.

  `__dbt__CTE__my_ephemeral` is an ephemeral model. Consider making is a view or table instead.` is an ephemeral model. Consider making is a view or table instead.

因此,正如新的错误消息所表明的,唯一的解决方法是将上游模型设置为视图或表。

您可以共享packages.yml文件内容吗?这将有助于告诉我答案!我也这么想,但很高兴得到确认,我没有错误地思考这个问题。谢谢你的帮助!