Azure data factory 数据工厂服务主体的ACL验证失败,尽管它具有rwx权限

Azure data factory 数据工厂服务主体的ACL验证失败,尽管它具有rwx权限,azure-data-factory,azure-data-lake,u-sql,azure-data-factory-2,Azure Data Factory,Azure Data Lake,U Sql,Azure Data Factory 2,我有一个U-SQL脚本,它使用我的个人凭据从VS代码成功执行,但从数据工厂管道触发时失败。我的个人帐户拥有Azure订阅的所有者权限。ADF通过Data Lake Analytics&Store使用服务主体身份验证 我正在使用Data Factory V2和Data Lake Gen1以及默认的集成运行时。ADLA防火墙已禁用 U-SQL脚本非常简单,它只从CSV文件中读取数据,然后尝试将其写入另一个CSV文件中。以下是整个脚本: @companies = EXTRACT

我有一个U-SQL脚本,它使用我的个人凭据从VS代码成功执行,但从数据工厂管道触发时失败。我的个人帐户拥有Azure订阅的所有者权限。ADF通过Data Lake Analytics&Store使用服务主体身份验证

我正在使用Data Factory V2和Data Lake Gen1以及默认的集成运行时。ADLA防火墙已禁用

U-SQL脚本非常简单,它只从CSV文件中读取数据,然后尝试将其写入另一个CSV文件中。以下是整个脚本:

@companies = 
    EXTRACT
        Id string,
        Name string
    FROM @InputFile
    USING Extractors.Csv(skipFirstNRows: 1);

OUTPUT @companies
    TO @OutputFile
    USING Outputters.Csv(outputHeader: true);
参数InputFile和OutputFile包含到输入和输出数据的ADL路径。这些参数是从数据工厂传递的。脚本的第一阶段(“提取”)成功执行,图中显示错误发生在“PodAggregate”阶段。如果尝试将输出写入托管表而不是CSV文件,则会发生类似错误

Data Factory中的高级错误消息为:

错误Id:VertexFailedFast,错误消息:Vertex因fail fast错误而失败

Data Lake Analytics提供了更详细的错误:

E_STORE_USER_错误:在读取或写入数据时报告了用户错误

组件:存储

描述:操作“Open::Wait”返回错误代码-2096559454“禁止”。ACL验证失败。资源不存在或用户无权执行请求的操作。“for stream”adl://[myadl].azuredatalakestore.net/adla/tmp/8a1495dc-8d80-44b9-a724-f2a0a963b3c8/stack_test/companys.csv---6F21F973-45B9-46C7-805F-192672C99393-9_0_1.dtf%23N”

详情:

流名称'adl://[myadl].azuredatalakestore.net/adla/tmp/8a1495dc-8d80-44b9-a724-f2a0a963b3c8/stack_test/companys.csv---6F21F973-45B9-46C7-805F-192672C99393-9_0_1.dtf%23N'

2018年7月19日星期四02:35:42:存储用户错误,操作:[打开::等待],错误资源不存在或当前用户无权执行请求的操作 7ffd8c4195b7范围引擎!?ToStringInternal@KeySampleCollection@SSLibV3@ScopeEngine@@AEAA?AV?$basic_string@DU?$char_traits@D@性病病毒$allocator@D@2@@std@@XZ+11b7
7ffd8c39a96d范围引擎!??0ExceptionWithStack@ScopeEngine@@QEAA@W4ErrorNumber@1@AEBV?初始化器_list@VScopeErrorArg@ScopeCommon@@@std@@_N@Z+13d 7ffd8c3abe3e范围引擎!??0DeviceException@ScopeEngine@@QEAA@AEAVBlockDevice@1@AEBV?$basic_string@DU?$char_traits@D@性病病毒$allocator@D@2@@std@@J@Z+1de
7ffd8c3f8c7b范围引擎!?GetTotalIoWaitTime@Statistics@Scanner@ScopeEngine@@QEAA_JXZ+133b 7ffd8c3f87dc示波器发动机!?GetTotalIoWaitTime@Statistics@Scanner@ScopeEngine@@QEAA_JXZ+e9c
7ffd9157780dScopeCodeGenEngine!ScopeEngine::CosmosOutput::IssueWritePage+4d d:\data\yarnnm\local\usercache\f675bad0-3d48-4f08-9933-d7cb614ec7a8\appcache\application\U 1531519980045\U 88416\container\U e194\U 1531519980045\U 88416\U 01\U000001\wd\scopeio.h行:6063 7ffd9156be7dScopeCodeGenEngine!ScopeEngine::TextOutputStream,ScopeEngine::CosmosOutput>::Write+2bd:\data\yarnnm\local\usercache\f675bad0-3d48-4f08-9933-d7cb614ec7a8\appcache\application\U 1531519980045\U 88416\container\U e194\U 1531519980045\U 88416\U 01\U000001\wd\scopeio.h行:7828 7ffd91579290ScopeCodeGenEngine!ScopeEngine::TextOutputPolicy::SerializeHeader+30D:\data\yarnnm\local\usercache\f675bad0-3d48-4f08-9933-d7cb614ec7a8\appcache\application\u 1531519980045\u 88416\container\u e194\u 1531519980045\u 88416\u 01\u000001\wd\uuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuu 7ffd91574ba7ScopeCodeGenEngine!ScopeEngine::Outputer,ScopeEngine::BinaryInputStream,ScopeEngine::ExecutionStats>,SV1_Extract_out0,ScopeEngine::ScopeUnionAll,ScopeEngine::BinaryInputStream,ScopeEngine::ExecutionStats>,SV1_Extract_out0,1>,SV1_Extract_out0,ScopeEngine::TextOutputPolicy,ScopeEngine::TextOutputStream,ScopeEngine::CosmoOutput>,0,ScopeEngine::ExecutionStats,ScopeEngine::DummyStatsWriter>::DoOutput+27 d:\data\yarnnm\local\usercache\f675bad0-3d48-4f08-9933-d7cb614ec7a8\appcache\application\U 1531519980045\U 88416\container\U e194\U 1531519980045\U 88416\U 01\U000001\wd\scopeoperators.h行:5713 7ffd91582258ScopeCodeGenEngine!SV2\u PodAggregate\u execute+658 d:\data\yarnnm\local\usercache\f675bad0-3d48-4f08-9933-d7cb614ec7a8\appcache\application\u 1531519980045\u 88416\container\u e194\u 1531519980045\u 88416\u 01\u000001\wd\uuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuu 7ffd8c36571d范围引擎!??1OutputFileInfo@ScopeEngine@@QEAA@XZ+60d
7ffd8c397aa0范围引擎!?RunUserCode@Vertex@ScopeEngine@@SA_N_NAEBV?$函数@$$A6AXXZ@std@@@Z+1b0
7ffd8c397a4e范围引擎!?RunUserCode@Vertex@ScopeEngine@@SA_N_NAEBV?$函数@$$A6AXXZ@std@@@Z+15e
7ffd8c397915范围引擎!?RunUserCode@Vertex@ScopeEngine@@SA_N_NAEBV?$函数@$$A6AXXZ@std@@@Z+25 7ffd8c365c7f范围引擎!??1OutputFileInfo@ScopeEngine@@QEAA@XZ+b6f
7ffd8c3950c4范围引擎!?Execute@Vertex@ScopeEngine@@SA_NAEBVVertexStartupInfo@2@PEAUVertexExecutionInfo@2@@Z+3f4 7ff731d8ae8d作用域主机!(没有名字) 7ff731d8adbd示波器主机!(没有名字) 7ffd8c4274d9范围引擎!?Execute@VertexHostBase@ScopeEngine@@IEAA_NAEAVVertexStartupInfo@2@@Z+379 7ff731d8d236范围主机!(没有名字) 7ff731d6a966示波器主机!(没有名字) 7ff731d98dac示波器主机!(没有名字) 7ffd9e4713d2内核32!BaseThreadInitThunk+22
7FFD9E54E4 ntdll!RtlUserThreadStart+34

服务主体帐户具有Data Lake Analytics的所有者权限。SP帐户还具有(默认)rwx对Data Lake Store中的/stack_test子目录及其所有文件和子目录的权限,以及对