Pyspark 带有eol错误的笔记本参数记录错误代码_Pyspark_Jupyter Notebook_Azure Synapse

Pyspark 带有eol错误的笔记本参数记录错误代码

pyspark jupyter-notebook

Pyspark 带有eol错误的笔记本参数记录错误代码,pyspark,jupyter-notebook,azure-synapse,Pyspark,Jupyter Notebook,Azure Synapse,我试图在Azure Synapse工作区中捕获笔记本中的错误日志记录。我尝试了几种方法，将活动中的字符串值作为动态内容传递。我所尝试和“学到”的： [我在抓救命稻草！]我明白了这给了我.NET Spark（C#）中的EOL错误。我怀疑如果我可以访问输入的#content部分，那么我可能能够解码它并将其写入文件因此，我的问题是如何最好地捕捉错误。我有4种类型可以传递参数（string、int、float、bool）string是我最好的选择。我通过的内容类似于： var ErrorDescr

我试图在Azure Synapse工作区中捕获笔记本中的错误日志记录。我尝试了几种方法，将活动中的字符串值作为动态内容传递。
我所尝试和“学到”的：

[我在抓救命稻草！]我明白了

这给了我.NET Spark（C#）中的EOL错误。我怀疑如果我可以访问输入的#content部分，那么我可能能够解码它并将其写入文件

因此，我的问题是如何最好地捕捉错误。我有4种类型可以传递参数（string、int、float、bool）string是我最好的选择。我通过的内容类似于：

var ErrorDescription = \"System.InvalidOperationException: Failure happened on Source side. ErrorCode=RestSourceCallFailed,Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The HttpStatusCode 400 indicates failure.\nRequest URL: https://restapp.name.provider-og.cloud/rest/v1/domain/data/SOMEMETHOD?qc=SOMEVALUE,=,134578\nResponse payload:<html>\r\n<head><title>400 Bad Request</title></head>\r\n<body>\r\n<center><h1>400 Bad Request</h1></center>\r\n</body>\r\n</html>\r\n,Source=Microsoft.DataTransfer.ClientLibrary,\n   at Submission#18.<<Initialize>>d__0.MoveNext()\n--- End of stack trace from previous location where exception was thrown ---\n   at Microsoft.CodeAnalysis.Scripting.ScriptExecutionState.RunSubmissionsAsync[TResult](ImmutableArray`1 precedingExecutors, Func`2 currentExecutor, StrongBox`1 exceptionHolderOpt, Func`2 catchExceptionOpt, CancellationToken cancellationToken)\"

ErrorDescription": {
            "value": {
                "$content-type": "application/octet-stream",
                "$content": "U3lzdGVtLkludmFsaWRPcGVyYXRpb25FeGNlcHRpb246IEZpbGUgY3JlYXRpb24KICAgYXQgU3VibWlzc2lvbiMxOC48PEluaXRpYWxpemU+PmRfXzAuTW92ZU5leHQoKQotLS0gRW5kIG9mIHN0YWNrIHRyYWNlIGZyb20gcHJldmlvdXMgbG9jYXRpb24gd2hlcmUgZXhjZXB0aW9uIHdhcyB0aHJvd24gLS0tCiAgIGF0IE1pY3Jvc29mdC5Db2RlQW5hbHlzaXMuU2NyaXB0aW5nLlNjcmlwdEV4ZWN1dGlvblN0YXRlLlJ1blN1Ym1pc3Npb25zQXN5bmNbVFJlc3VsdF0oSW1tdXRhYmxlQXJyYXlgMSBwcmVjZWRpbmdFeGVjdXRvcnMsIEZ1bmNgMiBjdXJyZW50RXhlY3V0b3IsIFN0cm9uZ0JveGAxIGV4Y2VwdGlvbkhvbGRlck9wdCwgRnVuY2AyIGNhdGNoRXhjZXB0aW9uT3B0LCBDYW5jZWxsYXRpb25Ub2tlbiBjYW5jZWxsYXRpb25Ub2tlbik="
            },
            "type": "string"
        },

var ErrorDescription = \"System.InvalidOperationException: Failure happened on Source side. ErrorCode=RestSourceCallFailed,Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The HttpStatusCode 400 indicates failure.\nRequest URL: https://restapp.name.provider-og.cloud/rest/v1/domain/data/SOMEMETHOD?qc=SOMEVALUE,=,134578\nResponse payload:<html>\r\n<head><title>400 Bad Request</title></head>\r\n<body>\r\n<center><h1>400 Bad Request</h1></center>\r\n</body>\r\n</html>\r\n,Source=Microsoft.DataTransfer.ClientLibrary,\n   at Submission#18.<<Initialize>>d__0.MoveNext()\n--- End of stack trace from previous location where exception was thrown ---\n   at Microsoft.CodeAnalysis.Scripting.ScriptExecutionState.RunSubmissionsAsync[TResult](ImmutableArray`1 precedingExecutors, Func`2 currentExecutor, StrongBox`1 exceptionHolderOpt, Func`2 catchExceptionOpt, CancellationToken cancellationToken)\"

{"message":"Job failed due to reason: Expression cannot be parsed. Details:Parameter stream  has parsing errors\nLine 18 Position 17: extraneous input ''' expecting {DECIMAL_LITERAL, HEX_LITERAL, OCT_LITERAL, BINARY_LITERAL, '-', '!', '$', '~', ':', '(', '#', '[', '@(', '[]', FLOAT_LITERAL, HEX_FLOAT_LITERAL, STRING_LITERAL, REGEX_LITERAL, 'parameters', 'functions', 'as', 'input', 'output', 'constant', 'expression', 'integer', 'short', 'long', 'double', 'float', 'decimal', 'boolean', 'timestamp', 'date', 'byte', 'binary', 'integral', 'number', 'fractional', 'any', IDENTIFIER, ANY_IDENTIFIER, META_MATCH, '$$', OPEN_INTERPOLATE}","failureType":"UserError","target":"Data flow1","errorCode":"DF-Executor-ParseError"}