Airflow 启动多个并发通用任务

Airflow 启动多个并发通用任务,airflow,google-cloud-composer,Airflow,Google Cloud Composer,正在尝试在cloud composer上同时获取一些任务: arr = {} for i in xrange(3): print("i: " + str(i)) command_formatted = command_template.format(str(i)) create_training_instance = bash_operator.BashOperator( task_id='create_training_instance',

正在尝试在cloud composer上同时获取一些任务:

arr = {}
for i in xrange(3):
    print("i: " + str(i))
    command_formatted = command_template.format(str(i))
    create_training_instance = bash_operator.BashOperator(
        task_id='create_training_instance',
        bash_command=command_formatted)
    arr[i] = create_training_instance
    start_training.set_downstream(arr[i])  
获取以下错误:

损坏的DAG:[/home/aiffair/gcs/dags/scale\u simple.py]依赖关系 ,已创建\u培训\u实例 登记


您还需要参数化任务id,例如。,
task_id='create_training_instance'-->'create_training_instance-{}。格式(i)

对于单个任务,
task_id
应始终是唯一的。因此,您可以使用
create\u training\u instance\u{}.format(i)
as
task\u id