Python 将多个YAML文件转换为CSV
我对Python非常陌生，有几个YAML文件需要转换成csv。这些是来自我们的CRM高层的笔记、评论和电子邮件。我只需要笔记和评论，不需要电子邮件。这里有几个例子 Test_Co_1.txtPython 将多个YAML文件转换为CSV,python,csv,yaml,Python,Csv,Yaml,我对Python非常陌生，有几个YAML文件需要转换成csv。这些是来自我们的CRM高层的笔记、评论和电子邮件。我只需要笔记和评论，不需要电子邮件。这里有几个例子 Test_Co_1.txt --- - ID: 273679215 Name: Test Company 1 Tags: - Sample tag 1 - Sample tag 2 - Sample tag 3 - Sample tag 4 - Contact: - - Addresses
---
- ID: 273679215
Name: Test Company 1
Tags:
- Sample tag 1
- Sample tag 2
- Sample tag 3
- Sample tag 4
- Contact:
-
- Addresses
-
- "123 W Elm Street, Anywhere, FL, 11111, United States"
-
- Phone_numbers
-
- 555-111-2222
- Background: sample text
- Note 424169327:
-
Author: Diane S.
-
Written: "May 16, 2017 19:32"
-
About: Jeff Smith
-
Body: Called 5/16/17 - Receptionist indicated Jeff was unavailable. She said they are not interested in attending any webinars hung up.
- Note 424598243:
-
Author: Jenny S.
-
Written: "May 18, 2017 15:45"
-
About: Test Company 1
-
Body: |-
email sent to TM: Pete
Pete,
Can you help us with this prospective customer to determine if he is interested?
We made some outbound calls this week, inviting dealers to the prospective dealer Summer Series webinars, with the first one being this Friday. Can you see if Jeff is interested? We do not have an email for him. Do you have that?
This is the note from earlier this week:
Called 5/16/17 - Receptionist indicated Jeff was unavailable. She said they are not interested in attending any webinars hung up.
Thanks for your help.
photo
Jenny
- Comment 424601588:
-
Author: Jenny S.
-
Written: "May 18, 2017 15:56"
-
About: Test Company 1
-
Body: |-
email back from TM: Jenny,
Yes. I will reach out to them.
Thanks!
Pete
---
- ID: 306184746
Name: Fake Company 2
Tags:
- Sample Tag 1
- Contact:
-
- Addresses
-
- "444 N Oak St, Faketon City, MI, 22222, United States"
-
- Phone_numbers
-
- 333-333-3333
- Note 473905168:
-
Author: Robin S.
-
Written: "February 20, 2018 22:19"
-
About: Fake Company 2
-
Body: "1:1 with Steven 2/27/18"
- Email 476444812:
-
Author: Aaron N.
-
Written: "March 06, 2018 16:30"
-
About: Jose Viago
-
Subject: Welcome Call
-
Body: |-
Hello Jose,
We just talked and we scheduled your welcome call. I noticed after we hung
up that time changes this weekend. Unfortunately Arizona
doesn't change time and we will now be 2 hours behind you. Are you
available on at 10:30 AM CST on Tuesday, March 13th? Otherwise I will need
to schedule at a different time.
I apologize for the error and inconvenience.
<http://fakedomain.com/>
Support Team Lead
D: xxx-xxx-xxxx | C: xxx-xxx-xxxx | F: xxx-xxx-xxxx
<mailto:noreply@fakedomain.com> noreply@fakedomain.com
<http://fakedomain.com/> Website |
<https://www.youtube.com/watch?v=xxx> Our Story
Confidentiality Disclaimer: This email may contain confidential and/or
private
information. If you received this email in error please delete and notify
sender.
- Note 476458623:
-
Author: Jamie H.
-
Written: "March 06, 2018 17:12"
-
About: Fake Company 2
-
Body: ""
- Note 476460268:
-
Author: Aaron N.
-
Written: "March 06, 2018 17:18"
-
About: Fake Company 2
-
Body: |-
Called and talked to Jose and scheduled the Welcome Call for Tuesday, March 13 at 9:30 AM. After I hung up I realized that time changes this weekend. I left him a voice mail and emailed to see if doing the appointment at 10:30 AM would be ok.
Prep for appointment: Monday, March 12 at 2:30 PM
Welcome Call: Tuesday, March 13 at 10:30 AM CST
Jose emailed back and said that 10:30 is fine.
Michael H has been scheduled
- Comment 476460532:
-
Author: Aaron N.
-
Written: "March 06, 2018 17:18"
-
About: Jose Viago
-
Body: |-
From: Jose Viago [mailto:fakecompany2@gmail.com]
Sent: Tuesday, March 6, 2018 10:01 AM
To: admin@fakecompany.com
Subject: Re: Welcome Call
Yes that is fine. Thank you!
Jose Viago
Fake Company 2
xxx-xxx-xxxx
- Note 477585004:
-
Author: Laura H.
-
Written: "March 12, 2018 23:46"
-
About: Fake Company 2
-
Body: |-
Welcome call prep complete. Roadmap & workbook have been saved to their profile in BOX, and updated per their provided information.
03/12/18 (LH)
- Note 477740716:
-
Author: Michael H.
-
Written: "March 13, 2018 16:47"
-
About: Fake Company 2
-
Body: |-
03-13-2018. Did a welcome call with Jose. Jose now has access to the box. We will have a follow up call for Dashboard roll out.
03-13-2018. Did a follow up with Jose. He now has owner and tech role to the App and Dashboard. We also reviewed Online portal and help center. (MH)
- Note 502997603:
-
Author: Laura H.
-
Written: "August 06, 2018 17:14"
-
About: Fake Company 2
-
Body: |-
Received a text from Jose letting me know there is a leak in his office, and he needs to reschedule our call today. I moved him to Thursday 08/09/18 @ 9:00AM CDT.
08/06/18 (LH)
我找到了这段代码，但我对Python了解不够，无法让它在没有语法错误的情况下正常工作。我会利用Python YAML库来帮助完成这项工作。这可以通过以下方式安装：
pip install pyyaml
import csv
import yaml
fieldnames = ['Name', 'Author', 'Written', 'About', 'Body']
with open('output.csv', 'w', newline='') as f_output:
csv_output = csv.DictWriter(f_output, fieldnames=fieldnames)
csv_output.writeheader()
for filename in ['Test_Co_1.txt', 'Test_Co_2.txt']:
with open(filename) as f_input:
data = yaml.safe_load(f_input)
name = data[0]['Name']
for entry in data:
key = next(iter(entry))
if key.startswith('Note') or key.startswith('Comment'):
row = {'Name' : name}
for d in entry[key]:
for get in ['Author', 'Written', 'About', 'Body']:
try:
row[get] = d[get]
except KeyError as e:
pass
csv_output.writerow(row)
要将此应用于所有YAML文件，我将使用对glob.glob'*.txt'的调用来替换文件名。您正在处理哪些部分？您的语法错误尝试是什么？语法错误是什么？看起来像是一个包含多个YAML文档的大文件，第二个文件是无效的YAML，它在根级别结合了列表和多行纯标量。您将无法使用YAML解析器解析它。如果这不是一个包含多个YAML文档的单一文件，那么请努力格式化，不要将其作为一个文件呈现。谢谢Martin。这非常有帮助。这将正确地将我的大多数文件转换为csv，但是我确实会在一些带有特殊字符的文件上出现一些错误。我肯定这是一个编码问题，但还没有澄清它刚刚。再次感谢您抽出时间帮助python新手。您可以尝试使用openfilename打开文件，将='utf-8'编码为f_输入：
import csv
import yaml
fieldnames = ['Name', 'Author', 'Written', 'About', 'Body']
with open('output.csv', 'w', newline='') as f_output:
csv_output = csv.DictWriter(f_output, fieldnames=fieldnames)
csv_output.writeheader()
for filename in ['Test_Co_1.txt', 'Test_Co_2.txt']:
with open(filename) as f_input:
data = yaml.safe_load(f_input)
name = data[0]['Name']
for entry in data:
key = next(iter(entry))
if key.startswith('Note') or key.startswith('Comment'):
row = {'Name' : name}
for d in entry[key]:
for get in ['Author', 'Written', 'About', 'Body']:
try:
row[get] = d[get]
except KeyError as e:
pass
csv_output.writerow(row)