Python Sqlalchemy-如何修复'_萨乌州';
我有一个包含20多万个json文件的文件夹。每个json对象都是一个Tweet(twitter)。我在将tweet保存到数据库时出错Python Sqlalchemy-如何修复'_萨乌州';,python,twitter,sqlalchemy,Python,Twitter,Sqlalchemy,我有一个包含20多万个json文件的文件夹。每个json对象都是一个Tweet(twitter)。我在将tweet保存到数据库时出错 #sqlalchemy_insert.py def create_new_tweet(data, new_user): """ insert new tweet into db """ #tweet tweet_id = data.get('id') language = data.get('lang', 'en'
#sqlalchemy_insert.py
def create_new_tweet(data, new_user):
"""
insert new tweet into db
"""
#tweet
tweet_id = data.get('id')
language = data.get('lang', 'en')
tweet_text = data.get('text')
in_reply_to_user = data.get('in_reply_to_user_id')
coord = check_if_it_s_null(data.get('coordinates'))
geo_location = check_if_it_s_null(data.get('geo'))
created_at = parse(data.get('created_at'))
try:
new_tweet = Tweet(id=tweet_id, tweet=tweet_text,
lang=language,created_at=created_at,
geo=geo_location, coordinates=coord,
user=new_user)
session.add(new_tweet)
except:
import ipdb; ipdb.set_trace()
session.commit()
return new_tweet
我在这行session.add(new\u tweet)
我添加了一个try
,以便能够调试,但我不知道如何将此tweet插入此数据库。插入第153条tweet后会出现此问题
如果用户存在,则创建新用户返回
查询
对象
new_user = session.query(User).filter(User.id == user_id) # it's a query
但是您需要将User
对象传递到create\u new\u tweet
你可以这样做
def create_new_user(data):
s_name = (data.get('user').get('screen_name'))
user_name = (data.get('user').get('name'))
user_id = (data.get('user').get('id'))
new_user = session.query(User).filter(User.id == user_id).first() # it's a User object
if new_user is None:
new_user = User(id=user_id, name=user_name, screen_name=s_name)
session.add(new_user)
session.commit()
#creating a profile
create_new_profile(data, new_user)
return new_user
def create_new_user(data):
s_name = (data.get('user').get('screen_name'))
user_name = (data.get('user').get('name'))
user_id = (data.get('user').get('id'))
new_user = session.query(User).filter(User.id == user_id).first() # it's a User object
if new_user is None:
new_user = User(id=user_id, name=user_name, screen_name=s_name)
session.add(new_user)
session.commit()
#creating a profile
create_new_profile(data, new_user)
return new_user