使用Python将JSON数据从API发送到Firestore的最佳方式
我通过API收到了带有亚马逊搜索结果的JSON数据,我正试图将其发送到我的firestore数据库。我想它是一个产品的集合,已经被搜索 这意味着;对于搜索结果中的每个职位(产品),我希望将其存储为文档。我手工制作了这个集合,以展示它的样子 我已经用下面的代码将JSON转换成可读的JSON使用Python将JSON数据从API发送到Firestore的最佳方式,python,json,python-3.x,google-cloud-firestore,Python,Json,Python 3.x,Google Cloud Firestore,我通过API收到了带有亚马逊搜索结果的JSON数据,我正试图将其发送到我的firestore数据库。我想它是一个产品的集合,已经被搜索 这意味着;对于搜索结果中的每个职位(产品),我希望将其存储为文档。我手工制作了这个集合,以展示它的样子 我已经用下面的代码将JSON转换成可读的JSON json_api = api_result.json() def convert_json_to_dict(json_api): with open(json_api) as JSON:
json_api = api_result.json()
def convert_json_to_dict(json_api):
with open(json_api) as JSON:
json_dict = json.load(JSON)
return json_dict
def convert_dict_to_df(json_api):
return pd.json_normalize(convert_json_to_dict(json_api))
这给了我以下数据,我想处理。它是元数据和前两个位置
{'request_info': {'success': True,
'credits_used': 46,
'credits_remaining': 54,
'credits_used_this_request': 1},
'request_metadata': {'created_at': '2021-02-25T10:17:35.565Z',
'processed_at': '2021-02-25T10:17:39.793Z',
'total_time_taken': 4.23,
'amazon_url': 'https://www.amazon.com/s/?k=beetle+chair&ref=nb_sb_noss_2'},
'request_parameters': {'amazon_domain': 'amazon.com',
'type': 'search',
'search_term': 'beetle chair'},
'search_results': [{'position': 1,
'title': 'CosmoLiving by Cosmopolitan Astor Dining Chair Green',
'asin': 'B07P6T73Y3',
'link': 'https://www.amazon.com/dp/B07P6T73Y3',
'categories': [{'name': 'All Departments', 'id': 'search-alias=aps'}],
'image': 'https://m.media-amazon.com/images/I/81F4zscz2OL._AC_UL320_.jpg',
'is_prime': True,
'is_amazon_fresh': False,
'is_whole_foods_market': False,
'rating': 4.1,
'ratings_total': 232,
'sponsored': False,
'prices': [{'symbol': '$',
'value': 99.99,
'currency': 'USD',
'raw': '$99.99'}],
'price': {'symbol': '$',
'value': 99.99,
'currency': 'USD',
'raw': '$99.99'},
'delivery': {'tagline': 'Get it as soon as Fri, Mar 5',
'price': {'raw': 'FREE Shipping by Amazon',
'symbol': '$',
'currency': 'USD',
'value': 0,
'is_free': True}}},
{'position': 2,
'title': 'Guyou Modern Plush Velvet Accent Chairs, Upholstered Round Back Dining Chairs Living Room Decor Set of 2 with Brass Legs (Emerald Green)',
'asin': 'B085NKFJ2Y',
'link': 'https://www.amazon.com/dp/B085NKFJ2Y',
'categories': [{'name': 'All Departments', 'id': 'search-alias=aps'}],
'image': 'https://m.media-amazon.com/images/I/51Evpn0iw-L._AC_UL320_.jpg',
'is_prime': False,
'is_amazon_fresh': False,
'is_whole_foods_market': False,
'rating': 4.5,
'ratings_total': 38,
'sponsored': False,
'prices': [{'symbol': '$',
'value': 159.83,
'currency': 'USD',
'raw': '$159.83'}],
'price': {'symbol': '$',
'value': 159.83,
'currency': 'USD',
'raw': '$159.83'},
'delivery': {'price': {'raw': 'FREE Shipping',
'symbol': '$',
'currency': 'USD',
'value': 0,
'is_free': True}}},
其目的是在数千种产品上使用它。您可以创建一个for循环,为每个
搜索结果创建一个文档,并使用asin作为文档名称
使用您的数据集,我必须修复您显示的数据集,因为它是无效的JSON,以下是用于测试的数据集:
data = {'request_info': {'success': True,
'credits_used': 46,
'credits_remaining': 54,
'credits_used_this_request': 1},
'request_metadata': {'created_at': '2021-02-25T10:17:35.565Z',
'processed_at': '2021-02-25T10:17:39.793Z',
'total_time_taken': 4.23,
'amazon_url': 'https://www.amazon.com/s/?k=beetle+chair&ref=nb_sb_noss_2'},
'request_parameters': {'amazon_domain': 'amazon.com',
'type': 'search',
'search_term': 'beetle chair'},
'search_results': [{'position': 1,
'title': 'CosmoLiving by Cosmopolitan Astor Dining Chair Green',
'asin': 'B07P6T73Y3',
'link': 'https://www.amazon.com/dp/B07P6T73Y3',
'categories': [{'name': 'All Departments', 'id': 'search-alias=aps'}],
'image': 'https://m.media-amazon.com/images/I/81F4zscz2OL._AC_UL320_.jpg',
'is_prime': True,
'is_amazon_fresh': False,
'is_whole_foods_market': False,
'rating': 4.1,
'ratings_total': 232,
'sponsored': False,
'prices': [{'symbol': '$',
'value': 99.99,
'currency': 'USD',
'raw': '$99.99'}],
'price': {'symbol': '$',
'value': 99.99,
'currency': 'USD',
'raw': '$99.99'},
'delivery': {'tagline': 'Get it as soon as Fri, Mar 5',
'price': {'raw': 'FREE Shipping by Amazon',
'symbol': '$',
'currency': 'USD',
'value': 0,
'is_free': True}}},
{'position': 2,
'title': 'Guyou Modern Plush Velvet Accent Chairs, Upholstered Round Back Dining Chairs Living Room Decor Set of 2 with Brass Legs (Emerald Green)',
'asin': 'B085NKFJ2Y',
'link': 'https://www.amazon.com/dp/B085NKFJ2Y',
'categories': [{'name': 'All Departments', 'id': 'search-alias=aps'}],
'image': 'https://m.media-amazon.com/images/I/51Evpn0iw-L._AC_UL320_.jpg',
'is_prime': False,
'is_amazon_fresh': False,
'is_whole_foods_market': False,
'rating': 4.5,
'ratings_total': 38,
'sponsored': False,
'prices': [{'symbol': '$',
'value': 159.83,
'currency': 'USD',
'raw': '$159.83'}],
'price': {'symbol': '$',
'value': 159.83,
'currency': 'USD',
'raw': '$159.83'},
'delivery': {'price': {'raw': 'FREE Shipping',
'symbol': '$',
'currency': 'USD',
'value': 0,
'is_free': True}}}]}
使用此示例,您可以执行以下操作:
import firebase_admin
from firebase_admin import credentials
from firebase_admin import firestore
# Use a service account
cred = credentials.Certificate('path/to/serviceAccount.json')
firebase_admin.initialize_app(cred)
db = firestore.client()
for result in data["search_results"]:
doc_ref = db.collection(u'amazon').document(result["asin"])
doc_ref.set(result)
这将使用asin创建一个文档,但它可以是您想要的任何其他id,甚至可以是使用db.collection(u'amazon').document(“position:+str(result[“position”]))搜索结果上的位置。
下面是如果您使用asin作为文档名时的外观。
是关于通过设置服务帐户和一些代码片段快速启动PythonFireStore的更多信息