Fatal编程技术网
  • mongodb/
  • MongoDB查询优化或提高性能

MongoDB查询优化或提高性能

mongodb

MongoDB查询优化或提高性能,mongodb,query-optimization,performance-testing,query-performance,Mongodb,Query Optimization,Performance Testing,Query Performance,我有一个5.5左右的产品集合，缺少文档，集合大小为3.3 GB，它存储产品详细信息和属性的数据。所有属性都存储为带有数据类型数组的主键。现在，我想要一个按所选类别列出的唯一属性列表 我已经在下面查询了pr。已创建为活动索引。在第一阶段，将所有文档品牌数组转换为一，然后从所有品牌数组值中获取唯一值。这个查询需要3146毫秒，这对我来说太多了。我想提高我的查询性能 在文档中，所有键都以大写字母开头，后者是属性。我想要文档示例中列出的所有属性的唯一值 我使用的是一台本地机器，它有256 GB的SSD，

我有一个5.5左右的产品集合，缺少文档，集合大小为3.3 GB，它存储产品详细信息和属性的数据。所有属性都存储为带有数据类型数组的主键。现在，我想要一个按所选类别列出的唯一属性列表

我已经在下面查询了pr。已创建为活动索引。在第一阶段，将所有文档品牌数组转换为一，然后从所有品牌数组值中获取唯一值。这个查询需要3146毫秒，这对我来说太多了。我想提高我的查询性能

在文档中，所有键都以大写字母开头，后者是属性。我想要文档示例中列出的所有属性的唯一值

我使用的是一台本地机器，它有256 GB的SSD，8 GB的RAM。 我还尝试了Mongotalas 4核、10GB空间和16GB RAM机器。这也需要同样的时间。所以，我认为这不是硬件问题

质疑

第一阶段输出

{
    "Brand": [
        ["Design Clinic"],
        ["Laitin Art"],
        ["Matrix International"],
        ["De Majo"],
        ["Verdure Wellness"],
        ["Maxmarko"],
        ["Golden"],
        ["Panseima"],
        ["Akdo"],
        ["Xiangda kitchenware"]
    ]
}
最终产量

{
    "Brand": ["12h", "5th Gallery", "A & X", "A Casa K", "A Lot Of Brasil", "A Lot of Brasil", "ACL", "ADS Lighting", "AL2", "Akdo"]
}
给我解释一下下面的数据

"executionStats" : {
                    "executionSuccess" : true,
                    "nReturned" : 525536,
                    "executionTimeMillis" : 3146,
                    "totalKeysExamined" : 525536,
                    "totalDocsExamined" : 525536,
                    "executionStages" : {
                        "stage" : "FETCH",
                        "nReturned" : 525536,
                        "executionTimeMillisEstimate" : 199,
                        "works" : 525537,
                        "advanced" : 525536,
                        "needTime" : 0,
                        "needYield" : 0,
                        "saveState" : 4143,
                        "restoreState" : 4143,
                        "isEOF" : 1,
                        "docsExamined" : 525536,
                        "alreadyHasObj" : 0,
                        "inputStage" : {
                            "stage" : "IXSCAN",
                            "nReturned" : 525536,
                            "executionTimeMillisEstimate" : 38,
                            "works" : 525537,
                            "advanced" : 525536,
                            "needTime" : 0,
                            "needYield" : 0,
                            "saveState" : 4143,
                            "restoreState" : 4143,
                            "isEOF" : 1,
                            "keyPattern" : {
                                "active" : 1
                            },
                            "indexName" : "active",
                            "isMultiKey" : false,
                            "multiKeyPaths" : {
                                "active" : [ ]
                            },
                            "isUnique" : false,
                            "isSparse" : false,
                            "isPartial" : false,
                            "indexVersion" : 2,
                            "direction" : "forward",
                            "indexBounds" : {
                                "active" : [
                                    "[\"1\", \"1\"]"
                                ]
                            },
                            "keysExamined" : 525536,
                            "seeks" : 1,
                            "dupsTested" : 0,
                            "dupsDropped" : 0
                        }
                    }
                }
我的文件设计如下

{
    "_id": "5dedda7a4f015667657654a8",
    "id": "47442",
    "name": "LTZ 19030159 60 61",
    "slug": "ltz-19030159-60-61",
    "model_number": "ltz 19030159 60 61",
    "country_of_mfg": "China",
    "description": "<p>Different elements of colors, shadows, lines and textures, recur the Modern art on the gold foiled hand torn art paper which mounted with the double solid wood frame.</p>\r\n\r\n<ul>\r\n\t<li>Material: imported American poplar frame+ glass+gold foiled hand torn art paper + MDF backboard</li>\r\n\t<li>Customization Available for Frame Material, Finish &amp; Size</li>\r\n\t<li>Sizes\r\n\t<ul>\r\n\t\t<li>L - 600 mm x W - 800 mm</li>\r\n\t\t<li>L - 700 mm&nbsp;x W - 1000 mm</li>\r\n\t\t<li>L - 800 mm x W - 1200 mm</li>\r\n\t</ul>\r\n\t</li>\r\n</ul>",
    "brand_id": "553",
    "price": "0.00",
    "primary_image_url": "https://dt4f7ywfipgvt.cloudfront.net/products_images/47442/optimized/ltz_19030159_60_61-1.jpg",
    "keywords": ["Paintings", "Painting", "picture", "canvas", "sketch", "sketches", "portrait", "drawing", "oil paint", "oil painting", "paint", "paints", "color", "colors", "colour", "depiction", "art", "art work", "decor", "decoration", "decorations", "decorates", "decorative", "indoor", "inside", "in home", "inside home", "for home", "for room", "inside room", "home", "wooden frame painting", "morden art"],
    "new": "0",
    "active": "1",
    "featured": "0",
    "featured_big_flag": "0",
    "uom": "Each",
    "created_datetime": "2019-09-03 09:22:22",
    "category_ids": "14",
    "category_processed": "1",
    "update_date": "2019-09-05 16:35:01",
    "Country": ["China"],
    "Brand": ["Laitin Art"],
    "Frame Material": ["Wood"],
    "Artwork Surface": ["Paper"],
    "Subject": ["Abstract"],
    "Orientation": ["Portrait"],
    "Color": ["Gold", "Multicolor"],
    "brand_data": {
        "id": "553",
        "vendor_id": "520",
        "vendors_brands_id": "0",
        "brand_name": "Laitin Art",
        "active": "1",
        "hide_brand_name": "0",
        "featured": "0",
        "synced": "1",
        "priority": "1"
    },
    "categories_data": [{
        "id": "9337238",
        "top_cat_id": "4",
        "name": "Paintings",
        "breadcrumb": "Rugs & Decor",
        "breadcrumb_full": "Rugs & Decor> Paintings",
        "breadcrumb_html": "<li><a href='/product-list/rugs-decor/1'>Rugs & Decor</a> </li><li> <a href='/product-list/paintings/1'>Paintings</a></li>",
        "partial_breadcrumb_html": "<li><a href='/product-list/rugs-decor/1'>Rugs & Decor</a> </li><li> Paintings</li>",
        "slug": "paintings",
        "type": "category",
        "active": "1",
        "products_count": "1195",
        "category_id": "14",
        "product_id": "47442"
    }, {
        "id": "9337239",
        "name": "Rugs & Decor",
        "breadcrumb": "Rugs & Decor",
        "breadcrumb_full": "Decor> Decor",
        "breadcrumb_html": "<li> Rugs & Decor</li>",
        "partial_breadcrumb_html": "<li> Rugs & Decor</li>",
        "slug": "rugs-decor",
        "type": "category",
        "active": "1",
        "products_count": "8379",
        "sub_cat_ids": "8,10,11,13,14,15,839,842,844,845,985,986,1742,1795,1851,1861,1867,1883,1909,1913,1930,1938,1958,1959",
        "category_id": "4",
        "product_id": "47442"
    }],
    "Brand": ["Paintings", "Rugs & Decor"],
    "images": [{
        "id": "81874",
        "product_id": "47442",
        "image_url": "https://dt4f7ywfipgvt.cloudfront.net/products_images/47442/optimized/ltz_19030159_60_61-2.jpg",
        "type": "image",
        "sort_order": "1"
    }],
    "attributes": {
        "Country": {
            "values": ["China"],
            "value_display": ["China"],
            "active": "1",
            "filterable": "1"
        },
        "Brand": {
            "values": ["Laitin Art"],
            "value_display": ["Laitin Art"],
            "active": "1",
            "filterable": "1"
        },
        "Frame Material": {
            "values": ["Wood"],
            "value_display": ["Poplar Wood"],
            "active": "1",
            "filterable": "1"
        },
        "Artwork Surface": {
            "values": ["Paper"],
            "value_display": ["Art Paper"],
            "active": "1",
            "filterable": "1"
        },
        "Style": {
            "values": ["Modern"],
            "value_display": ["Modern"],
            "active": "1",
            "filterable": "1"
        },
        "Frame Type ": {
            "values": ["Framed"],
            "value_display": ["Framed"],
            "active": "1",
            "filterable": "1"
        },
        "Subject": {
            "values": ["Abstract"],
            "value_display": ["Abstract"],
            "active": "1",
            "filterable": "1"
        },
        "Orientation": {
            "values": ["Portrait"],
            "value_display": ["Portrait"],
            "active": "1",
            "filterable": "1"
        },
        "Color": {
            "values": ["Gold", "Multicolor"],
            "value_display": ["Gold", "Multicolor"],
            "active": "1",
            "filterable": "1"
        }
    }
}

{
“_id”：“5DEDDA7A4F01566767654A8”，
“id”：“47442”，
“名称”：“LTZ 1903015960 61”，
“slug”：“ltz-19030159-60-61”，
“型号号”：“ltz 1903015960 61”，
“制造国”：“中国”，
“说明”："颜色、阴影、线条和纹理的不同元素，在镶有双实木框架的金箔手工撕碎艺术纸上重现现代艺术。
\r\n\r\n
    \r\n\t
  • 材质：进口美国杨木框架+玻璃+金箔手工撕碎艺术纸+MDF背板
    • \r\n\t
  • 可定制框架材料，饰面和尺寸
    • \r\n\t
  • 尺寸\r\n\t
      \r\n\t
    • L-600毫米x宽-800毫米
      • \r\n\t\t
    • L-700毫米x宽-1000毫米
      • \r\n\t
    • L-800毫米x宽-1200毫米
      • \r\n\t
    \r\n\t，
“品牌标识”：“553”，
“价格”：“0.00”，
“主图像\u url”：https://dt4f7ywfipgvt.cloudfront.net/products_images/47442/optimized/ltz_19030159_60_61-1.jpg",
“关键词”：[“绘画”、“绘画”、“图画”、“画布”、“素描”、“素描”、“肖像”、“素描”、“油画”、“油漆”、“颜料”、“颜色”、“颜色”、“描绘”、“艺术”、“艺术作品”、“装饰”、“装饰”、“室内”、“室内”、“室内”、“室内”、“为家”、“为房间”“室内”、“家”、“木框画”、“现代艺术”]，
“新建”：“0”，
“活动”：“1”，
“特色”：“0”，
“特色大旗”：“0”，
“计量单位”：“每个”，
“创建日期时间”：“2019-09-03 09:22:22”，
“类别识别码”：“14”，
“已处理类别”：“1”，
“更新日期”：“2019-09-05 16:35:01”，
“国家”：[“中国”]，
“品牌”：[“莱丁艺术”]，
“框架材料”：[“木材”]，
“艺术品表面”：[“纸张”]，
“主题”：[“摘要”]，
“方向”：[“纵向”]，
“颜色”：[“金色”、“多色”]，
“品牌数据”：{
“id”：“553”，
“供应商id”：“520”，
“供应商品牌标识”：“0”，
“品牌名称”：“莱丁艺术”，
“活动”：“1”，
“隐藏品牌名称”：“0”，
“特色”：“0”，
“已同步”：“1”，
“优先级”：“1”
},
“类别数据”：[{
“id”：“9337238”，
“顶级类别id”：“4”，
“名称”：“绘画”，
“面包屑”：“地毯和装饰”，
“面包屑满”：“地毯和装饰>绘画”，
“面包屑html”：“
  • ”，
“部分面包屑html”：“
  • 绘画作品”，
“鼻涕虫”：“绘画”，
“类型”：“类别”，
“活动”：“1”，
“产品数量”：“1195”，
“类别id”：“14”，
“产品标识”：“47442”
}, {
“id”：“9337239”，
“名称”：“地毯和装饰”，
“面包屑”：“地毯和装饰”，
“面包屑满了”：“装饰>装饰”，
“面包屑”：“
  • 地毯和装饰”，
“部分面包屑html”：“
  • 地毯和装饰”，
“鼻涕虫”：“地毯装饰”，
“类型”：“类别”，
“活动”：“1”，
“产品数量”：“8379”，
“子类ID”：“8,10,11,13,14,15839844284484598598617421795518511861186718831909131930193819581959”，
“类别id”：“4”，
“产品标识”：“47442”
}],
“品牌”：[“绘画”、“地毯和装饰”]，
“图像”：[{
“id”：“81874”，
“产品id”：“47442”，
“图像url”：https://dt4f7ywfipgvt.cloudfront.net/products_images/47442/optimized/ltz_19030159_60_61-2.jpg",
“类型”：“图像”，
“排序顺序”：“1”
}],
“属性”：{
“国家”：{
“价值观”：[“中国”]，
“价值显示”：[“中国”]，
“活动”：“1”，
“可过滤”：“1”
},
“品牌”：{
“价值”：[“莱丁艺术”]，
“价值展示”：[“莱丁艺术”]，
“活动”：“1”，
“可过滤”：“1”
},
“框架材料”：{
“价值”：[“木材”]，
“值显示”：[“杨木”]，
“活动”：“1”，
“可过滤”：“1”
},
“艺术品表面”：{
“价值”：[“纸张”]，
“价值展示”：[“艺术纸”]，
“活动”：“1”，
“可过滤”：“1”
},
“风格”：{
“价值观”：[“现代”]，
“价值展示”：[“现代”]，
“活动”：“1”，
“可过滤”：“1”
},
“框架类型”：{
“值”：[“框架”]，
“值显示”：[“框显”]，
“活动”：“1”，
“可过滤”：“1”
},
“主题”：{
“价值”：[“抽象”]，
“值显示”：[“摘要”]，
“活动”：“1”，
“可过滤”：“1”
},
“方向”：{
“值”：[“纵向”]，
“数值显示”：[“纵向”]，
“活动”：“1”，
“可过滤”：“1”
},
“C

    {
    "_id": "5dedda7a4f015667657654a8",
    "id": "47442",
    "name": "LTZ 19030159 60 61",
    "slug": "ltz-19030159-60-61",
    "model_number": "ltz 19030159 60 61",
    "country_of_mfg": "China",
    "description": "<p>Different elements of colors, shadows, lines and textures, recur the Modern art on the gold foiled hand torn art paper which mounted with the double solid wood frame.</p>\r\n\r\n<ul>\r\n\t<li>Material: imported American poplar frame+ glass+gold foiled hand torn art paper + MDF backboard</li>\r\n\t<li>Customization Available for Frame Material, Finish &amp; Size</li>\r\n\t<li>Sizes\r\n\t<ul>\r\n\t\t<li>L - 600 mm x W - 800 mm</li>\r\n\t\t<li>L - 700 mm&nbsp;x W - 1000 mm</li>\r\n\t\t<li>L - 800 mm x W - 1200 mm</li>\r\n\t</ul>\r\n\t</li>\r\n</ul>",
    "brand_id": "553",
    "price": "0.00",
    "primary_image_url": "https://dt4f7ywfipgvt.cloudfront.net/products_images/47442/optimized/ltz_19030159_60_61-1.jpg",
    "keywords": ["Paintings", "Painting", "picture", "canvas", "sketch", "sketches", "portrait", "drawing", "oil paint", "oil painting", "paint", "paints", "color", "colors", "colour", "depiction", "art", "art work", "decor", "decoration", "decorations", "decorates", "decorative", "indoor", "inside", "in home", "inside home", "for home", "for room", "inside room", "home", "wooden frame painting", "morden art"],
    "new": "0",
    "active": "1",
    "featured": "0",
    "featured_big_flag": "0",
    "uom": "Each",
    "created_datetime": "2019-09-03 09:22:22",
    "category_ids": "14",
    "category_processed": "1",
    "update_date": "2019-09-05 16:35:01",
    "Country": ["China"],
    "Brand": ["Laitin Art"],
    "Frame Material": ["Wood"],
    "Artwork Surface": ["Paper"],
    "Subject": ["Abstract"],
    "Orientation": ["Portrait"],
    "Color": ["Gold", "Multicolor"],
    "brand_data": {
        "id": "553",
        "vendor_id": "520",
        "vendors_brands_id": "0",
        "brand_name": "Laitin Art",
        "active": "1",
        "hide_brand_name": "0",
        "featured": "0",
        "synced": "1",
        "priority": "1"
    },
    "categories_data": [{
        "id": "9337238",
        "top_cat_id": "4",
        "name": "Paintings",
        "breadcrumb": "Rugs & Decor",
        "breadcrumb_full": "Rugs & Decor> Paintings",
        "breadcrumb_html": "<li><a href='/product-list/rugs-decor/1'>Rugs & Decor</a> </li><li> <a href='/product-list/paintings/1'>Paintings</a></li>",
        "partial_breadcrumb_html": "<li><a href='/product-list/rugs-decor/1'>Rugs & Decor</a> </li><li> Paintings</li>",
        "slug": "paintings",
        "type": "category",
        "active": "1",
        "products_count": "1195",
        "category_id": "14",
        "product_id": "47442"
    }, {
        "id": "9337239",
        "name": "Rugs & Decor",
        "breadcrumb": "Rugs & Decor",
        "breadcrumb_full": "Decor> Decor",
        "breadcrumb_html": "<li> Rugs & Decor</li>",
        "partial_breadcrumb_html": "<li> Rugs & Decor</li>",
        "slug": "rugs-decor",
        "type": "category",
        "active": "1",
        "products_count": "8379",
        "sub_cat_ids": "8,10,11,13,14,15,839,842,844,845,985,986,1742,1795,1851,1861,1867,1883,1909,1913,1930,1938,1958,1959",
        "category_id": "4",
        "product_id": "47442"
    }],
    "Brand": ["Paintings", "Rugs & Decor"],
    "images": [{
        "id": "81874",
        "product_id": "47442",
        "image_url": "https://dt4f7ywfipgvt.cloudfront.net/products_images/47442/optimized/ltz_19030159_60_61-2.jpg",
        "type": "image",
        "sort_order": "1"
    }],
    "attributes": {
        "Country": {
            "values": ["China"],
            "value_display": ["China"],
            "active": "1",
            "filterable": "1"
        },
        "Brand": {
            "values": ["Laitin Art"],
            "value_display": ["Laitin Art"],
            "active": "1",
            "filterable": "1"
        },
        "Frame Material": {
            "values": ["Wood"],
            "value_display": ["Poplar Wood"],
            "active": "1",
            "filterable": "1"
        },
        "Artwork Surface": {
            "values": ["Paper"],
            "value_display": ["Art Paper"],
            "active": "1",
            "filterable": "1"
        },
        "Style": {
            "values": ["Modern"],
            "value_display": ["Modern"],
            "active": "1",
            "filterable": "1"
        },
        "Frame Type ": {
            "values": ["Framed"],
            "value_display": ["Framed"],
            "active": "1",
            "filterable": "1"
        },
        "Subject": {
            "values": ["Abstract"],
            "value_display": ["Abstract"],
            "active": "1",
            "filterable": "1"
        },
        "Orientation": {
            "values": ["Portrait"],
            "value_display": ["Portrait"],
            "active": "1",
            "filterable": "1"
        },
        "Color": {
            "values": ["Gold", "Multicolor"],
            "value_display": ["Gold", "Multicolor"],
            "active": "1",
            "filterable": "1"
        }
    }
}