Node.js 我想更改axios请求的浏览器

Node.js 我想更改axios请求的浏览器,node.js,browser,axios,Node.js,Browser,Axios,我是从某处刮来的,但theese网站知道theese来自axios。所以我想让axios扮演普通浏览器一样的角色。如何更改axios浏览器或如何制作更真实的axios。首先,我想了解我是否可以更改axios请求的浏览器。也许在标题部分,有一些参数或cookie表示浏览器,但我无法从谷歌那里找到答案。谷歌正在阻止你。。。根据搜索词和你的查询频率,如果谷歌怀疑你的客户活动不正常,它可能会拒绝你的请求。为了减少被阻止的机会,您可以发送与浏览器相同的HTTP头,模拟浏览器的TLS指纹,旋转未被过度使用的

我是从某处刮来的,但theese网站知道theese来自axios。所以我想让axios扮演普通浏览器一样的角色。如何更改axios浏览器或如何制作更真实的axios。首先,我想了解我是否可以更改axios请求的浏览器。也许在标题部分,有一些参数或cookie表示浏览器,但我无法从谷歌那里找到答案。

谷歌正在阻止你。。。根据搜索词和你的查询频率,如果谷歌怀疑你的客户活动不正常,它可能会拒绝你的请求。为了减少被阻止的机会,您可以发送与浏览器相同的HTTP头,模拟浏览器的TLS指纹,旋转未被过度使用的代理,并在请求之间随机化延迟

您需要将“用户代理”标题添加到Axios请求中。更多细节。您还可以使用代理。以下是如何添加标题:

const AXIOS\u选项={
标题:{
“用户代理”:
“Mozilla/5.0(Windows NT 10.0;Win64;x64)AppleWebKit/537.36(KHTML,类似Gecko)Chrome/74.0.3729.157 Safari/537.36”,
},
};
axios.get()https://example.com/getSomething,AXIOS_选项),然后(…);
如果你需要提出一些要求,我推荐木偶师。例如,您希望获取请求“pizza”的标题和链接。您的请求将如下所示:

const puppeter=require(“木偶演员”);
const queryup=“比萨饼”;
constquery=encodeURI(queryup);
异步函数GSearch(searchQuery){
const browser=wait puppeter.launch();
const page=wait browser.newPage();
等待page.goto(
`https://www.google.com/search?q=${searchQuery}`
);
wait wait page.waitForSelector(“.yuRUbf>a”);
const links=wait page.evaluate(函数getURL(){
返回数组.from(document.queryselectoral(.yuRUbf>a)).map((el)=>({
标题:el.querySelector(“h3”).innerText,
链接:el.getAttribute(“href”),
}));
});
等待浏览器关闭();
控制台日志(链接);
}
GSearch(查询);
输出:

[
  { title: "Austin's Pizza: Home", 
    link: 'https://austinspizza.com/' 
  },
  {
    title: "Menu - Austin's Pizza",
    link: 'https://austinspizza.com/menu/'
  },
  {
    title: 'Pinthouse Pizza | Craft Brewpub | Austin Texas',
    link: 'https://pinthousepizza.com/'
  },
  {
    title: "10721 Research Blvd Russo's, Italian Pizza Restaurant Austin ...",
    link: 'https://www.nypizzeria.com/locations/austin-arboretum-area'
  },
  {
    title: 'Pizza Veterano - Home | Facebook',
    link: 'https://www.facebook.com/Pizza.Veterano/'
  },
  {
    title: 'Southside Flying Pizza - Pizza Restaurant in TX',
    link: 'https://www.southsideflyingpizza.com/'
  },
  {
    title: 'Where to Find Pizza To-Go and Delivery in Austin - Eater Austin',
    link: 'https://austin.eater.com/maps/best-pizza-restaurants-austin-pizzerias-takeout-deliveries'
  },
  {
    title: 'Pizza Day | Healthy & Organic Pizza - Pizza Delivery - Austin ...',
    link: 'https://pizzadaytx.com/'
  },
  {
    title: 'Pizza Restaurant In Austin - Visit Our Pizzeria Today!',
    link: 'https://www.thepizzapress.com/location/austin-tx/'
  }
]
[
  {
    position: 1,
    title: "Domino's: Pizza Delivery & Carryout, Pasta, Chicken & More",
    link: "https://www.dominos.com/en/",
    displayed_link: "https://www.dominos.com › ...",
    snippet:
      "Order pizza, pasta, chicken & more online for carryout or delivery from your local Domino's restaurant. View our menu, find locations and track orders.",
    sitelinks: {
      inline: [
        {
          title: "Order Online",
          link: "https://www.dominos.com/en/pages/order/",
        },
        {
          title: "Pizza",
          link: "https://www.dominos.com/en/about-pizza/",
        },
        {
          title: "Coupons",
          link: "https://www.dominos.com/en/pages/order/coupon",
        },
        {
          title: "Menu",
          link: "https://www.dominos.com/en/pages/order/menu",
        },
      ],
    },
    cached_page_link:
      "https://webcache.googleusercontent.com/search?q=cache:snbLj6fCwk0J:https://www.dominos.com/en/+&cd=12&hl=en&ct=clnk&gl=us",
    related_pages_link:
      "https://www.google.com/search?hl=en&gl=us&q=related:https://www.dominos.com/en/+pizza&sa=X&ved=2ahUKEwieyO31pJLxAhUGKawKHWZfCS8QHzALegQIBRAQ",
  },
  {
    position: 2,
    title: "Pizza Hut: Pizza Delivery | Pizza Carryout | Coupons | Wings ...",
    link: "https://www.pizzahut.com/",
    displayed_link: "https://www.pizzahut.com",
    snippet:
      "DELIVERY & CARRYOUT LOCATIONS ARE OPEN! Order pizza online from a store near you. View our full menu, nutritional information, store locations, and ...",
    sitelinks: {
      inline: [
        {
          title: "Find a Pizza Hut",
          link: "https://www.pizzahut.com/locator",
        },
        {
          title: "Pizza",
          link: "https://locations.pizzahut.com/",
        },
        {
          title: "Contact Us",
          link: "https://www.pizzahut.com/contactus",
        },
        {
          title: "Pizza Hut Franchise",
          link: "https://franchise.pizzahut.com/",
        },
      ],
    },
    cached_page_link:
      "https://webcache.googleusercontent.com/search?q=cache:oiTvlHsuOeEJ:https://www.pizzahut.com/+&cd=13&hl=en&ct=clnk&gl=us",
    related_pages_link:
      "https://www.google.com/search?hl=en&gl=us&q=related:https://www.pizzahut.com/+pizza&sa=X&ved=2ahUKEwieyO31pJLxAhUGKawKHWZfCS8QHzAMegQIBBAP",
  },
];
或者,您可以使用SerpApi提供的。它解决验证码,旋转代理,完全模仿人类的行为。这保证了你得到用户真正看到的东西。更多信息,请查看

用法示例:

const SerpApi=require('google-search-results-nodejs');
const search=new SerpApi.GoogleSearch(“secret_api_key”);
常量参数={
引擎:“谷歌”,
问:“比萨饼”,
地点:“纽约,纽约,美国”,
谷歌域名:“google.com”,
德国劳埃德船级社:“美国”,
hl:“恩”
};
常量回调=函数(数据){
console.log(数据[“有机_结果]);
};
//将结果显示为JSON
json(参数,回调);
输出:

[
  { title: "Austin's Pizza: Home", 
    link: 'https://austinspizza.com/' 
  },
  {
    title: "Menu - Austin's Pizza",
    link: 'https://austinspizza.com/menu/'
  },
  {
    title: 'Pinthouse Pizza | Craft Brewpub | Austin Texas',
    link: 'https://pinthousepizza.com/'
  },
  {
    title: "10721 Research Blvd Russo's, Italian Pizza Restaurant Austin ...",
    link: 'https://www.nypizzeria.com/locations/austin-arboretum-area'
  },
  {
    title: 'Pizza Veterano - Home | Facebook',
    link: 'https://www.facebook.com/Pizza.Veterano/'
  },
  {
    title: 'Southside Flying Pizza - Pizza Restaurant in TX',
    link: 'https://www.southsideflyingpizza.com/'
  },
  {
    title: 'Where to Find Pizza To-Go and Delivery in Austin - Eater Austin',
    link: 'https://austin.eater.com/maps/best-pizza-restaurants-austin-pizzerias-takeout-deliveries'
  },
  {
    title: 'Pizza Day | Healthy & Organic Pizza - Pizza Delivery - Austin ...',
    link: 'https://pizzadaytx.com/'
  },
  {
    title: 'Pizza Restaurant In Austin - Visit Our Pizzeria Today!',
    link: 'https://www.thepizzapress.com/location/austin-tx/'
  }
]
[
  {
    position: 1,
    title: "Domino's: Pizza Delivery & Carryout, Pasta, Chicken & More",
    link: "https://www.dominos.com/en/",
    displayed_link: "https://www.dominos.com › ...",
    snippet:
      "Order pizza, pasta, chicken & more online for carryout or delivery from your local Domino's restaurant. View our menu, find locations and track orders.",
    sitelinks: {
      inline: [
        {
          title: "Order Online",
          link: "https://www.dominos.com/en/pages/order/",
        },
        {
          title: "Pizza",
          link: "https://www.dominos.com/en/about-pizza/",
        },
        {
          title: "Coupons",
          link: "https://www.dominos.com/en/pages/order/coupon",
        },
        {
          title: "Menu",
          link: "https://www.dominos.com/en/pages/order/menu",
        },
      ],
    },
    cached_page_link:
      "https://webcache.googleusercontent.com/search?q=cache:snbLj6fCwk0J:https://www.dominos.com/en/+&cd=12&hl=en&ct=clnk&gl=us",
    related_pages_link:
      "https://www.google.com/search?hl=en&gl=us&q=related:https://www.dominos.com/en/+pizza&sa=X&ved=2ahUKEwieyO31pJLxAhUGKawKHWZfCS8QHzALegQIBRAQ",
  },
  {
    position: 2,
    title: "Pizza Hut: Pizza Delivery | Pizza Carryout | Coupons | Wings ...",
    link: "https://www.pizzahut.com/",
    displayed_link: "https://www.pizzahut.com",
    snippet:
      "DELIVERY & CARRYOUT LOCATIONS ARE OPEN! Order pizza online from a store near you. View our full menu, nutritional information, store locations, and ...",
    sitelinks: {
      inline: [
        {
          title: "Find a Pizza Hut",
          link: "https://www.pizzahut.com/locator",
        },
        {
          title: "Pizza",
          link: "https://locations.pizzahut.com/",
        },
        {
          title: "Contact Us",
          link: "https://www.pizzahut.com/contactus",
        },
        {
          title: "Pizza Hut Franchise",
          link: "https://franchise.pizzahut.com/",
        },
      ],
    },
    cached_page_link:
      "https://webcache.googleusercontent.com/search?q=cache:oiTvlHsuOeEJ:https://www.pizzahut.com/+&cd=13&hl=en&ct=clnk&gl=us",
    related_pages_link:
      "https://www.google.com/search?hl=en&gl=us&q=related:https://www.pizzahut.com/+pizza&sa=X&ved=2ahUKEwieyO31pJLxAhUGKawKHWZfCS8QHzAMegQIBBAP",
  },
];
免责声明,我为SerpApi工作