How to use deliverErrorValue method in Puppeteer

You probably would want to set a certain screen size, which any real browser has:

const puppeteer = require('puppeteer');

(async () => {
  const browser = await puppeteer.launch();
  const page = await browser.newPage();
  await page.setViewport({ width: 1366, height: 768});
  await page.goto('https://example.com', {waitUntil: 'networkidle2'});
  await page.screenshot({path: 'example.png'});

  browser.close();
})();

According to the Puppeteer Documentation:

page.title()

• returns: <Promise<string>> Returns page's title.

Shortcut for page.mainFrame().title().

Therefore, you should use page.title() for getting the title of the newly opened page.

Alternatively, you can gain a slight performance boost by using the following:

page._frameManager._mainFrame.evaluate(() => document.title)

Note: Make sure to use the await operator when calling page.title(), as the title tag must be downloaded before Puppeteer can access its content.

You probably would want to set a certain screen size, which any real browser has:

const puppeteer = require('puppeteer');

(async () => {
  const browser = await puppeteer.launch();
  const page = await browser.newPage();
  await page.setViewport({ width: 1366, height: 768});
  await page.goto('https://example.com', {waitUntil: 'networkidle2'});
  await page.screenshot({path: 'example.png'});

  browser.close();
})();

I used what was seen on blog.kowalczyk.info

const puppeteer = require("puppeteer");
const fs = require("fs");

async function run() {
  const browser = await puppeteer.launch();
  const page = await browser.newPage();
    await page.goto("https://www.google.com/", { waitUntil: "networkidle2" });
    // hacky defensive move but I don't know a better way:
    // wait a bit so that the browser finishes executing JavaScript
    await page.waitFor(1 * 1000);
    const html = await page.content();
    fs.writeFileSync("index.html", html);
    await browser.close();
}

run();

You can use mouse.click(x, y[, options]).

First get x and y.

const selector = "#elementID";

const rect = await page.evaluate((selector) => {
  const element = document.querySelector(selector);
  if (!element) return null;
  const { x, y } = element.getBoundingClientRect();
  return { x, y };
}, selector);

Then pass clickCount as an option to simulate double click.

await page.mouse.click(rect.x, rect.y, { clickCount: 2 });

Full code:

const puppeteer = require("puppeteer");

(async () => {
  const browser = await puppeteer.launch();

  const page = await browser.newPage();

  await page.goto("https://www.example.com", {
    waitUntil: "domcontentloaded",
  });

  const selector = "#elementID";

  const rect = await page.evaluate((selector) => {
    const element = document.querySelector(selector);
    if (!element) return null;
    const { x, y } = element.getBoundingClientRect();
    return { x, y };
  }, selector);

  if (rect) {
    await page.mouse.click(rect.x, rect.y, { clickCount: 2 });
  } else {
    console.error("Element Not Found");
  }

  await browser.close();
})();

Update

You can add delay between the two clicks by use delay option. The code below will click double clicks to element with 100ms delay.

await page.mouse.click(rect.x, rect.y, { clickCount: 2, delay: 100 });

You can use the contentFrame function.

const elementHandle = await page.$('.iframe-class');
const frame = await elementHandle.contentFrame();

You're using low-quality public proxies and it's only natural that they will generate network errors and/or be blocked by Google. The simplest solution here is to go for paid ones.

But it's also possible to intercept the error and repeat request if page.open failed:

const collectData = async (page) => {
  try {
    await page.goto('https://www.google.com/search?q=concerts+near+new+york');
    return page.evaluate(() => document.title);
  } catch (err) {
    console.error(err.message);
    return false;
  }
}

let data = false;
let attempts = 0;

// Retry request until it gets data or tries 5 times
while(data === false && attempts < 5)
{
  data = await collectData(page);
  attempts += 1;  
  if (data === false) {
    // Wait a few seconds, also a good idea to swap proxy here*
    await new Promise((resolve) => setTimeout(resolve, 3000));
  }
}

* Modules for changing proxies programmatically:

• https://www.npmjs.com/package/puppeteer-page-proxy
• https://www.npmjs.com/package/proxy-chain

elements can't be returned using page.evaluate as they're not serializable. Use page.evaluateHandle instead.

From the docs

The only difference between page.evaluate and page.evaluateHandle is that page.evaluateHandle returns in-page object (JSHandle)

example:

Here the element is not returned.

const element = await page.evaluate(() => document.querySelector('a'));

while here the element will be an instance of JSHandle:

const element = await page.evaluateHandle(() => document.querySelector('a'));

You can use jsHandle.asElement() to get the ElementHandle.

According to the Puppeteer Documentation:

page.title()

• returns: <Promise<string>> Returns page's title.

Shortcut for page.mainFrame().title().

Therefore, you should use page.title() for getting the title of the newly opened page.

Alternatively, you can gain a slight performance boost by using the following:

page._frameManager._mainFrame.evaluate(() => document.title)

Note: Make sure to use the await operator when calling page.title(), as the title tag must be downloaded before Puppeteer can access its content.