How can I retrieve page content with Puppeteer in an n8n workflow?

Below is an example of how you can modify your code so that the asynchronous Puppeteer call gets awaited and its result is returned as output. In the Code node, if you call an async function without awaiting it, you’ll only get a pending promise. Also, note that output written via console.log goes to the browser’s developer console (if you open it) rather than n8n’s UI. You can instead return your result as workflow output for easier inspection.

Try this version:

JAVASCRIPTCopied
const puppeteer = require('puppeteer');

async function run() {
  const browser = await puppeteer.launch();
  const page = await browser.newPage();

  // Navigate to the URL.
  await page.goto('https://developer.chrome.com/');

  // Set the viewport.
  await page.setViewport({ width: 1080, height: 1024 });

  // Type into the search field.
  await page.locator('.devsite-search-field').fill('automate beyond recorder');

  // Wait and click on the first result.
  await page.locator('.devsite-result-item-link').click();

  // Locate the full title with a unique string.
  const textSelector = await page.locator('text/Customize and automate').waitHandle();
  const fullTitle = await textSelector?.evaluate(el => el.textContent);

  await browser.close();

  // Return the title.
  return fullTitle;
}

// Await the function call so that you get the resolved value.
const result = await run();

// Optionally log to the browser console (open developer tools to see it).
console.log('The title of the blog post is:', result);

// Set the result into the output JSON.
$input.item.json.content = result;

// Return the modified item.
return $input.item;

Key Points

• Await your asynchronous function:
  By using await run(); you ensure that the promise from Puppeteer resolves before continuing.

• Return the result:
  Instead of relying on console.log output (which goes to the browser’s developer console), assign the result to the JSON output for inspection in later nodes or in the workflow results.

• Console output:
  Remember that console.log inside the Code node sends output to the browser console. To view these logs, open your browser’s developer tools.

Using this adjusted code, you should be able to retrieve and see the page content (in this case, the blog post title) in the workflow output.