TestMu 2025 - The Largest Virtual Software Testing Conference is Back | 50,000+ Attendees

How to use ShouldWorkForMainFrameNavigationRequests method of PuppeteerSharp.Tests.NetworkTests.RequestFrameTests class

Best Puppeteer-sharp code snippet using PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForMainFrameNavigationRequests

RequestFrameTests.cs

Source: RequestFrameTests.cs

...12        public RequestFrameTests(ITestOutputHelper output) : base(output)13        {14        }15        [Fact]16        public async Task ShouldWorkForMainFrameNavigationRequests()17        {18            var requests = new List<Request>();19            Page.Request += (sender, e) =>20            {21                if (!TestUtils.IsFavicon(e.Request))22                {23                    requests.Add(e.Request);24                }25            };26            await Page.GoToAsync(TestConstants.EmptyPage);27            Assert.Single(requests);28            Assert.Equal(Page.MainFrame, requests[0].Frame);29        }30        [Fact]...

ShouldWorkForMainFrameNavigationRequests

Using AI Code Generation

1PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForMainFrameNavigationRequests()2at PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForMainFrameNavigationRequests() in D:\a\1\s\lib\PuppeteerSharp.Tests\NetworkTests\RequestFrameTests.cs:line 273Assert.Equal() Failure4PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForSubFrameNavigationRequests()5at PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForSubFrameNavigationRequests() in D:\a\1\s\lib\PuppeteerSharp.Tests\NetworkTests\RequestFrameTests.cs:line 366Assert.Equal() Failure7PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForSubFrameNavigationRequests()

ShouldWorkForMainFrameNavigationRequests

Using AI Code Generation

1PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForMainFrameNavigationRequests()2PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForSubFrameNavigationRequests()3PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForSubFrameNavigationRequests()4PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForSubFrameNavigationRequests()5PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForSubFrameNavigationRequests()6PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForSubFrameNavigationRequests()7PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForSubFrameNavigationRequests()8PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForSubFrameNavigationRequests()9PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForSubFrameNavigationRequests()10PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForSubFrameNavigationRequests()

ShouldWorkForMainFrameNavigationRequests

Using AI Code Generation

1PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForMainFrameNavigationRequests()2PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForSubframeNavigationRequests()3PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForSubresourceNavigationRequests()4PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForXHRNavigationRequests()5PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForFetchNavigationRequests()6PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForEventSourceNavigationRequests()7PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForWebSocketNavigationRequests()8PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForOtherNavigationRequests()9PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForNavigationRequestsFromDifferentFrames()10PuppeteerSharp.Tests.NetworkTests.RequestFrameTests.ShouldWorkForNavigationRequestsFromDifferentFrames()

ShouldWorkForMainFrameNavigationRequests

Using AI Code Generation

1using System;2using System.Collections.Generic;3using System.Linq;4using System.Text;5using System.Threading.Tasks;6{7    {8    }9}10using System;11using System.Collections.Generic;12using System.Linq;13using System.Text;14using System.Threading.Tasks;15{16    {17    }18}19using System;20using System.Collections.Generic;21using System.Linq;22using System.Text;23using System.Threading.Tasks;24{25    {26    }27}28using System;29using System.Collections.Generic;30using System.Linq;31using System.Text;32using System.Threading.Tasks;33{34    {35    }36}37using System;38using System.Collections.Generic;39using System.Linq;40using System.Text;41using System.Threading.Tasks;42{43    {44    }45}46using System;47using System.Collections.Generic;48using System.Linq;49using System.Text;50using System.Threading.Tasks;51{52    {53    }54}55using System;56using System.Collections.Generic;57using System.Linq;58using System.Text;59using System.Threading.Tasks;60{61    {62    }63}

ShouldWorkForMainFrameNavigationRequests

Using AI Code Generation

1Assert.Equal(HttpStatusCode.OK, response.Status);2Assert.Equal(HttpStatusCode.OK, response.Status);3Assert.Equal(HttpStatusCode.OK, response.Status);4Assert.Equal(HttpStatusCode.OK, response.Status);5Assert.Equal(HttpStatusCode.OK, response.Status);6Assert.Equal(HttpStatusCode.OK, response.Status);7Assert.Equal(HttpStatusCode.OK, response.Status);8Assert.Equal(HttpStatusCode.OK, response.Status);

ShouldWorkForMainFrameNavigationRequests

Using AI Code Generation

1Assert.True(request.IsNavigationRequest);2Assert.True(request.IsMainFrame);3Assert.True(request.IsNavigationRequest);4Assert.False(request.IsMainFrame);5Assert.False(request.IsNavigationRequest);6Assert.False(request.IsMainFrame);7Assert.False(request.IsNavigationRequest);8Assert.False(request.IsMainFrame);9Assert.False(request.IsNavigationRequest);10Assert.False(request.IsMainFrame);11Assert.False(request.IsNavigationRequest);12Assert.False(request.IsMainFrame);13Assert.False(request.IsNavigationRequest);14Assert.False(request.IsMainFrame);15Assert.False(request.IsNavigationRequest);16Assert.False(request.IsMainFrame);

StackOverFlow community discussions

Questions

Discussion

Style Property and Values

Evaluate Fetch Api in PuppeteerSharp

HtmlAgilityPack Issue in reading some sites

Puppeteer-sharp: page is crashed from browser.NewPageAsync()

Generating PDF file with PuppeteerSharp from webpage containing images linking to Azure Blob storage

Scrap Data after button click in PuppeteerSharp C#

Change from JS Puppeteer code to PuppeteerSharp C#

Failed to launch Base! /app/.local-chromium/Linux-706915/chrome-linux/chrome: ... libX11.so.6

Loop through JSHandle@array PuppeteerSharp

Puppeteer Sharp strange behaviour

The problem is how the CSSStyleDeclaration is serialized. If that´s how Chromium decides to serialize that object there is nothing we can do there.

But, we can try to solve that from javascript using EvaluateFunctionAsync.

foreach (var handle in elementHandles)
{
  var style = await page.EvaluateFunctionAsync<Dictionary<string, string>>(
    "e => Object.entries(e.style).filter(i => isNaN(i[0]) && i[1]).map(i => { return { [i[0]] : i[1]}}).reduce((acc, cur) => { return {...acc, ...cur}}, {})", handle);
  var output = style.ToString();
}

Let's take a look at the javascript expression

e=> //We send the HTML element instead of the style property
  Object.entries(e.style) //We get all the property/value pairs from the CSSStyleDeclaration object
    // We want to exclude number properties (like 0,1,2) and empty values
    .filter(i => isNaN(i[0]) && i[1]) 
    //We turn them into objects
    .map(i => { return { [i[0]] : i[1]}})
    //We merge them into one single object that will be returned to C#
    .reduce((acc, cur) => { return {...acc, ...cur}}, {})

https://stackoverflow.com/questions/58727636/style-property-and-values

In Puppeteer, the function that we provide to page.evaluate is executed in context of the page and so it has to be a JavaScript function.

Likewise, in the equivalent functions in puppeteer-sharp e.g. page.EvaluateFunctionAsync, the first argument is a string which is nothing but a JavaScript function. You should be able to use the fetch as it is, something like:

await page.EvaluateFunctionAsync(@"() => {
  return fetch('url', {method: 'POST', body: 'test' });
}");

https://stackoverflow.com/questions/65539174/evaluate-fetch-api-in-puppeteersharp

It looks like the examples you're sending are Single Page Applications or highly JavaScript based. The first example returns the following HTML:

<!DOCTYPE html>
<html lang="fa-IR">
<head>
<script type="9055e798d34ceda9b8089665-text/javascript">(function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':
            new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],
        j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src=
        'https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);
    })(window,document,'script','dataLayer','GTM-MSQZK3S');</script>
<script type="9055e798d34ceda9b8089665-text/javascript">
        !function (t, e, n) {
            t.yektanetAnalyticsObject = n, t[n] = t[n] || function () {
                t[n].q.push(arguments)
            }, t[n].q = t[n].q || [];
            var a = new Date, r = a.getFullYear().toString() + "0" + a.getMonth() + "0" + a.getDate() + "0" + a.getHours(),
                    c = e.getElementsByTagName("script")[0], s = e.createElement("script");
            s.id = "ua-script-yn-2448-adv"; s.dataset.analyticsobject = n;
            s.async = 1; s.type = "text/javascript";
            s.src = "https://cdn.yektanet.com/rg_woebegone/scripts_v2/yn-2448-adv/rg.complete.js?v=" + r, c.parentNode.insertBefore(s, c)
        }(window, document, "yektanet");
    </script>
<base href="/">
<meta charset="UTF-8">
<meta name="theme-color" content="#2e9ed8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<meta name="language" content="fa" />
<link rel="apple-touch-icon" sizes="180x180" href="./apple-touch-icon.png">
<link rel="icon" type="image/png" sizes="32x32" href="./favicon-32x32.png">
<link rel="icon" type="image/png" sizes="16x16" href="./favicon-16x16.png">
<link rel="manifest" href="./site.webmanifest">
<link rel="mask-icon" href="./safari-pinned-tab.svg" color="#5bbad5">
<meta name="msapplication-TileColor" content="#ffc40d">
<meta name="theme-color" content="#ffffff">
<meta name="google-signin-scope" content="profile email">
<link rel="search" type="application/opensearchdescription+xml" title="Faranesh" href="./opensearch.xml" />
<link rel="manifest" href="./manifest.json" />

As you can see there is no body and no title tag initially.

If you want to parse the content, including the JavaScript generated DOM elements you'll need to automate a Headless browser instead of parsing the raw HTML returned by the server.

https://github.com/dhamaniasad/HeadlessBrowsers

For example, try:

https://github.com/hardkoded/puppeteer-sharp

Not tested locally, but from the examples in their repository, something along these lines:

await new BrowserFetcher().DownloadAsync(BrowserFetcher.DefaultRevision);
var browser = await Puppeteer.LaunchAsync(new LaunchOptions
{
    Headless = true
});
var page = await browser.NewPageAsync();
await page.GoToAsync("https://faranesh.com/");

var title = @"document.title";
Console.WriteLine($"Title: {title}");

https://stackoverflow.com/questions/62081688/htmlagilitypack-issue-in-reading-some-sites

Should be due to PuppeteerSharp requires to run on Linux system in Azure (which can download and install Chromium by coding). If want to test on Windows, need to pre-install Chrome/Chromium and add ExecutablePath in LaunchOptions

// DEBUG: for running on local
ExecutablePath = "C:\\Program Files (x86)\\Google\\Chrome\\Application\\chrome.exe"

Please share if you have other solutions.

https://stackoverflow.com/questions/67612806/puppeteer-sharp-page-is-crashed-from-browser-newpageasync

When I used querySelectorAll. My issue has been resolved.

var  content = await page.EvaluateExpressionAsync("document.querySelectorAll('#res')");

https://stackoverflow.com/questions/70606433/scrap-data-after-button-click-in-puppeteersharp-c-sharp

We cannot convert the whole code for you but here are some pointers. You need to take one chunk of problem at a time.

Break the while loop

Let us look into the JS code,

let count = 0;
while (await page.$('#search-content button.btn-icon') !== null && count != 1) {}

It's creating a while look, which stops if count is 1.

Now your C# Code,

while (await page.QuerySelectorAsync("#search-content button.btn-icon") != null)

It's not checking for count, this will end up in infinite while loop.

You should count the number,

int count = 0;
while (await page.QuerySelectorAsync("#search-content button.btn-icon") != null && count != 1){
 // other code
 count++;
}

This way it will stop after it finds one result.

Learn more about Promise.all etc.

Your rest of the question is about Promise.all and few other stuff. Here are some useful links,

https://stackoverflow.com/questions/55522149/change-from-js-puppeteer-code-to-puppeteersharp-c-sharp

Ok, turns out it was a mix of things. The dockerfile needed rearranging and works best without a sandbox. As you'll see, the original code was installing dependencies on the intermediate image rather then the final/base.

For some reason, I couldn't get it to work under a sandboxed user properly, so that was removed. As a result the implementation needed updating to enable the --no-sandbox argument.

Here's the updated code for anyone else struggling to get puppeteer-sharp working with .NET Core 3.1.

dockerfile

#See https://aka.ms/containerfastmode to understand how Visual Studio uses this Dockerfile to build your images for faster debugging.

FROM mcr.microsoft.com/dotnet/core/aspnet:3.1-buster-slim AS base
#####################
#PUPPETEER RECIPE
#####################
# Install latest chrome dev package and fonts to support major charsets (Chinese, Japanese, Arabic, Hebrew, Thai and a few others)
# Note: this installs the necessary libs to make the bundled version of Chromium that Puppeteer
# installs, work.
ARG CHROME_VERSION="81.0.4044.138-1"
RUN apt-get update && apt-get -f install && apt-get -y install wget gnupg2 apt-utils
RUN wget --no-verbose -O /tmp/chrome.deb http://dl.google.com/linux/chrome/deb/pool/main/g/google-chrome-stable/google-chrome-stable_${CHROME_VERSION}_amd64.deb \
&& apt-get update \
&& apt-get install -y /tmp/chrome.deb --no-install-recommends --allow-downgrades fonts-ipafont-gothic fonts-wqy-zenhei fonts-thai-tlwg fonts-kacst fonts-freefont-ttf \
&& rm /tmp/chrome.deb

ENV PUPPETEER_EXECUTABLE_PATH "/usr/bin/google-chrome"
#####################
#END PUPPETEER RECIPE
#####################

WORKDIR /app
EXPOSE 80
EXPOSE 443


FROM mcr.microsoft.com/dotnet/core/sdk:3.1-buster AS build
WORKDIR /src


COPY ["ProjectName.Core/ProjectName.Core.csproj", "ProjectName.Core/"]
RUN dotnet restore "ProjectName.Core/ProjectName.Core.csproj"


COPY . .
WORKDIR "/src/ProjectName.Core"
RUN dotnet build "ProjectName.Core.csproj" -c Release -o /app/build

FROM build AS publish
RUN dotnet publish "ProjectName.Core.csproj" -c Release -o /app/publish

FROM base AS final
WORKDIR /app
COPY --from=publish /app/publish .
ENTRYPOINT ["dotnet", "ProjectName.Core.dll"]

Implementation

public static async Task<Stream> GeneratePdfFromHtml(string html, List<string> styleUrls = null)
{
    await new BrowserFetcher().DownloadAsync(BrowserFetcher.DefaultRevision);

    var browser = await Puppeteer.LaunchAsync(new LaunchOptions
    {
        Args = new[] { "--no-sandbox" },
        Headless = true                
    });

    using (var page = await browser.NewPageAsync())
    {
        await page.SetContentAsync(html);

        if(styleUrls != null)
            foreach (var url in styleUrls)
            {
                await page.AddStyleTagAsync(new AddTagOptions { Path = url });
            }

        return await page.PdfStreamAsync();                
    }
}

It's probably worth noting that the docker implementation of puppeteer-sharp also seems to have a problem with finding stylesheets using a local url (e.g. localhost:1234/lib/bootsrap/bootsrap.min.css). It just hangs and spins forever, hence changing the AddStyleTagAsync() to use filepaths instead. Don't forget, this is found under IHostingEnvironment.WebRootPath to save you a google search.

Hope this helps someone else out there. No doubt it'll cross my path again at some point in the not-so-distant future too!

https://stackoverflow.com/questions/64292937/failed-to-launch-base-app-local-chromium-linux-706915-chrome-linux-chrome

That's an array in the browser. If you want to get that array on your site, you can use the GetPropertiesAsync method. It should be something like this:

var properties = await elements.GetPropertiesAsync().ConfigureAwait(false);
var elementsArray = properties.Values.OfType<ElementHandle>().ToArray();

https://stackoverflow.com/questions/66288973/loop-through-jshandlearray-puppeteersharp

I found a solution: If the pages will be created in the same scope as their browser instance, then the pages will be created as expected, otherwise Task.Run() will be stuck due to NewPageAsync() method.

Bad behaviour:

Task[] Tasks = new Task[1];
Browser browser = await Puppeteer.LaunchAsync
(
    new LaunchOptions
    {
        Headless = true,
        ExecutablePath = "Chromium\\chrome.exe"
    }
);
for (int i = 0; i < Tasks.Length; i++)
{
    int ThreadNumber = i;
    Tasks[i] = Task.Run(async () =>
    {
       Page page = await browser.NewPageAsync(); //stucks
    });
}

Task.WaitAll(Tasks);

As expected:

Task[] Tasks = new Task[1];
for (int i = 0; i < Tasks.Length; i++)
{
    int ThreadNumber = i;
    Tasks[i] = Task.Run(async () =>
    {
       Browser browser = await Puppeteer.LaunchAsync
       (
           new LaunchOptions
           {
                Headless = true,
               ExecutablePath = "Chromium\\chrome.exe"
           }
       );
       Page page = await browser.NewPageAsync(); //creates as expected
    });
}

Task.WaitAll(Tasks);

Anyway this is not the best solution because I have to create browsers for async tasks rather than using one browser for all async tasks. Hope someone can explain that. Thanks everyone for helping!

https://stackoverflow.com/questions/57970079/puppeteer-sharp-strange-behaviour

Blogs

Check out the latest blogs from LambdaTest on this topic:

Migrating Test Automation Suite To Cypress 10

There are times when developers get stuck with a problem that has to do with version changes. Trying to run the code or test without upgrading the package can result in unexpected errors.

How To Run Cypress Tests In Azure DevOps Pipeline

When software developers took years to create and introduce new products to the market is long gone. Users (or consumers) today are more eager to use their favorite applications with the latest bells and whistles. However, users today don’t have the patience to work around bugs, errors, and design flaws. People have less self-control, and if your product or application doesn’t make life easier for users, they’ll leave for a better solution.

How To Find Hidden Elements In Selenium WebDriver With Java

Have you ever struggled with handling hidden elements while automating a web or mobile application? I was recently automating an eCommerce application. I struggled with handling hidden elements on the web page.

Test Managers in Agile – Creating the Right Culture for Your SQA Team

I was once asked at a testing summit, “How do you manage a QA team using scrum?” After some consideration, I realized it would make a good article, so here I am. Understand that the idea behind developing software in a scrum environment is for development teams to self-organize.

How to Position Your Team for Success in Estimation

Estimates are critical if you want to be successful with projects. If you begin with a bad estimating approach, the project will almost certainly fail. To produce a much more promising estimate, direct each estimation-process issue toward a repeatable standard process. A smart approach reduces the degree of uncertainty. When dealing with presales phases, having the most precise estimation findings can assist you to deal with the project plan. This also helps the process to function more successfully, especially when faced with tight schedules and the danger of deviation.

Automation Testing Tutorials

Learn to execute automation testing from scratch with LambdaTest Learning Hub. Right from setting up the prerequisites to run your first automation test, to following best practices and diving deeper into advanced test scenarios. LambdaTest Learning Hubs compile a list of step-by-step guides to help you be proficient with different test automation frameworks i.e. Selenium, Cypress, TestNG etc.