How to use IsTextOnlyObject method of PuppeteerSharp.PageAccessibility.AXNode class

After struggling with the issue for several hours, we finally located the issue. It is not related with Puppeteer that works like a charm but rather with the way a private blob storage container handles authentication: as our request contained an Authorization HTTP Header with a bearer token required by our own app, this header was sent by Chromium while retrieving remote images from the blob container. Unfortunately Azure service tried to handle that token and rejected our request.

How did we identify that? By connecting a chrome debugger to the Chromium instance and by checking the logs. Indeed it is possible to launch Puppeteer with a remote debugging port.

Just replacing navigation with WaitUntilNavigation.Networkidle2 worked to wait until Javascript is finished to excute.

using PuppeteerSharp;

await new BrowserFetcher().DownloadAsync(BrowserFetcher.DefaultRevision);
Browser browser = await Puppeteer.LaunchAsync(new LaunchOptions
{
    Headless = true // false if you need to see the browser
});
var page = await browser.NewPageAsync();
page.DefaultTimeout = 5000; // or you can set this as 0
await page.GoToAsync("https://www.google.com", WaitUntilNavigation.Networkidle2);
var content = await page.GetContentAsync();

Console.WriteLine(content);

I think EvaluateFunctionAsync is the most straight forward way to do this:

var type = await node.EvaluateFunctionAsync<string>("node => node.type");

How to use PuppeteerSharp inside an UWP App?

PuppeteerSharp does not support in UWP, You could check PuppeteerSharp source code to verify this. This is DownloadsFolder = Path.Combine(Directory.GetCurrentDirectory(), ".local-chromium") and matched path is "{AppRoot}\bin\x86\Debug\AppX.local-chromium". In the following code we call Create method in it, but above path is read-only in UWP.

    public async Task<RevisionInfo> DownloadAsync(int revision)
    {
        var url = GetDownloadURL(Platform, DownloadHost, revision);
        var zipPath = Path.Combine(DownloadsFolder, $"download-{Platform.ToString()}-{revision}.zip");
        var folderPath = GetFolderPath(revision);

        if (new DirectoryInfo(folderPath).Exists)
        {
            return RevisionInfo(revision);
        }

        var downloadFolder = new DirectoryInfo(DownloadsFolder);
        if (!downloadFolder.Exists)
        {
            downloadFolder.Create();
        }

        if (DownloadProgressChanged != null)
        {
            _webClient.DownloadProgressChanged += DownloadProgressChanged;
        }
        await _webClient.DownloadFileTaskAsync(new Uri(url), zipPath).ConfigureAwait(false);

        if (Platform == Platform.MacOS)
        {
            //ZipFile and many others unzip libraries have issues extracting .app files
            //Until we have a clear solution we'll call the native unzip tool
            //https://github.com/dotnet/corefx/issues/15516
            NativeExtractToDirectory(zipPath, folderPath);
        }
        else
        {
            ZipFile.ExtractToDirectory(zipPath, folderPath);
        }

        new FileInfo(zipPath).Delete();

        var revisionInfo = RevisionInfo(revision);

        if (revisionInfo != null && GetCurrentPlatform() == Platform.Linux)
        {
            LinuxSysCall.Chmod(revisionInfo.ExecutablePath, LinuxSysCall.ExecutableFilePermissions);
        }
        return revisionInfo;
    }

I have found the solution, here it is for those who may be interested:

First, we should create a CDPSession like this:

var client = await page.Target.CreateCDPSessionAsync();

then we should Evaluate our script to get an element:

var body = await client.SendAsync("Runtime.evaluate", new { expression = "document.getElementsByTagName('input')[0]" });

and at last, we should use DOMDebugger with the element's objectId to get its event listeners:

var result = await client.SendAsync("DOMDebugger.getEventListeners", new { objectId = body["result"]["objectId"] });

Not sure you can disable the built in download manager with --disable-extensions.

Another approach if it is just ZIP's you want to stop is to plumb this code in:-

await page.setRequestInterception(true);
page.on('request', request => {
    if (request.url().endsWith('.zip'))
        request.abort();
    else
      request.continue();
});

You may also want to lower case the url so you also trap .ZIP abnd Zip etc

Also on your goto you will need to abort the request e.g.

  await page
        .goto("https://winaero.com/downloads/Win7Games4Win10_8_81_v2.zip")
        .catch(r => r.abort);

I think you will find easy to translate the code from puppeteer recorder to Puppeteer-Sharp. At least you can get the selectors from there.

Once you have those selectors you could do 3 things:

One option is setting a directory where the browser can store the cookies using the UserDataDir property. You could open the browser BrowserFetcher downloads and click that button.

A better solution is executing a script using EvaluateFunctionAsync to check if you have the cookies button and click it (using the selector you got from the recorder). Your code will be more flexible.

Last option would be downloading Chromie 77 or higher and launch it using ExecutablePath.

You can do something like this:

await page.EvaluateExpressionAsync("document.querySelectorAll('SCRIPT').forEach(e => e.remove())");

Try adding the URL/Domain to Internet Download Manager's exception list. It will ignore the download request.