Stack Overflow
Stack Overflow

Questions tagged [crrri]

The crrri R package provides a native interface to interact with a headless Chromium or Chrome instance. Use this tag for questions that specifically focus on the R interface. Use the chrome-devtools-protocol tag for more generic questions about the DevTools protocol.

6 questions
4
votes
1 answer

Correct way to get response body of XHR requests generated by a page with RStudio Chromote

I'd like to use Chromote to gather the response body of the XHR calls made by a website, but I find the API a bit complex to master, especially the async pipeline. I guess I need to first enable the Network functionality and then load the page (this…
Bakaburg
  • 3,165
  • 4
  • 32
  • 64
1
vote
1 answer

crrri wait until page is loaded

Hi I am using the crrri R package to build a scraper, I have an asynchronous function to dump the DOM but i keep getting blanks even though I have the Page$loadEventFired() in the loop. Tried to create runtime event that will wait until I get the…
Giuliano
  • 11
  • 1
1
vote
1 answer

How to set chrome bin in crrri asynchronous functions?

When I try running an asynchronous function with crrri, I receive the error message: "Error: Cannot launch Chrome. Please add the path to your Chrome bin." I guess the error message is trying to tell me that crrri cannot find my chrome executable.…
Tea Tree
  • 882
  • 11
  • 26
0
votes
0 answers

Can I ensure a promises function is complete before continuing in R?

I am using the crrri package to webscrape some dynamic sites; however, when I run it across multiple pages in a for loop, there is a delay (I'm presuming because of the promises), which means that sometimes when accessing the html_temp file, it is…
timnus
  • 197
  • 10
0
votes
1 answer

Cannot install crrri package on Mac OS

I'm running into the following error when trying to install the headless chrom crrri package on Mac OS using remotes::install_github('rlesur/crrri'): Downloading GitHub repo rlesur/crrri@HEAD Running R CMD build... checking for file…
Rafael Velásquez
  • 337
  • 1
  • 3
  • 14
0
votes
0 answers

Scroll the page down using crrri package and headless chrome

I'm trying to scrape a website, that has javascript executing, adding new information when user scrolls down. I use this function to get DOM: library(crrri) dump_DOM <- function(url) { perform_with_chrome(function(client) { Network <-…
vladli
  • 1,454
  • 2
  • 16
  • 40