How do I perform web parsing in the form of changing the value to Javascript after an HTML call?

The developer tool shows the value, but if you parse the web itself, the data value is not parsed.

I want to parse the contents after the Javascript function is executed after the page is loaded.

I heard that simple XML parsing is not possible, so how do I parse?

Can the web be parsed after the javascript function is called? None?

If there is, how should I google the keyword?

I'd like to know the search keyword. ㅠ<

web parse

2022-09-21 18:54

1 Answers

In some cases, results are obtained by performing JavaScript with a JavaScript implementation of Spider-Monkey, and test automation programs such as selenium are also used.

The former is very cumbersome, but the method using selenium in the latter has the advantage of being able to use the browsed html as it is using the installed browser.

Of course, selenium also has its disadvantages, but since it uses the browser itself, it does what the browser does It's as heavy and slow as it is.

The recommended method for the questioner is to control phantomjs, a headless browser (a light web engine that does not display results on the screen), to selenium to get results.

2022-09-21 18:54

If you have any answers or tips

Popular Tags

python x 4647

android x 1593

java x 1494

javascript x 1427

c x 927

c++ x 878

ruby-on-rails x 696

php x 692

python3 x 685

html x 656