I'm trying to make a web recorder. It is easy to get the content of a web page, but when you filter that data, you usually choose "Inspect Element" and assume that the element's Xpath, id, class is known and filtered.

How can I capture that data (text, table, body etc) from any web site over the mouse pointer? And how do I catch the clicked url? (I tried to explain this in the visuals)enter image description hereenter image description here

I tried to do it with Selenium, but it's more used for testing. How can I do this with beautifulsoup in Scrapy(I tried to use selector)? Or should I use something else?

Any advice on how to do capture and parse function will be highly appreciated!

enter image description hereenter image description here

Your Answer

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Browse other questions tagged or ask your own question.