We are recently working on the development of a crawler. One major feature/function is to do transformation from crawled HTML into text. We have surveyed a few python solution such as scrapy. However, we decide to move coding language from python to nodejs (Because of the headless chrome). Is there any recommendation on exist JS framework/library excellent to do the work in transforming html into text? (e.g.: html-to-text)
Ps. It will be great that the package/library itself can have some intelligence to remove the advertisement/footer/header out and easy to do extension if we want customized logic.