I need a tool that can pull out all the useful content from a multi-page webpage and converts it to one Markdown file.
I need to save the material that I learning from and document it in a specific markup format so I can add my new experiences and make connections between things.
I can manually write a program for different websites but I cannot find a general solution for converting multi-page to one Markdown file. I don't want to do it manually.
For example, I have converted all Java documentation into one Markdown file with a basic program and have added my experiences and create connections between with my computer science notes. These notes save me a lot of pain because search engines such as Google are not saving me every time.
pandoc
is the tool for the job. For multi-page sites, you'll probably need to use some combo of tools: a web crawler pluspandoc
plus some simple Bash scripting. – tonysdg Dec 12 '18 at 17:52