I have a list of HTTP URLs and I want to know if the corresponding HTML pages contain structured data markup, and if yes, which syntaxes and which vocabularies they use.
The tool can be anything: a desktop program (no matter which OS, but ideally for GNU/Linux), a Web app (no matter if self-hosted or hosted), a script, … I’d prefer not to have to script/program something myself, but if all needed parts are figured out and I only have to connect them or adjust something, I’m open for it.
Free/Libre software preferred, but not required. It doesn’t have to be gratis.
Syntaxes
At the minimum, the tool must detect the syntaxes
- JSON-LD (in
script
elements with theapplication/ld+json
type), - Microdata, and
- RDFa.
Bonus points for support of other embedded syntaxes (e.g., Turtle in script
elements), or even for checking alternative representations (e.g., RDF/XML via content negotiation).
Vocabularies
It should output all used vocabularies (so not only looking for specific ones, like Schema.org).
It would be great if the tool outputs all specified types/classes and properties in addition.
I’m not interested in the full RDF graph or the actual data, I only want to know which elements from vocabularies get used.
Example output
It could be something like this:
URL Syntaxes Vocabularies
------------------------------------------------------------------
http://example.com/foo Microdata Schema.org
http://example.com/bar RDFa, JSON-LD OGP, Schema.org
http://example.net/i RDFa FOAF
http://example.org/login Microdata <no vocabulary>
Or with types:
URL Syntaxes Types
-----------------------------------------------------------------------
http://example.com/foo Microdata schema:Organization, schema:Thing
http://example.net/i RDFa foaf:Person, foaf:Document
The output should be in a suitable format for gathering statistics.
Product
, bottom of the page) or on Google’s doc for their Product Rich Snippet. – unor Apr 17 '16 at 13:29