31:[] 2f:{"title":"wtf-wikipedia-json","cells":[{"id":0,"value":"md`# wtf-wikipedia-json\n\n[wtf_wikipedia](https://github.com/spencermountain/wtf_wikipedia/) can turn a wikipedia article into JSON in an easy way:\n`","pinned":false,"hidden":false,"mode":"ojs"},{"id":14,"value":"viewof page = html``","pinned":false,"hidden":false,"mode":"ojs"},{"id":61,"value":"viewof lang = html``","pinned":false,"hidden":false,"mode":"ojs"},{"id":33,"value":"doc = await wtf.fetch(page, lang)","pinned":false,"hidden":false,"mode":"ojs"},{"id":19,"value":"json = doc.json()","pinned":true,"hidden":false,"mode":"ojs"},{"id":27,"value":"JSON.stringify(json, null, 2)","pinned":false,"hidden":false,"mode":"ojs"},{"id":23,"value":"md`\nyou may notice a few things right away:\n\n* it's a very complex and verbose format by default (sorry)\n* there's a ton of data there\n* it's kinda in page-order, but also kinda not.\n\n---\n\nFortunately, you can wrangle things down in a variety of ways.\n\nFirst, you can just create your own json, from any part of the page you'd like:\n`","pinned":false,"hidden":false,"mode":"ojs"},{"id":31,"value":"{\n //get json for one section only\n let section = doc.section(0).json()\n\n // get just the infobox\n let infobox = doc.infobox(0)\n if(infobox){\n infobox = infobox.json()\n }\n \n //get the link json\n let links = doc.links().map(l => l.json())\n \n //get the image json\n let images= doc.images().map(img => img.json())\n \n return {section, infobox, links, images}\n}","pinned":true,"hidden":false,"mode":"ojs"},{"id":42,"value":"md`\nyou can also turn-on and off json fields, in any part, using a options object parameter:`","pinned":false,"hidden":false,"mode":"ojs"},{"id":45,"value":"doc.json({paragraphs:true, references:false, lists:false, templates:false, categories:false})","pinned":true,"hidden":false,"mode":"ojs"},{"id":68,"value":"---\n\nmany properties are available to be added or removed from the json output:\n\n```js\nconst defaults = {\n title: true,\n sections: true,\n pageID: true,\n categories: true,\n wikidata: true,\n description: true,\n revisionID: false,\n timestamp: false,\n pageImage: false,\n domain: false,\n language: false,\n}\n```","pinned":false,"hidden":false,"mode":"md"},{"id":52,"value":"md`---\nhere is the default json output format, which may be helpful:\n\n\\`\\`\\`coffee\nDoc:\n title: ''\n pageID: ''\n categories: ['']\n sections:\n - title: ''\n depth: 1\n paragraphs:\n - sentences:\n - text: ''\n links:\n - type: ''\n text: ''\n page: ''\n formatting:\n bold: ['']\n italic: ['']\n templates:\n - template: ''\n prop: ''\n infoboxes:\n - name: ''\n prop: ''\n references:\n - type: ''\n title: ''\n\\`\\`\\`\n\nyou can see, for example, that \\`references\\` and other templates are on \\'section\\` - and cannot be mapped-back to their specific location in the document. ie, some of the detailed ordering in the page is lost.\n\n\n`","pinned":false,"hidden":false,"mode":"ojs"},{"id":2,"value":"wtf=require('wtf_wikipedia')","pinned":false,"hidden":false,"mode":"ojs"},{"id":7,"value":"wtf.version","pinned":false,"hidden":false,"mode":"ojs"},{"id":5,"value":"style = html``","pinned":false,"hidden":false,"mode":"ojs"}],"files":"$W31","stdlib":"1","titling":"auto"}