31:T977,vtt_string = `WEBVTT Kind: captions Language: en 00:00:00.176 --> 00:00:01.716 >> We have recently identified 00:00:01.716 --> 00:00:04.816 that some astronauts experience changes in their vision, 00:00:04.816 --> 00:00:07.756 which might be related to the cardiovascular system. 00:00:07.756 --> 00:00:10.986 Our hearts pump blood around our body through blood vessels. 00:00:10.986 --> 00:00:13.016 Special adaptations in our bodies ensure 00:00:13.016 --> 00:00:18.246 that fluid is evenly distributed despite the pull of gravity. 00:00:18.246 --> 00:00:21.206 In space, astronauts no longer experience the downward pull 00:00:21.206 --> 00:00:23.446 of gravity, and the fluid in their bodies tends 00:00:23.446 --> 00:00:26.426 to move towards the upper body and the head. 00:00:26.426 --> 00:00:28.376 Our cranium is a rigid container. 00:00:28.376 --> 00:00:30.126 As the fluid moves towards the head, 00:00:30.126 --> 00:00:32.546 it causes the pressure inside the skull to rise. 00:00:32.546 --> 00:00:35.146 This is known as increased intracranial pressure. 00:00:35.146 --> 00:00:38.376 The optic nerve travels from the brain to the eye. 00:00:38.466 --> 00:00:41.006 The increased pressure from the cranium travels 00:00:41.006 --> 00:00:42.486 down the nerve and affects the eye. 00:00:42.486 --> 00:00:46.196 It causes the optic nerve to be squeezed and the optic disc 00:00:46.246 --> 00:00:48.366 where the optic nerve meets the eye to swell. 00:00:48.366 --> 00:00:51.556 The back of the eyeball flattens as pressure builds behind it, 00:00:51.556 --> 00:00:54.446 and the blood vessels in the back of the eyeball also swell. 00:00:54.446 --> 00:00:58.086 These changes can affect the astronaut's vision. 00:00:58.086 --> 00:01:00.956 One change is that the astronauts become far sighted. 00:01:00.956 --> 00:01:03.646 A second change is that they can develop cotton wool spots, 00:01:03.646 --> 00:01:06.126 which represent damage of the nerve fibers 00:01:06.126 --> 00:01:07.046 in the back of the eye. 00:01:07.046 --> 00:01:10.196 These can cause discrete areas of vision loss. 00:01:10.196 --> 00:01:14.286 NASA is working to understand to prevent these changes 00:01:14.286 --> 00:01:16.576 in astronauts which may also help us understand 00:01:16.576 --> 00:01:22.096 to prevent related vision changes here on Earth. ------------------------------688ed48833b8-- `32:[] 2f:{"title":"Working with data from transcripts","cells":[{"id":0,"value":"md`# Working with data from transcripts`","pinned":false,"hidden":false,"mode":"ojs"},{"id":182,"value":"md `## \"vtt-to-json\" for vtt file format to json conversion & \"compromise\" for basic NLP`","pinned":false,"hidden":false,"mode":"ojs"},{"id":166,"value":"md `### Why?`","pinned":false,"hidden":false,"mode":"ojs"},{"id":168,"value":"md `Watching videos or listening to audio is slow and requires a human, a costly human. As speech-to-text gets better transcription is less costly and more common. Data visualizations of transcripts, or keywords, or attributes of groups of words should be faster for many search/compare/understand tasks than watching or listening at real-time speeds.`","pinned":false,"hidden":false,"mode":"ojs"},{"id":173,"value":"md `### What is in this notebook?`","pinned":false,"hidden":false,"mode":"ojs"},{"id":159,"value":"md `This is a quick demo of data conversion before you would do data visuailzation. It show how you might use vtt-to-json for converting vtt files into easier to work with json and compromise for basic natural language processing as early steps before doing data visuaization.`","pinned":false,"hidden":false,"mode":"ojs"},{"id":163,"value":"md `VTT is a web format standard for video transcripts.`","pinned":false,"hidden":false,"mode":"ojs"},{"id":72,"value":"md `### Import the vtt-to-json function`","pinned":false,"hidden":false,"mode":"ojs"},{"id":2,"value":"vttToJson = require('vtt-to-json@0.1.1/index.js').catch(() => window.convertVttToJson)","pinned":true,"hidden":false,"mode":"ojs"},{"id":89,"value":"md `We'll use the transcript file from this youtube video on \"Astronaut Vision Changes in Microgravity\" for demonstration purposes. Scroll down to the bottom of the transcript for the next part.`","pinned":false,"hidden":false,"mode":"ojs"},{"id":189,"value":"//// Uncomment the lines below to see video!\nhtml``","pinned":false,"hidden":false,"mode":"ojs"},{"id":198,"value":"md `#### Paste in the vtt file as a string`","pinned":false,"hidden":false,"mode":"ojs"},{"id":291,"value":"ytdlcore = require('https://bundle.run/ytdl-core@0.20.2')","pinned":false,"hidden":false,"mode":"ojs"},{"id":235,"value":"videoID = \"q_q61B-DyPk\"","pinned":true,"hidden":false,"mode":"ojs"},{"id":241,"value":"getYoutubeSubtitles = require('@joegesualdo/get-youtube-subtitles-node@0.1.0/index.js').catch(() => window.getYoutubeSubtitles) ","pinned":false,"hidden":false,"mode":"ojs"},{"id":266,"value":"function getSubtitles(videoID){\n getYoutubeSubtitles(videoID).then(subtitles => {\n console.log(subtitles)\n subtitles_holder.push(subtitles)\n return subtitles\n})\n.catch(err => {\n console.log(err)\n subtitles_holder.push(err)\n})\n}\n","pinned":true,"hidden":false,"mode":"ojs"},{"id":277,"value":"subtitles = getSubtitles(videoID)","pinned":true,"hidden":false,"mode":"ojs"},{"id":269,"value":"subtitles_holder = [\"\"]","pinned":false,"hidden":false,"mode":"ojs"},{"id":43,"value":"$31","pinned":false,"hidden":false,"mode":"ojs"},{"id":93,"value":"md `### Use the vttToJson function we established above to return a JSON of the VTT file to make it easier to work with`","pinned":false,"hidden":false,"mode":"ojs"},{"id":66,"value":"json_transcript_output = vttToJson(vtt_string)\n.then((result) => {\n return(result)\n})","pinned":true,"hidden":false,"mode":"ojs"},{"id":95,"value":"md `Now that the data is in json format, it is a little easier to work with. Click on the arrow next to \"Array\" to expand the json and see the key/value pairs.`","pinned":false,"hidden":false,"mode":"ojs"},{"id":98,"value":"md `## We can bring in the compromise JavaScript NLP library to do some quick analysis on the words in the transcript`","pinned":false,"hidden":false,"mode":"ojs"},{"id":139,"value":"md `This is a good demo of the compromise library in Observable.`","pinned":false,"hidden":false,"mode":"ojs"},{"id":142,"value":"md `### Importing the compromise library with require`","pinned":false,"hidden":false,"mode":"ojs"},{"id":103,"value":"nlp =require('compromise')","pinned":false,"hidden":false,"mode":"ojs"},{"id":145,"value":"md `\"getAllWords\" is a function for getting all the words from the JSON created from the vtt transcript with vtt-to-json.`","pinned":false,"hidden":false,"mode":"ojs"},{"id":105,"value":"function getAllWords(json_){\n let all_words = [];\n for (var i = 0; i < json_.length; i++) { \n \tlet words = json_[i][\"words\"]\n \tfor (var j = 0; j < words.length; j++){\n all_words.push(words[j][\"word\"])\n }\n \t\n\t}\n return all_words\n}","pinned":false,"hidden":false,"mode":"ojs"},{"id":108,"value":"all_words_array = getAllWords(json_transcript_output)","pinned":false,"hidden":false,"mode":"ojs"},{"id":149,"value":"md `\"turnArrayofWordsIntoString\" is a function that takes the array of words found above and turns it into a string with no commas, periods, etc.`","pinned":false,"hidden":false,"mode":"ojs"},{"id":115,"value":"function turnArrayofWordsIntoString(arrayOfWords){\n\tlet wordString = \"\";\n \tfor (var i = 0; i < arrayOfWords.length; i++) {\n \tconsole.log(arrayOfWords[i])\n \twordString = wordString+\" \"+arrayOfWords[i]\n }\n return wordString\n}","pinned":true,"hidden":false,"mode":"ojs"},{"id":201,"value":"md `Get all the words`","pinned":false,"hidden":false,"mode":"ojs"},{"id":118,"value":"words = turnArrayofWordsIntoString(all_words_array)","pinned":true,"hidden":false,"mode":"ojs"},{"id":151,"value":"md `We can then give that string of words to compromise-nlp and ask it to give us arrays of words back according to parts of speech, like nouns or verbs. `","pinned":false,"hidden":false,"mode":"ojs"},{"id":203,"value":"md `Get all the verbs.`","pinned":false,"hidden":false,"mode":"ojs"},{"id":128,"value":"VERBS = nlp(words).verbs().out('array')","pinned":true,"hidden":false,"mode":"ojs"},{"id":205,"value":"md `Get all the nouns.`","pinned":false,"hidden":false,"mode":"ojs"},{"id":134,"value":"NOUNS = nlp(words).nouns().out('array')","pinned":true,"hidden":false,"mode":"ojs"},{"id":216,"value":"viewof min_length_of_word = html``","pinned":false,"hidden":false,"mode":"ojs"},{"id":222,"value":"min_length_of_word","pinned":false,"hidden":false,"mode":"ojs"},{"id":207,"value":"function longerWords(words){\n\tlet moreImpWords = []\n \tfor (let eachW in words){\n \tif (words[eachW].length > min_length_of_word){\n moreImpWords.push(words[eachW])\n }\n \telse if (words[eachW].includes(\" \")){\n moreImpWords.push(words[eachW])\n }\n }\n return moreImpWords\n}","pinned":false,"hidden":false,"mode":"ojs"},{"id":230,"value":"md `Subset of NOUNS: includes words with spaces, so multiple words, or words with characters > than min_length_of_word variable`","pinned":false,"hidden":false,"mode":"ojs"},{"id":211,"value":"longer_nouns = longerWords(NOUNS)","pinned":false,"hidden":false,"mode":"ojs"}],"files":"$W32","stdlib":"1","titling":"auto"}