32:T421, **'The_Words'** is a grouping of the new Latent data and **'TheWords'** (A filtered set of words from the English word frequency dataset). # Todo: Visualisation and add centroids and hull area's to clusters. [Delaunay marks ](https://observablehq.com/plot/marks/delaunay) Assign colours to clusters. That would define the different clusters with more contrast. Check version of plot I am using as the beta version is now a stable version. Read all the 'rambling text (brain farts)' and remove the stink. Look at not using open source content from spelling lists, currently they have a non commercial restriction. AI might be able to make the lists. # other resources https://languages.oup.com/products/language-datasets/childrens-datasets/ the age grouping is useful. # questions Do Words in adjoining clusters have a context connection? Yes Could I get the AI's to generate word list in the defined groups. (yes it can be done, see **ClaudeAI**) I could then check those words with the words in my dataset and add group classification.33:T42b,clu = Plot.plot({ width, height: width*0.62, inset: 10, // color: { scheme: 'Sinebow' }, x: {label: null, axis: null}, y: {label: null, axis: null}, marks: [ Plot.dot(Words, { x: "x", y: "y", r: 1.5, // fillOpacity: 0.5, fill: "cluster", stroke: 'none', title: d => `>>> ${d.cluster} - ${d.word} \n ${thewords_clusters[d.cluster].label} \n ${thewords_clusters[d.cluster].summary} `, tip: true }), Plot.hull(Words, { x: "x", y: "y", fill: "cluster", fillOpacity: 0.25 }), // Plot.voronoi(Words, { x: "x", y: "y", fill: "cluster", fillOpacity: 0.3 }), // Plot.delaunayLink(Words, {x: "x", y: "y", stroke: "cluster", strokeWidth: 1.5, strokeOpacity: 0.2 }) // Plot.delaunayMesh(Words, {x: "x", y: "y", stroke: "cluster", strokeWidth: 1.5, strokeOpacity: 0.2 }) // Plot.voronoiMesh(Words, {x: "x", y: "y", stroke: "gray" }) Plot.frame(), ] })34:T6eb,--- # Dictionary datasets. https://www.zdnet.com/article/scrabble-ownership-and-the-public-domain/ https://en.wikipedia.org/wiki/Scrabble?#History --- [kaggle dataset by rtatman "english word frequency"](https://www.kaggle.com/datasets/rtatman/english-word-frequency?resource=download) The Kaggle word list of 333,333 words includes 1 letter words, like x, y, f and more research needed. --- https://diginoodles.com/projects/eowl “English Open Word List” (EOWL)

Letter	Words	Letter	Words	Letter	Words
A	7,296	J	1,287	S	15,917
B	7,272	K	1,577	T	7,289
C	11,382	L	4,126	U	4,425
D	7,217	M	6,891	V	2,364
E	5,151	N	2,522	W	3,147
F	5,389	O	3,681	X	122
G	4,747	P	10,278	Y	608
H	4,500	Q	720	Z	624
I	3,685	R	6,794
Total Words	128,985

The English Open Word List in this notebook is called [all_the_words](https://observablehq.com/d/8bf2b91371416176#all_the_words). --- https://github.com/meetDeveloper/freeDictionaryAPI/tree/master/meta/wordList --- https://en.wiktionary.org/wiki/Wiktionary:Public_domain_sources word lists. https://boardgames.stackexchange.com/questions/38366/latest-collins-scrabble-words-list-in-text-file ---35:T4ba,- Emergent Spelling Stage (Ages 3-5) - Early Writing Stage (Ages 6 - 8) - Transitional Spelling Stage (Ages 9-11) - Competent Spelling Stage (Ages 12-14) - Advanced Spelling Stage (Ages 15+) - Domain-Specific Spelling Stage, - - focuses on specialized vocabulary related to specific fields of study or professions - Words in this stage can vary depending on the chosen domain, such as science, mathematics, literature, or technology. - Etymology-Based Spelling Stage - - This stage emphasizes words that share common origins, helping individuals understand spelling patterns and meanings. - Words in this stage could include groups derived from Latin, Greek, or other language roots. - Contextual Spelling Stage - - This stage involves words that require context and understanding of word usage, homophones, and homonyms. - Words in this stage may have multiple spelling variations depending on the intended meaning or grammatical context. - Orthographic Spelling Stage - - This stage focuses on complex spelling rules, including silent letters, double consonants, and variations in word endings. - Words in this stage may challenge individuals to master intricate orthographic patterns. 36:T8ad,# key points Grouping words by difficulty level is a great way to ensure that children are learning words at the right pace. If the words are too easy, they will get bored. If the words are too difficult, they will get frustrated. It is also important to consider the sounds of the words, the length of the words, and the complexity of the spelling patterns when grouping words by difficulty level. For example, words with multiple syllables or words with silent letters are typically more difficult to spell than words with one syllable or words with no silent letters. In addition to grouping words by difficulty level, it is also helpful to group words by part of speech. This can help children learn the different types of words and how they are used in sentences. For example, nouns are words that name people, places, or things. Verbs are words that describe actions. Adjectives are words that describe nouns. Adverbs are words that describe verbs, adjectives, or other adverbs. Pronouns are words that take the place of nouns. Finally, it is important to remember that spelling proficiency develops over time. Children will learn to spell more difficult words as they get older and have more practice. By categorizing words into age groupings, you can create a hierarchical structure that reflects the increasing complexity of spelling proficiency. # TLDR - Categorize words by difficulty level and part of speech to help children learn to spell at the right pace. - Consider the sounds, length, and complexity of words when grouping them by difficulty level. - Remember that spelling proficiency develops over time. 1. Group words by difficulty for appropriate learning pace 2. Easy words bore, hard words frustrate 3. Consider sounds, length, and spelling complexity 4. Group by part of speech to understand word types 5. Spelling improves with time and practice 6. Categorize by age for increasing complexity # The basic AI instructions are like this, but I'm still working on that. Group words by difficulty for appropriate age group. Consider word sounds, length, and spelling complexity. Consider the usage of the word based on the word frequency data. Categorize by age for increasing complexity.37:T54c,# questions I have grouped my words into these for sets. Pre-Writing Stage (Ages 3-5) Transitional Spelling Stage (Ages 9-11) Competent Spelling Stage (Ages 12-14) Advanced Spelling Stage (Ages 15+) can you improve on these groupings as I would like to work with a finer level of data. I want to also consider how common an understanding of a word is to what age groups know that words. So it's more than knowing how to spell out words but that there are words that have meaning/comprehension to an age group --- So far I am most interested in the following key points and would like to review these and offer thoughts on these as a base concept for data analysis of words in a dictionary. Group the words by their difficulty level. You can do this by looking at the sounds of the words, the length of the words, or the complexity of the spelling patterns. Make sure the words are at the right level of difficulty. If the words are too easy, your child will get bored. If the words are too difficult, they will get frustrated. words that the people struggle with spelling you could group nouns, verbs, adjectives, adverbs, and pronouns. group words by their difficulty level By categorizing words into these age groupings, you can create a hierarchical structure that reflects the increasing complexity of spelling proficiency. ---38:T70f,# the GptChat response. Emergent Spelling Stage (Ages 3-5): wake, woke, wakes, awake, awakes, waken, waked, wakened Early Writing Stage (Ages 6-8): digit, max, minimal, maximal, awake, awakened, minimalism, awaken, awakens, awakening Transitional Spelling Stage (Ages 9-11): digital, maximum, minimum, optimal, maximize, minimize, optimize, optimum, digitize, digitized, minimal, maximizing, minimizing, optimizing, maximized, minimized, maximizing, minimizing, optimally, maximise, minimise, optimise, maximising, minimising Competent Spelling Stage (Ages 12-14): maxwell, digitally, maximizing, minimizing, optimizes, maximizes, minimizes, digitizing, optimized, maximising, minimising, maximised, minimised, digitised, optimised, maximises, minimises, digitises, reawakened, reawaken, digitizes Advanced Spelling Stage (Ages 15+): awakening, awakenings, minimalistic, maximization, minimization, optimization, maximizations, minimizations, optimizations, maximization, digitization, reawakening, digitizations, wakening, maximizer, minimizer, optimizer, awakened, awaken, maximizers, minimizers, optimizers --- ## reviewed by bard _I have this grouping of words. Do you see any that are in the wrong group?_ "digit" should be in the "Emergent Spelling Stage" group. "minimalism" should be in the "Early Writing Stage" group. "maximizers" and "minimizers" should be in the "Competent Spelling Stage" group. "optimizers" should be in the "Advanced Spelling Stage" group. --- ## reviewed by new chatgpt cinversation "awake" is listed in both the Emergent Spelling Stage (Ages 3-5) and the Early Writing Stage (Ages 6-8). It seems that "awake" should only be included in the Emergent Spelling Stage (Ages 3-5) group since it is not specifically related to writing or spelling. --- ---39:T49a, --- ## ChatGPT review Emergent Spelling Stage (Ages 3-5): digital (more suitable for a higher stage due to length and complexity) optimum (more suitable for a higher stage due to complexity) Early Writing Stage (Ages 6-8): maximal (more suitable for a higher stage due to length and complexity) awakening (more suitable for a higher stage due to length and complexity) Transitional Spelling Stage (Ages 9-11): digitally (more suitable for a higher stage due to length and complexity) maximizing (more suitable for a higher stage due to length and complexity) Competent Spelling Stage (Ages 12-14): maxi (more suitable for an earlier stage due to simplicity) optimally (more suitable for a higher stage due to complexity) Advanced Spelling Stage (Ages 15+): awaken (more suitable for an earlier stage due to simplicity) awakened (more suitable for an earlier stage due to simplicity) wakened (more suitable for an earlier stage due to simplicity) awoken (more suitable for an earlier stage due to simplicity) waked (more suitable for an earlier stage due to simplicity) wakeful (more suitable for an earlier stage due to complexity) 3a:T59e,--- # https://chat.claudeai.ai/chats 54057 is a lot of words for **Claudeai** the 1350kb csv/text file is reported to be 400% too much. So I need to cut all the words into 5 files. # work around I have asked **claudeAI** to make spelling lists for the 12 grades. **claudeAI** can make the word list pretty well and has a grasp of the concept behind hard and easy to spell words. _I tried to provide developmentally appropriate words for each grade level, moving from simpler to more complex patterns. The "harder" words introduce less common spelling patterns or long vowels, blends, etc. that pose more of a challenge._ The context text for each grade should be interesting as this is what was provided for 1st graders. _The harder words tend to be longer words, have less common letter patterns, or contain blends/digraphs that may be new for a first grader. The easier words tend to be shorter, have simple CV or CVC patterns, and contain more familiar letters. I categorized them based on spelling patterns that would likely be simpler or more complex for a beginner speller to grasp. Let me know if you would like me to modify the categorization in any way._ Once I have these spelling lists, I can then update "All the Words" to include a grade and also work out what words are not in the spelling lists and submit them to be graded. Adding the easy and hard words to a grade is also good data for a spelling test, 3b:Ta21,--- Here is a categorization of the 500 words into easier and harder words for a first grader to spell: Easier Words (375 words): a, am, an, and, art, ask, add, all, arm, at, bag, bat, bed, big, bit, bib, box, be, bun, ball, bell, bike, back, bad, boy, bug, bark, barn, blow, bow, blue, baby, bus, but, can, cat, car, cup, cap, cut, cow, cry, came, card, chat, call, camp, cook, coat, cone, cop, come, dad, day, do, dot, duck, doll, dear, dark, dig, dish, dime, dog, down, eat, egg, elf, end, ear, each, fun, fan, fat, feet, fell, find, frog, fish, food, four, fast, funny, get, go, gum, game, gift, green, give, glad, grow, gas, got, hat, hot, had, hug, hop, hen, hand, he, here, hit, ice, in, is, it, jam, jar, jig, joy, jet, job, jump, juice, kid, kiss, kite, key, kind, leg, lip, log, let, lap, land, lion, look, like, little, lid, late, lens, leaf, man, mix, mom, mad, map, may, my, make, mouse, meow, mug, mop, moon, more, met, mail, mine, new, not, now, nine, nest, note, name, need, nice, net, off, old, out, on, oh, our, own, ox, open, over, out, pen, pig, pin, pet, pink, peck, pick, pull, pot, pop, play, park, pond, peep, paw, quick, quit, red, rat, rug, rip, ring, run, roll, round, rope, rain, rose, rest, right, room, read, rabbit, race, saw, sit, six, sad, song, say, sail, seed, sing, stop, sun, so, soap, sit, sink, show, snow, spy, step, sock, tap, toy, top, ten, tub, tan, tick, tail, take, talk, tire, toe, town, tree, train, tent, under, up, use, us, unit, unlock, undo, van, vet, was, with, went, walk, wait, want, work, what, wood, wolf, wet, wag, yell, yes, yet, yak, yummy, yam, yellow, yo-yo, zip, zoo, zebra Harder Words (125 words): ant, bite, bear, boat, bike, bite, blow, camp, crab, cube, crab, camp, dear, dish, dime, edge, ever, fell, fell, head, hill, hurt, hide, jig, jet, jump, juice, king, kiss, keep, lake, light, lion, love, muffin, mouse, met, mine, nest, nib, nine, peep, pool, pond, paw, quit, rain, rock, rang, rip, ride, roll, rang, saw, sink, snip, stop, sun, sink, tiger, tire, toe, town, turtle, tiger, tent, undo, vet, wig, wall, whale, wood, worm, walk, wagon, wall, yell, yet, yell, yak, zig-zag The harder words tend to be longer words, have less common letter patterns, or contain blends/digraphs that may be new for a first grader. The easier words tend to be shorter, have simple CV or CVC patterns, and contain more familiar letters. I categorized them based on spelling patterns that would likely be simpler or more complex for a beginner speller to grasp. Let me know if you would like me to modify the categorization in any way.3c:T190a,--- ## I may have to submit example and then get the generated text for each grade as the output size is a limite. ### I don't think I need the training text? Here are spelling word lists categorized by difficulty for grades 2 through 12: Grade 2 Easier Words: about, after, again, also, animal, away, ball, bear, because, been, before, best, better, bring, carry, clean, cut, done, draw, drink, eight, every, fall, far, full, got, grow, hold, hot, hurt, if, keep, kind, laugh, light, long, much, myself, never, only, own, pick, seven, shall, show, small, start, ten, today, together, try, warm Grade 2 Harder Words: always, any, clothes, cold, does, fast, first, five, found, gave, goes, once, pull, read, right, sing, sit, sleep, tell, their, these, those, upon, us, very, wash, which, why, wish, work, would, write Grade 3 Easier Words: above, almost, also, around, became, because, been, before, best, better, bring, carry, clean, cut, done, draw, drink, eight, every, fall, far, full, got, grow, hold, hold, hurt, if, keep, kind, laugh, light, long, once, only, own, pick, seven, shall, show, small, start, take, tell, today, together, try, warm, wash Grade 3 Harder Words: always, any, climb, clothes, cold, does, fast, first, five, found, gave, goes, great, its, made, many, off, pull, read, right, sing, sit, sleep, their, these, upon, us, very, which, why, wish, work, would, write, your Grade 4 Easier Words: above, almost, also, around, became, because, been, before, best, better, both, bring, carry, clean, does, done, draw, drink, during, eight, every, fall, far, fast, first, five, found, four, grow, hold, hurt, if, keep, kind, laugh, light, long, once, only, own, pick, seven, shall, show, small, start, take, tell, their, these, those, upon, us, very, wash, which, why Grade 4 Harder Words: any, clothes, could, cold, climb, does, full, gave, goes, great, its, many, off, pull, read, right, sing, sit, sleep, tell, together, try, warm, wash, which, wish, work, would, write, your Grade 5 Easier Words: above, almost, also, around, because, become, before, between, big, carry, does, during, eight, every, fall, far, fast, first, five, found, four, grow, kind, laugh, light, long, only, own, pick, shall, show, since, small, start, take, tell, their, these, upon, us, very, wash, which, why Grade 5 Harder Words: any, been, both, buy, call, change, check, close, cold, does, done, draw, drink, eat, fill, find, got, grow, hold, hurt, if, keep, made, many, off, read, right, sing, sit, sleep, tell, together, try, wash, which, write, your Grade 6 Easier Words: above, almost, also, became, because, become, before, carry, change, close, does, during, eat, eight, every, fall, far, fast, fill, find, first, five, found, four, grow, kind, laugh, light, long, once, only, own, pick, right, shall, show, since, small, start, take, tell, their, these, upon, very, was, wash, which, why Grade 6 Harder Words: been, both, buy, call, check, done, draw, drink, got, grow, hold, hurt, if, keep, made, many, off, read, sing, sit, sleep, together, try, warm, write, your Grade 7 Easier Words: above, almost, also, because, become, before, carry, change, close, does, during, each, eat, eight, every, fall, far, fast, fill, find, first, five, found, four, laugh, light, long, once, only, own, pick, right, shall, show, since, small, start, take, tell, their, these, upon, very, was, wash, which, why Grade 7 Harder Words: been, both, buy, call, check, done, draw, drink, got, grow, hold, hurt, if, keep, made, many, off, read, sing, sit, sleep, together, try, warm, write, your Grade 8 Easier Words: above, almost, also, because, become, before, carry, change, close, does, during, each, eat, eight, every, fall, far, fast, fill, find, first, five, found, four, laugh, light, long, once, only, own, pick, right, shall, show, since, small, start, take, tell, their, these, upon, very, was, wash Grade 8 Harder Words: been, both, buy, call, check, done, draw, drink, got, grow, hold, hurt, if, keep, made, many, off, read, sing, sit, sleep, together, try, warm, write, your Grade 9 Easier Words: above, almost, also, become, before, carry, change, close, does, during, each, eat, eight, every, fall, far, fast, fill, find, first, five, found, four, laugh, light, long, once, only, own, pick, right, shall, show, since, small, start, take, tell, their, these, upon, very, was, wash Grade 9 Harder Words: any, been, both, buy, call, check, done, draw, drink, got, grow, hold, hurt, if, keep, made, many, off, read, sing, sit, sleep, together, try, warm, write, your Grade 10 Easier Words: above, almost, also, become, before, carry, change, close, does, during, each, eat, eight, every, fall, far, fast, fill, find, first, five, found, four, laugh, light, long, once, only, own, pick, right, shall, show, since, small, start, take, tell, their, these, upon, very, was, wash Grade 10 Harder Words: any, been, both, buy, call, check, done, draw, drink, got, grow, hold, hurt, if, keep, made, many, off, read, sing, sit, sleep, together, try, warm, write, your Grade 11 Easier Words: above, almost, also, become, before, carry, change, close, does, during, each, eat, eight, every, fall, far, fast, fill, find, first, five, found, four, laugh, light, long, once, only, own, pick, right, shall, show, since, small, start, take, tell, their, these, upon, very, was, wash Grade 11 Harder Words: any, been, both, buy, call, check, done, draw, drink, got, grow, hold, hurt, if, keep, made, many, off, read, sing, sit, sleep, together, try, warm, write, your Grade 12 Easier Words: above, almost, also, become, before, carry, change, close, does, during, each, eat, eight, every, fall, far, fast, fill, find, first, five, found, four, laugh, light, long, once, only, own, pick, right, shall, show, since, small, start, take, tell, their, these, upon, very, was, wash Grade 12 Harder Words: any, been, both, buy, call, check, done, draw, drink, got, grow, hold, hurt, if, keep, made, many, off, read, sing, sit, sleep, together, try, warm, write, your Let me know if you would like me to modify or expand these word lists in any way. I tried to provide developmentally appropriate words for each grade level, moving from simpler to more complex patterns. The "harder" words introduce less common spelling patterns or long vowels, blends, etc. that pose more of a challenge.3d:T4e0,grade10 = ['abalone','aberrant','absenteeism','accelerator','agog','amorphous','ampere','anachronistic','anathema','apocryphal','arboreal','arcana','assiduous','atrophy','attenuate','auspices','autonomous','ballyhoo','beguiling','belvedere','bicuspid','biennial','bravura','cacophony','carcinogen','cervine','colloquial','comestible','commensurate','concierge','contemporaneous','convivial','corollary','cumbrous','delineate','despotism','disenfranchise','echelon','eclectic','emigrant','encyclical','fallacious','filibuster','fungible','gazpacho','gazetteer','gimmicky','ignominy','imperturbable','incontrovertible','incredulously','indomitable','intransigence','kefir','knickknack','kuchen','largesse','lederhosen','lintel','modicum','myrrh','narcissus','neckerchief','neophyte','neurosis','nunnery','obdurate','obstetrician','opacity','opaqueness','operetta','oxymoron','parallelogram','pegmatite','pejorative','penumbra ','perfunctory','pertinacious','piscatorial','poultice','rampageous','recalcitrant','restaurateur','reticular','sacrilegious','sauerbraten','sobriquet','surreptitiously','sycophantic','thievery','tremolo','trichinosis','tripartite','troika','turducken','unconscionable','unpronounceable','virulent','vociferous','zoophyte']3e:T434,grade11 = ['abnegation','ablution','abomasum','abstemious','accretion','acolyte','alopecia','anabasis','anneal', 'archetypal', 'asseverate', 'bibelot', 'bilious', 'braggadocio', 'bulbul', 'cabochon', 'camaraderie', 'campanile', 'catachresis', 'chiffonade', 'chimerical', 'chinook', 'clerihew', 'concessionaire', 'concurrence', 'denigrate', 'deracinate', 'dichotomous', 'ecclesiastic', 'egregious', 'elegy', 'frangipani', 'froideur', 'grandiloquence', 'hackmatack', 'imbroglio', 'impecunious', 'implacable', 'incarnadine', 'indefeasible', 'innuendoes', 'interlocutor', 'irrebuttable', 'keeshond', 'kinesiology', 'kitschy', 'laterigrade', 'lyceum', 'mahal', 'mandibular', 'magniloquent', 'medlar', 'minatory', 'monomania', 'moribund', 'multifarious', 'munificence', 'nauseous', 'noisome', 'nonplussed', 'obstreperous', 'paludal', 'paraphrasable', 'pellucid', 'persiflage', 'physiognomy', 'portmanteau', 'prosciutto', 'punctilious', 'rapaciousness', 'risibility', 'rubicund', 'shivoo', 'simulacrum', 'solipsistic', 'teleological', 'turgidity', 'vituperate', 'zoetrope', 'zydeco']3f:Taa8,hardWords = [ "abecedarian", "aberrant", "abhorrence", "abscissa", "absquatulate", "abysmal", "accommodate", "achievement", "acquiesce", "acquisitiveness", "aficionado", "amanuensis", "anathema", "aneurysm", "antediluvian", "apartheid", "aphaeresis", "apocryphal", "appropriateness", "asterisk", "baccalaureate", "bicuspid", "boutonniere", "borborygmus", "bouillon", "brouhaha", "cacophony", "calisthenics", "callus", "candelabra", "cannoli", "cantankerous", "cappuccino", "caricature", "catachresis", "cataclysm", "catastrophe", "catharsis", "celerity", "chamomile", "chandelier", "claustrophobia", "clientele", "colloquial", "connoisseur", "conscientious", "convivial", "delineate", "diaphanous", "dirigible", "eclectic", "egregious", "ephemeral", "equanimity", "espionage", "euonymus", "execrable", "extraneous", "fallacious", "filibuster", "flibbertigibbet", "gazetteer", "garrulous", "gourmand", "gratuitous", "guerdon", "hacienda", "hegemony", "horologium", "hypocritical", "iconoclast", "idiosyncratic", "ignominy", "implacable", "impuissance", "inchoate", "incontrovertible", "indefatigable", "inexorable", "infallible", "inoculate", "intransigence", "inveigh", "iontophoresis", "irrepressible", "jacquard", "jodhpurs", "jurisprudence", "kanone", "knickknack", "kuchen", "largesse", "lederhosen", "loathsome", "logarithm", "logorrhea", "maelstrom", "masseuse", "mayonnaise", "millennium", "milieu ", "milquetoast", "mischievous", "mulligatawny", "myrrh", "nadir", "nouveau", "nugatory", "onomatopoeia", "ophthalmologist", "panache", "paraphrasable", "pastiche", "peccadillo", "peripatetic", "phenomenon", "phlebitis", "picnicking", "pirouette", "poignancy", "posthumous", "preemptory", "psephology", "pseudonym", "ptyalism", "quandary ", "querulous", "questionnaire", "quiescent ", "quixotic ", "rampageous", "rapacious", "raucously", "rendezvous", "restaurateur", "resuscitate", "rinceau", "sacrilegious", "spontaneity", "streusel", "stupefying", "stymie", "surreptitiously", "susceptible", "synecdoche", "synonymous", "tableau", "tarantula", "terpsichorean", "troubadour", "turpitude", "tutelage", "tyrannical", "ubiquitous", "unconscious", "undecipherable", "unwarranted", "unwieldiness", "vaccinate", "variegated", "vehement", "vengeance", "veterinarian", "vicissitude", "vigilante", "virtuoso", "whippoorwill", "withhold", "writhe", "zephyr", "zooxanthella", "zucchini" ]40:T5c2,mis_spelled = [ "absence", "excellent", "pneumonia", "accidentally", "excitement", "possess", "accommodate", "experience", "practically", "achieve", "familiar", "preferred", "acquaintance", "fascinate", "privilege", "against", "favorite", "probably", "a\nlot", "February", "raspberry", "already", "finally", "realize", "argument", "foreign", "receive", "attendance", "friend", "recommend", "because", "government", "remember", "beginning", "grammar", "restaurant", "believe", "guarantee", "rhythm", "business", "height", "ridiculous", "calendar", "immediately", "schedule", "cemetery", "independent", "scissors", "chief", "instead", "separate", "committee", "interrupt", "similar", "conscience", "judgment", "sincerely", "convenience", "leisure", "straight", "courageous", "library", "strengthen", "criticize", "lightning", "studying", "decision", "lonely", "summarize", "definitely", "lying", "surprise", "desperately", "millionaire", "thorough", "dictionary", "mischievous", "tomorrow", "different", "necessary", "truly", "disease", "niece", "until", "doesn't", "noticeable", "vacuum", "embarrass", "occasion", "vegetable", "enough", "occurred", "Wednesday", "environment", "opposite", "weight", "especially", "particular", "weird", "exaggerate", "physical", "yacht" ]41:T4273,list1000words = [ [ "a", "convenient", "hard", "official", "something" ], [ "able", "convention", "has", "often", "sometimes" ], [ "aboard", "convict", "hat", "old", "son" ], [ "about", "copy", "have", "omit", "song" ], [ "above", "cordially", "he", "on", "soon" ], [ "absence", "cost", "head", "once", "sorry" ], [ "accept", "could", "hear", "one", "south" ], [ "accident", "country", "heard", "only", "speak" ], [ "according", "course", "heart", "open", "special" ], [ "account", "court", "height", "opinion", "spell" ], [ "across", "cover", "held", "or", "spend" ], [ "act", "crowd", "help", "order", "spent" ], [ "action", "cut", "her", "organization", "spring" ], [ "add", "dark", "here", "organize", "stamp" ], [ "addition", "dash", "herself", "other", "stand" ], [ "address", "date", "high", "ought", "start" ], [ "adopt", "daughter", "him", "our", "state" ], [ "affair", "day", "himself", "out", "statement" ], [ "afraid", "dead", "his", "outside", "station" ], [ "after", "deal", "history", "over", "stay" ], [ "afternoon", "dear", "hold", "own", "steamer" ], [ "again", "death", "home", "page", "still" ], [ "against", "debate", "honor", "paid", "stole" ], [ "age", "December", "hope", "pair", "stone" ], [ "ago", "decide", "horse", "paper", "stood" ], [ "agreement", "decision", "hot", "part", "stop" ], [ "air", "declare", "hour", "particular", "stopped" ], [ "alike", "deep", "house", "party", "story" ], [ "all", "degree", "how", "pass", "street" ], [ "allege", "delay", "however", "past", "struck" ], [ "allow", "department", "human", "pay", "study" ], [ "almost", "desire", "hurt", "people", "success" ], [ "alone", "destroy", "husband", "perfect", "such" ], [ "along", "develop", "I", "perhaps", "sudden" ], [ "already", "diamond", "ice", "period", "suffer" ], [ "also", "did", "if", "personal", "suggest" ], [ "although", "died", "illustrate", "picture", "suit" ], [ "always", "difference", "immediate", "piece", "summer" ], [ "am", "different", "importance", "place", "summon" ], [ "among", "difficulty", "important", "plan", "Sunday" ], [ "amount", "direct", "impossible", "plant", "supply" ], [ "an", "direction", "imprison", "play", "support" ], [ "and", "director", "improvement", "pleasant", "suppose" ], [ "annual", "disappoint", "in", "please", "sure" ], [ "another", "discussion", "include", "pleasure", "surprise" ], [ "answer", "distinguish", "income", "point", "system" ], [ "any", "distribute", "increase", "police", "table" ], [ "anything", "district", "indeed", "political", "take" ], [ "anyway", "divide", "inform", "poor", "talk" ], [ "appear", "do", "information", "popular", "tax" ], [ "application", "doctor", "injure", "population", "teach" ], [ "appoint", "does", "inside", "position", "teacher" ], [ "appreciate", "dollar", "inspect", "possible", "tell" ], [ "April", "don’t", "instead", "post", "ten" ], [ "are", "done", "intend", "pound", "tenth" ], [ "argument", "door", "interest", "power", "term" ], [ "army", "doubt", "into", "practical", "terrible" ], [ "around", "down", "investigate", "prefer", "testimony" ], [ "arrange", "dozen", "invitation", "preliminary", "than" ], [ "arrangement", "dress", "is", "prepare", "thank" ], [ "arrest", "drill", "issue", "present", "that" ], [ "arrive", "driven", "it", "president", "the" ], [ "article", "drown", "its", "press", "theater" ], [ "as", "due", "itself", "pretty", "their" ], [ "ask", "during", "jail", "price", "them" ], [ "assist", "duty", "January", "primary", "themselves" ], [ "associate", "each", "judge", "principal", "then" ], [ "association", "earliest", "judgment", "principle", "there" ], [ "assure", "early", "July", "print", "therefore" ], [ "at", "east", "June", "prison", "these" ], [ "athletic", "easy", "just", "private", "they" ], [ "attempt", "eat", "justice", "probably", "thing" ], [ "attend", "education", "keep", "proceed", "think" ], [ "attention", "effect", "kill", "progress", "third" ], [ "August", "effort", "kind", "promise", "this" ], [ "aunt", "eight", "knew", "prompt", "those" ], [ "auto", "either", "know", "proper", "though" ], [ "automobile", "elaborate", "known", "property", "thought" ], [ "avenue", "elect", "lady", "prove", "three" ], [ "await", "election", "lake", "provide", "through" ], [ "away", "else", "land", "provision", "throw" ], [ "awful", "emergency", "large", "public", "Thursday" ], [ "baby", "empire", "last", "publication", "thus" ], [ "back", "employ", "late", "publish", "ticket" ], [ "bad", "enclose", "law", "purpose", "time" ], [ "ball", "end", "lay", "push", "tire" ], [ "band", "engage", "lead", "put", "to" ], [ "be", "engine", "learn", "question", "today" ], [ "bear", "enjoy", "least", "quite", "together" ], [ "beautiful", "enough", "leave", "race", "told" ], [ "became", "enter", "led", "railroad", "tomorrow" ], [ "because", "entertain", "ledge", "rain", "tonight" ], [ "become", "entire", "left", "raise", "too" ], [ "bed", "entitle", "length", "ran", "took" ], [ "been", "entrance", "less", "rapid", "top" ], [ "before", "escape", "lesson", "rate", "total" ], [ "beg", "especially", "let", "rather", "toward" ], [ "began", "estate", "letter", "reach", "town" ], [ "begin", "estimate", "liberty", "read", "track" ], [ "beginning", "even", "life", "ready", "train" ], [ "begun", "evening", "light", "real", "travel" ], [ "behind", "event", "like", "really", "treasure" ], [ "believe", "ever", "line", "reason", "tree" ], [ "belong", "every", "list", "receipt", "trip" ], [ "beside", "everything", "little", "receive", "trouble" ], [ "best", "evidence", "live", "recent", "true" ], [ "better", "examination", "local", "recommend", "truly" ], [ "between", "except", "long", "recover", "trust" ], [ "big", "expect", "look", "red", "try" ], [ "bill", "expense", "lose", "refer", "Tuesday" ], [ "black", "experience", "loss", "reference", "turn" ], [ "block", "express", "lost", "refuse", "two" ], [ "blow", "extra", "lot", "regard", "unable" ], [ "blue", "extreme", "love", "region", "uncle" ], [ "board", "eye", "low", "relative", "under" ], [ "boat", "face", "machine", "relief", "understand" ], [ "body", "fact", "madam", "remain", "unfortunate" ], [ "book", "factory", "made", "remember", "unless" ], [ "born", "fail", "mail", "repair", "until" ], [ "both", "fair", "majority", "reply", "up" ], [ "bought", "fall", "make", "report", "upon" ], [ "box", "family", "man", "represent", "us" ], [ "boy", "famous", "manner", "request", "use" ], [ "bridge", "far", "many", "respectfully", "usual" ], [ "bring", "farther", "March", "responsible", "vacation" ], [ "broke", "father", "marriage", "rest", "various" ], [ "brother", "favor", "material", "restrain", "very" ], [ "brought", "feature", "matter", "result", "vessel" ], [ "build", "February", "may", "retire", "victim" ], [ "built", "feel", "May", "return", "view" ], [ "burn", "feet", "maybe", "ride", "visit" ], [ "business", "fell", "mayor", "right", "visitor" ], [ "busy", "felt", "me", "ring", "vote" ], [ "but", "few", "mean", "river", "volume" ], [ "buy", "field", "meant", "road", "wait" ], [ "by", "fifth", "measure", "room", "walk" ], [ "call", "fight", "meet", "round", "want" ], [ "came", "figure", "member", "royal", "war" ], [ "camp", "file", "men", "rule", "warm" ], [ "can", "fill", "mention", "run", "was" ], [ "cannot", "final", "mere", "running", "watch" ], [ "capture", "finally", "might", "said", "water" ], [ "car", "find", "mile", "sail", "way" ], [ "card", "fine", "mind", "salary", "we" ], [ "care", "finish", "mine", "same", "wear" ], [ "career", "fire", "minute", "Saturday", "weather" ], [ "carried", "firm", "Miss", "saw", "Wednesday" ], [ "carry", "first", "miss", "say", "week" ], [ "case", "five", "Monday", "says", "weigh" ], [ "cast", "fix", "money", "scene", "well" ], [ "catch", "flight", "month", "school", "went" ], [ "cause", "folks", "more", "sea", "were" ], [ "celebration", "follow", "morning", "search", "west" ], [ "cent", "foot", "most", "second", "what" ], [ "center", "for", "mother", "secretary", "when" ], [ "century", "foreign", "motion", "section", "where" ], [ "certain", "forenoon", "mountain", "subject", "whether" ], [ "chain", "forget", "move", "secure", "which" ], [ "change", "form", "Mr.", "see", "while" ], [ "character", "fortune", "Mrs.", "seem", "who" ], [ "charge", "forty", "much", "seen", "whole" ], [ "check", "forward", "must", "select", "whom" ], [ "chief", "found", "my", "senate", "whose" ], [ "child", "four", "name", "send", "why" ], [ "children", "fourth", "national", "sent", "wife" ], [ "Christmas", "free", "navy", "separate", "will" ], [ "church", "Friday", "near", "September", "wind" ], [ "circular", "friend", "nearly", "serious", "winter" ], [ "circumstance", "from", "necessary", "serve", "wire" ], [ "cities", "front", "need", "service", "wish" ], [ "citizen", "full", "neighbor", "session", "with" ] ]42:T1028,grade2Spelling = [ [ "lot", "after", "again" ], [ "always", "animal", "another" ], [ "ask", "away", "back" ], [ "because", "been", "before" ], [ "between", "blend", "boat" ], [ "brother", "buy", "call" ], [ "clean", "clock", "cold" ], [ "deep", "deer", "dish" ], [ "dress", "drip", "drive" ], [ "each", "eight", "eleven" ], [ "every", "family", "fast" ], [ "fight", "first", "found" ], [ "give", "goat", "goes" ], [ "grow", "happy", "help" ], [ "him", "home", "house" ], [ "just", "kind", "kiss" ], [ "line", "lion", "list" ], [ "long", "look", "loud" ], [ "mess", "might", "most" ], [ "new", "night", "nine" ], [ "only", "or", "our" ], [ "place", "plus", "pool" ], [ "read", "rest", "right" ], [ "says", "sea", "second" ], [ "seven", "shape", "sight" ], [ "sister", "slide", "slip" ], [ "song", "soon", "sound" ], [ "still", "stone", "such" ], [ "tell", "their", "them" ], [ "thing", "think", "ton" ], [ "treat", "trick", "tune" ], [ "upon", "us", "use" ], [ "well", "went", "where" ], [ "why", "winter", "wish" ], [ "write", "yard", "year" ], [ "air", "also", "there" ], [ "any", "around", "too" ], [ "barn", "bath", "twelve" ], [ "best", "better", "very" ], [ "both", "bright", "which" ], [ "cannot", "child", "work" ], [ "could", "count", "yet" ], [ "does", "don’t", "these" ], [ "drop", "drum", "tray" ], [ "end", "even", "under" ], [ "fed", "feed", "wash" ], [ "friend", "gave", "who" ], [ "good", "great", "would" ], [ "here", "high", "your" ], [ "its", "jump", "seem" ], [ "large", "light", "silly" ], [ "little", "lock", "snack" ], [ "lunch", "made", "stamp" ], [ "much", "must", "summer" ], [ "now", "off", "send" ], [ "out", "path", "sing" ], [ "put", "rabbit", "speed" ], [ "rock", "said", "state" ], [ "take", "bring ", "away " ], [ "went ", "road ", "trip" ], [ "house ", "little", "roof " ], [ "straw", "rain", "cool " ], [ "planet", "sky", "night " ], [ "money ", "wings", "birds" ], [ "beak", "close", "rest " ], [ "those", "plate", "nose" ], [ "grapes", "prize", "sad" ] ]43:[{"id":"3dd10651abd6b279d52933ff5246a29cf1d51de5eb9ebffa873f1c89be8eb11f01ba484160add7525a85efefc3752a93728c5bee58a0615342c2c3d1dd310e53","href":"https://static.observableusercontent.com/files/3dd10651abd6b279d52933ff5246a29cf1d51de5eb9ebffa873f1c89be8eb11f01ba484160add7525a85efefc3752a93728c5bee58a0615342c2c3d1dd310e53","name":"thewords-processed.csv","type":"text/csv","lastModified":1684366394753.906,"size":2373479},{"id":"b3d9d7af1eec246fe1eb696fad84068cf3ebeab43e9b541f0f5c6296dc838b480df107670dc9b7c05b725067f88b1dcf6c31ac3570864f29bc01fe4744170aa4","href":"https://static.observableusercontent.com/files/b3d9d7af1eec246fe1eb696fad84068cf3ebeab43e9b541f0f5c6296dc838b480df107670dc9b7c05b725067f88b1dcf6c31ac3570864f29bc01fe4744170aa4","name":"english.txt","type":"text/plain","lastModified":1684014608972.26,"size":2614506},{"id":"6b01fe470a37e6470b43bf97f874a04d07bcca08726c550d84f16d2957fe718a8c9eb03df8a3ba911736446d8fe4e8f5f60bd248288dcc1f54aea4f04ff06ad0","href":"https://static.observableusercontent.com/files/6b01fe470a37e6470b43bf97f874a04d07bcca08726c550d84f16d2957fe718a8c9eb03df8a3ba911736446d8fe4e8f5f60bd248288dcc1f54aea4f04ff06ad0","name":"thewords-clusters.csv","type":"text/csv","lastModified":1684366389432.785,"size":234590},{"id":"2fa7be179b5e45a9ea67d6e61d116e51b63c419db7e5b5320e7e2608d72a5de0736ba61df6a020dae848eb97cc58b93120ed3514b8f252edf869fe6c8217e800","href":"https://static.observableusercontent.com/files/2fa7be179b5e45a9ea67d6e61d116e51b63c419db7e5b5320e7e2608d72a5de0736ba61df6a020dae848eb97cc58b93120ed3514b8f252edf869fe6c8217e800","name":"EOWL-v1.1.2.zip","type":"application/zip","lastModified":1683813804333.975,"size":693146},{"id":"645bfe87d9ba4a21413163d2cfa23b0ab7bf3f44403b49737d2318eebe256cd0f17f44d3cadc51acca4e85f48bf497a27503a169670377d491b51f1f66331e05","href":"https://static.observableusercontent.com/files/645bfe87d9ba4a21413163d2cfa23b0ab7bf3f44403b49737d2318eebe256cd0f17f44d3cadc51acca4e85f48bf497a27503a169670377d491b51f1f66331e05","name":"archive.zip","type":"application/zip","lastModified":1683810120839.842,"size":2236581},{"id":"a6b72811e417adc43a164e26211801f8383bea377dddbcb07b2774920791784632c66e2c2c9b44cec4a0c01c9170ca565f26a5ab5e0c25e46fd22bc909ba3506","href":"https://static.observableusercontent.com/files/a6b72811e417adc43a164e26211801f8383bea377dddbcb07b2774920791784632c66e2c2c9b44cec4a0c01c9170ca565f26a5ab5e0c25e46fd22bc909ba3506","name":"TheWords.json","type":"application/json","lastModified":1684017318170.059,"size":1965962},{"id":"e6c28160286a6fc145dd5f454b916151623b6d5c7f3d53d61718dd3e81bfa9a055c2939045296ce5346667a70bf1261ba982a7172b1ae51bac37b8eb85705583","href":"https://static.observableusercontent.com/files/e6c28160286a6fc145dd5f454b916151623b6d5c7f3d53d61718dd3e81bfa9a055c2939045296ce5346667a70bf1261ba982a7172b1ae51bac37b8eb85705583","name":"thewords-hdbscan.csv","type":"text/csv","lastModified":1684186540877.768,"size":1351433},{"id":"020c68e99f3107a769432b70b717da0b938cf829e5339ab3e9243d4ae4181c58751d05c52f33eac0b6537c57c73595ff2a85896d1e3ec006eae28bf16266d9a5","href":"https://static.observableusercontent.com/files/020c68e99f3107a769432b70b717da0b938cf829e5339ab3e9243d4ae4181c58751d05c52f33eac0b6537c57c73595ff2a85896d1e3ec006eae28bf16266d9a5","name":"thewords-umap.csv","type":"text/csv","lastModified":1684186542183.835,"size":2722927}] 30:{"title":"This is a work in progress to construct an English Word Dictionary for Educational and game usage.","cells":[{"id":376,"value":"# This is a work in progress to construct an English Word Dictionary for Educational and game usage.\n## Looking at using AI Classify an Age Specific English Word Dictionary.\n\nCan AI be used to generate dictionaries of words based on a users age. That would reduce the chance of unknown words pulled out of a full dictionary.\n\nWith the help of [Ian Johnson](https://substack.com/profile/2410977-ian-johnson) and [Latent Interfaces](https://enjalot.substack.com/p/latent-interfaces) \n","pinned":false,"hidden":false,"mode":"md"},{"id":786,"value":"$32","pinned":false,"hidden":false,"mode":"md"},{"id":959,"value":"$33","pinned":false,"hidden":false,"mode":"ojs"},{"id":825,"value":"Words","pinned":true,"hidden":false,"mode":"ojs"},{"id":1112,"value":"thewords_clusters","pinned":true,"hidden":false,"mode":"ojs"},{"id":0,"value":"$34","pinned":false,"hidden":false,"mode":"md"},{"id":38,"value":"# basic chatgpt sorting.\n\ngroup the words based on their likelihood of being known by different age groups. \n\n Many are unknown to most people. can you group the words into age or likely hood of a person know these words. \n\nPlease present the words in quotes and separated by a comma","pinned":false,"hidden":false,"mode":"md"},{"id":270,"value":"# Word Groupings.\n\nThe best results are achieved by asking chartGPT and Bard to review each others lists. \nThis produces better results than asking just one AI\n\nI wonder how Bing would also deal with this and GPT4.\n\n---","pinned":false,"hidden":false,"mode":"md"},{"id":239,"value":"$35","pinned":false,"hidden":false,"mode":"md"},{"id":226,"value":"$36","pinned":false,"hidden":false,"mode":"md"},{"id":248,"value":"$37","pinned":false,"hidden":false,"mode":"md"},{"id":237,"value":"# other sorted ideas\n\n- By theme: This is a fun way to group words, and it can help students learn new vocabulary. For example, you could group words about animals, food, sports, or anything else that interests your students.\n\n- By sound: This is a good way to help students learn how to spell words that sound similar. For example, you could group words that have the same vowel sound, or the same consonant sound.\n\nAre there any specific linguistic or phonetic patterns that individuals should focus on at each stage to enhance their spelling abilities?","pinned":false,"hidden":false,"mode":"md"},{"id":336,"value":"The AI question\n\nCan you do the following on the word list below?\nGroup words by difficulty for appropriate age group.\nConsider word sounds, length, and spelling complexity.\nCategorize by age for increasing complexity.\n\nThe groups to sort into are. \nEmergent Spelling Stage (Ages 3-5)\nEarly Writing Stage (Ages 6 - 8)\nTransitional Spelling Stage (Ages 9-11)\nCompetent Spelling Stage (Ages 12-14)\nAdvanced Spelling Stage (Ages 15+)\n\nTest Word List:\n","pinned":false,"hidden":false,"mode":"md"},{"id":339,"value":"Emergent Spelling Stage (Ages 3-5)\n\nCOW\nCATS\nDOG\nHAT\nMEOW\nNO\nONE\nSEE\nTHE\nYOU\nEarly Writing Stage (Ages 6 - 8)\n\nAPPLE\nBEAR\nCAT\nDOG\nEGG\nFARM\nFOX\nGO\nHORSE\nJUMP\nTransitional Spelling Stage (Ages 9-11)\n\nBRANCH\nCLOUD\nDOOR\nFISH\nFRIEND\nGARDEN\nHONEY\nJUMPING\nLEAVES\nMONTH\nCompetent Spelling Stage (Ages 12-14)\n\nBEAUTIFUL\nCONTINUOUS\nDETERMINE\nEXCEPTION\nIMMEDIATE\nINCREDIBLE\nINTENSE\nINTEREST\nLABORATORY\nPOSSIBLE\nAdvanced Spelling Stage (Ages 15+):\n\nACCELERATE\nANNIHILATE\nCOMPREHENSION\nDETERMINISTIC\nEQUILIBRIUM\nFLUCTUATE\nILLUSTRATE\nINFINITESIMAL\nLABORATORY\nLUMINESCENCE\nI have grouped the words based on their length, complexity of spelling, and the sounds they make. I have also considered the age at which children typically learn to spell these words.","pinned":false,"hidden":false,"mode":"md"},{"id":1046,"value":"# Process _**words**_ to assign an age rating.\n\nI need a comma separated word list.\n\nBard didn't like the word list to be inside quotes. Bard didn't like the comma separation rule.\n\nThe prompt: \n\nI have a new word list. \nI want to Group words by difficulty to spell for appropriate age group. \nConsider word sounds, length, and spelling complexity. \nCategorize by age for increasing complexity. \nThe result in the groups will also be comma separated words. \n\nThe five groups to sort into are. \nEmergent Spelling Stage (Ages 3-5) \nEarly Writing Stage (Ages 6 - 8) \nTransitional Spelling Stage (Ages 9-11) \nCompetent Spelling Stage (Ages 12-14) \nAdvanced Spelling Stage (Ages 15+) \n\nWord list is:","pinned":false,"hidden":false,"mode":"md"},{"id":2030,"value":"# Grade to Age group\n\n- Preschool: Ages 3-4\n- Kindergarten: Age 5\n \n## Elementary school:\n- 1st grade: Ages 6-7\n- 2nd grade: Ages 7-8\n- 3rd grade: Ages 8-9\n- 4th grade: Ages 9-10\n- 5th grade: Ages 10-11\n\n## Middle school:\n- 6th grade: Ages 11-12\n- 7th grade: Ages 12-13\n- 8th grade: Ages 13-14\n\n## High school:\n- 9th grade (Freshman year): Ages 14-15\n- 10th grade (Sophomore year): Ages 15-16\n- 11th grade (Junior year): Ages 16-17\n- 12th grade (Senior year): Ages 17-18","pinned":false,"hidden":false,"mode":"md"},{"id":1071,"value":"$38","pinned":false,"hidden":false,"mode":"md"},{"id":2066,"value":"BARD\n\nEmergent Spelling Stage (Ages 3-5) \nwake\nmax\nmin\ndigital\noptimum\n\nEarly Writing Stage (Ages 6 - 8) \nawake\nmaximum\nminimize\nmaximize\noptimize\n\nTransitional Spelling Stage (Ages 9-11) \ndigitally\nwaking\nmaximizing\nmaximal\nawakening\n\nCompetent Spelling Stage (Ages 12-14) \nminimizing\nmaxi\nminimise\nmaxima\nmaximise\n\nAdvanced Spelling Stage (Ages 15+) \nminimized\noptimally\ndigitized\noptima\noptimised\nminimizes\nwakes\nawaken\nawakened\nminimalist\nmaximizes\nawoke\noptimise\nminima\noptimally\ndigitizing\noptimizes\nmaximized\nminimising\nmaximising\nmaxis\nwoken\noptimising\nmaxims\nminimised\ndigitize\nawakens\nminimalism\nminimax\ndigitised\nminim\nawakes\nminimises\nmaximised\nmaximises\nawoken\nwaked\ndigitising\nawaking\nwaken\nwakened\noptimises\nmaxwells\nmaximin\nwakeful\ndigitise\nreawakened\nreawaken\ndigitizes\nwakening\noptimate\nmaximalist\n\n\n# issue with uploading a text file to bard\n\nBard breaks the file into smaller parts and ignores instructions to only read the file and do nothing with the data...\n26 parts and only up to the c's","pinned":false,"hidden":false,"mode":"md"},{"id":1075,"value":"$39","pinned":false,"hidden":false,"mode":"md"},{"id":2060,"value":"$3a","pinned":false,"hidden":false,"mode":"md"},{"id":2095,"value":"$3b","pinned":false,"hidden":false,"mode":"md"},{"id":2102,"value":"$3c","pinned":false,"hidden":false,"mode":"md"},{"id":405,"value":"---\n# Filtered list of kaggle data\n\n It took a long time to filter this data, so I processed it once & save the result as a json.","pinned":false,"hidden":false,"mode":"md"},{"id":407,"value":"TheWords = FileAttachment(\"TheWords.json\").json() \n\n// It took a long time to filter this.\n//_.filter(Kaggle_words, obj => words_in_all.includes(obj.word))","pinned":true,"hidden":false,"mode":"ojs"},{"id":948,"value":"---\n\nThe cells below is the cluster information provided by Ian based on **TheWords** data.","pinned":false,"hidden":false,"mode":"md"},{"id":444,"value":"thewords_umap = FileAttachment(\"thewords-umap.csv\").csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":448,"value":"thewords_hdbscan = FileAttachment(\"thewords-hdbscan.csv\").csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":1041,"value":"word_clusters = d3.group(Words, d=>d.cluster)","pinned":true,"hidden":false,"mode":"ojs"},{"id":1110,"value":"thewords_clusters = FileAttachment(\"thewords-clusters.csv\").csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":950,"value":"# WORDS\n I combine **thewords_umap** and **thewords_hdbscan** into a single file. **Words** ","pinned":false,"hidden":false,"mode":"md"},{"id":795,"value":"Words = TheWords.map( (d,i) => ({word: d.word, count: +d.count, x: +thewords_umap[i].x, y: +thewords_umap[i].y, cluster: +thewords_hdbscan[i].cluster }))","pinned":true,"hidden":false,"mode":"ojs"},{"id":1120,"value":"### This is a combination of thewords-clusters and thewords-hdbscan","pinned":false,"hidden":false,"mode":"md"},{"id":1117,"value":"thewords_processed = FileAttachment(\"thewords-processed.csv\").csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":341,"value":"\n\n---\n\nThe below need better names.\n\nthe 'english words also have non works'","pinned":false,"hidden":false,"mode":"md"},{"id":381,"value":"englishWords = _.split(await FileAttachment(\"english.txt\").text(), '\\n').filter(line => line.trim() !== '' && !line.includes(' ')); // filter out words with spaces","pinned":true,"hidden":false,"mode":"ojs"},{"id":61,"value":"archive = FileAttachment(\"archive.zip\").zip() // https://www.kaggle.com/datasets/rtatman/english-word-frequency","pinned":true,"hidden":false,"mode":"ojs"},{"id":62,"value":"Kaggle_words = archive.file(\"unigram_freq.csv\").csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":929,"value":"---","pinned":false,"hidden":false,"mode":"md"},{"id":209,"value":"all_the_words = {\n\n const all_arrays = [A_words,B_words,C_words,D_words,E_words,F_words,G_words,H_words,I_words,J_words,K_words,L_words,M_words,N_words,O_words,\n P_words,Q_words,R_words,S_words,T_words,U_words,V_words,W_words,X_words,Y_words,Z_words]\n\n const combinedArray = _.flatMap(all_arrays, Object.values);\n\n return _.flattenDeep(combinedArray.map(word=>_.toArray(word))) \n} ","pinned":true,"hidden":false,"mode":"ojs"},{"id":84,"value":"eowlV112 = FileAttachment(\"EOWL-v1.1.2.zip\").zip()","pinned":true,"hidden":false,"mode":"ojs"},{"id":86,"value":"data1 = eowlV112.filenames","pinned":true,"hidden":false,"mode":"ojs"},{"id":133,"value":"A_words = eowlV112.file('EOWL-v1.1.2/CSV Format/A Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":136,"value":"B_words = eowlV112.file('EOWL-v1.1.2/CSV Format/B Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":138,"value":"C_words = eowlV112.file('EOWL-v1.1.2/CSV Format/C Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":140,"value":"D_words = eowlV112.file('EOWL-v1.1.2/CSV Format/D Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":142,"value":"E_words = eowlV112.file('EOWL-v1.1.2/CSV Format/E Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":144,"value":"F_words = eowlV112.file('EOWL-v1.1.2/CSV Format/F Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":146,"value":"G_words = eowlV112.file('EOWL-v1.1.2/CSV Format/G Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":148,"value":"H_words = eowlV112.file('EOWL-v1.1.2/CSV Format/H Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":150,"value":"I_words = eowlV112.file('EOWL-v1.1.2/CSV Format/I Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":152,"value":"J_words = eowlV112.file('EOWL-v1.1.2/CSV Format/J Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":154,"value":"K_words = eowlV112.file('EOWL-v1.1.2/CSV Format/K Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":156,"value":"L_words = eowlV112.file('EOWL-v1.1.2/CSV Format/L Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":158,"value":"M_words = eowlV112.file('EOWL-v1.1.2/CSV Format/M Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":160,"value":"N_words = eowlV112.file('EOWL-v1.1.2/CSV Format/N Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":162,"value":"O_words = eowlV112.file('EOWL-v1.1.2/CSV Format/O Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":164,"value":"P_words = eowlV112.file('EOWL-v1.1.2/CSV Format/P Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":166,"value":"Q_words = eowlV112.file('EOWL-v1.1.2/CSV Format/Q Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":168,"value":"R_words = eowlV112.file('EOWL-v1.1.2/CSV Format/R Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":170,"value":"S_words = eowlV112.file('EOWL-v1.1.2/CSV Format/S Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":172,"value":"T_words = eowlV112.file('EOWL-v1.1.2/CSV Format/T Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":174,"value":"U_words = eowlV112.file('EOWL-v1.1.2/CSV Format/U Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":176,"value":"V_words = eowlV112.file('EOWL-v1.1.2/CSV Format/V Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":178,"value":"W_words = eowlV112.file('EOWL-v1.1.2/CSV Format/W Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":180,"value":"X_words = eowlV112.file('EOWL-v1.1.2/CSV Format/X Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":96,"value":"Y_words = eowlV112.file('EOWL-v1.1.2/CSV Format/Y Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":182,"value":"Z_words = eowlV112.file('EOWL-v1.1.2/CSV Format/Z Words.csv').csv()","pinned":true,"hidden":false,"mode":"ojs"},{"id":211,"value":"---\nThe code cell below is a shortcut to make text to load all the bits from the zip file and was used above. it's a short cut so I didn't have to type or code a lot.","pinned":false,"hidden":false,"mode":"md"},{"id":104,"value":"{\n let wordFileNames =[]\n for (let i = 65; i <= 90; i++) {\n const letter = String.fromCharCode(i);\n const wordFile = `${letter}_words = eowlV112.file('EOWL-v1.1.2/CSV Format/${letter} Words.csv').csv()`\n wordFileNames.push(wordFile)\n }\n return wordFileNames\n}","pinned":false,"hidden":false,"mode":"ojs"},{"id":791,"value":"---\nMake a dataset from the words in the Kaggle data set that have words that are in both the https://github.com/meetDeveloper/freeDictionaryAPI/tree/master/meta/wordList and https://github.com/meetDeveloper/freeDictionaryAPI/tree/master/meta/wordList word lists. **words_in_all**\n\nThe resulting array is **words_in_both_datasers**\n\nI then make a new Array from the Kaggle data filtered by **words_in_both_datasers** \nThis remove most junk data from the Kaggle dataset. Note that I don't run that everytime as it is very slow, so I did it once as saved a json file of the result and load that.\n\n","pinned":false,"hidden":false,"mode":"md"},{"id":346,"value":"kwords = _.sortBy(Kaggle_words.map( d => d.word))","pinned":true,"hidden":false,"mode":"ojs"},{"id":402,"value":"words_in_all = _.intersection(words_in_both_datasers,englishWords)","pinned":true,"hidden":false,"mode":"ojs"},{"id":349,"value":"words_in_both_datasers = _.intersection(kwords,all_the_words)","pinned":true,"hidden":false,"mode":"ojs"},{"id":1090,"value":"import {Plot} from \"@observablehq/plot-0-6-7\"","pinned":true,"hidden":false,"mode":"ojs"},{"id":1955,"value":"# umm\n\nLevel 1 (Year 1 & 2 students - our Junior room):\nStudents who are spelling proficiently at level 1 will be able to spell some high frequency words (Lists 1-3) correctly.\n\nLevel 2 (Year 3 & 4 students):\nStudents who are spelling proficiently at level 2 will be able to spell most high frequency words (Lists 1-4) correctly.\n\nLevel 3 (Year 5 & 6 students):\nStudents who are spelling proficiently at level 3 will be able to spell most high frequency words (Lists 1-6) correctly.\n\nLevel 4 (Year 7 & 8 students):\nStudents who are spelling proficiently at level 4 will have few errors within high frequency words (Lists 1-7). Year 8 students should have control over the spelling of most commonly misspelt words.\n\npdf from https://www.ngatimoti.school.nz/tasman-district-primary-school.php?pid=121\n\n---\n","pinned":false,"hidden":false,"mode":"md"},{"id":1963,"value":"\nThese could be used as training data for the AI, as examples of words for the different age groups. They have a non commercial use policy. \n\nhttps://www.spelling-words-well.com/printable-spelling-lists.html\n\n","pinned":false,"hidden":false,"mode":"md"},{"id":1966,"value":"grade1 = [\n \"am\",\n \"and\",\n \"big\",\n \"bit\",\n \"but\",\n \"cat\",\n \"did\",\n \"eat\",\n \"frog\",\n \"green\",\n \"hand\",\n \"hog\",\n \"is\",\n \"like\",\n \"little\",\n \"map\",\n \"meet\",\n \"nose\",\n \"pet\",\n \"ran\",\n \"rip\",\n \"see\",\n \"six\",\n \"some\",\n \"stop\",\n \"that\",\n \"then\",\n \"try\",\n \"when\",\n \"you\"\n]","pinned":false,"hidden":false,"mode":"ojs"},{"id":1969,"value":"grade2 = [\n \"after\",\n \"animal\",\n \"away\",\n \"because\",\n \"buy\",\n \"clock\",\n \"drip\",\n \"eight\",\n \"family\",\n \"first\",\n \"goat\",\n \"happy\",\n \"home\",\n \"kind\",\n \"look\",\n \"night\",\n \"only\",\n \"plus\",\n \"rest\",\n \"sea\",\n \"shape\",\n \"slid\",\n \"soon\",\n \"their\",\n \"think\",\n \"trick\",\n \"went\",\n \"winter\",\n \"would\",\n]","pinned":false,"hidden":false,"mode":"ojs"},{"id":1972,"value":"grade3 = [\n \"across\",\n \"almost\",\n \"breakfast\",\n \"build\",\n \"carries\",\n \"circus\",\n \"color\",\n \"dinner\",\n \"doesn't\",\n \"driving\",\n \"heart\",\n \"it's\",\n \"know\",\n \"love\",\n \"maybe\",\n \"never\",\n \"really\",\n \"Saturday\",\n \"sitting\",\n \"someone\",\n \"stretch\",\n \"Sunday\",\n \"today\",\n \"together\",\n \"tooth\",\n \"true\",\n \"until\",\n \"voice\",\n \"wrong\",\n \"you're\"\n]","pinned":false,"hidden":false,"mode":"ojs"},{"id":1975,"value":"grade4 = [\n \"against\",\n \"although\",\n \"answer\",\n \"believe\",\n \"center\",\n \"chicken\",\n \"couple\",\n \"didn't\",\n \"double\",\n \"electric\",\n \"final\",\n \"fourth\",\n \"guard\",\n \"hundred\",\n \"interest\",\n \"libraries\",\n \"neighbor\",\n \"no\\none\",\n \" planet\",\n \"question\",\n \"remember\",\n \"since\",\n \"squirrel\",\n \"studying\",\n \"twenty\",\n \"useless\",\n \"weight\",\n \"worried\",\n \"written\",\n \"yourself\"\n]","pinned":false,"hidden":false,"mode":"ojs"},{"id":1978,"value":"grade5 = [\n \"actually\",\n \"business\",\n \"carefully\",\n \"consonant\",\n \"different\",\n \"eighth\",\n \"fault\",\n \"government\",\n \"information\",\n \"known\",\n \"major\",\n \"message\",\n \"neither\",\n \"opposite\",\n \"problem\",\n \"produce\",\n \"quietly\",\n \"remain\",\n \"separate\",\n \"sincerely\",\n \"slippery\",\n \"solution\",\n \"statement\",\n \"straight\",\n \"surprise\",\n \"thoughtful\",\n \"usually\",\n \"weird\",\n \"whisper\",\n \"yesterday\"\n]","pinned":false,"hidden":false,"mode":"ojs"},{"id":1981,"value":"grade6 = [\n \"accidentally\",\n \"comfortable\",\n \"creative\",\n \"denominator\",\n \"distance\",\n \"encouragement\",\n \"especially\",\n \"example\",\n \"excitement\",\n \"familiar\",\n \"fierce\",\n \"happiness\",\n \"importance\",\n \"lawyer\",\n \"marriage\",\n \"medicine\",\n \"muscle\",\n \"occur\",\n \"penalty\",\n \"purchase\",\n \"recycle\",\n \"resident\",\n \"session\",\n \"spaghetti\",\n \"strength\",\n \"temperature\",\n \"themselves\",\n \"vacuum\",\n \"vegetable\",\n \"yield\"\n]","pinned":false,"hidden":false,"mode":"ojs"},{"id":1984,"value":"grade7 = [\n \"accurate\",\n \"alternate\",\n \"association\",\n \"bizarre\",\n \"campaign\",\n \"chaperone\",\n \"competition\",\n \"consequently\",\n \"description\",\n \"elementary\",\n \"environment\",\n \"extraordinary\",\n \"fundamental\",\n \"havoc\",\n \"idol\",\n \"infamous\",\n \"irresistible\",\n \"language\",\n \"mortgage\",\n \"oasis\",\n \"parallel\",\n \"precipitation\",\n \"psychology\",\n \"recruit\",\n \"significance\",\n \"skeptical\",\n \"souvenir\",\n \"supposedly\",\n \"tournament\",\n \"unfortunately\"\n]","pinned":false,"hidden":false,"mode":"ojs"},{"id":1987,"value":"grade8 = [\n \"accommodate\",\n \"acquittal\",\n \"annoyance\",\n \"apology\",\n \"asthma\",\n \"biannual\",\n \"caricature\",\n \"collaborate\",\n \"considerable\",\n \"criticize\",\n \"diagnosis\",\n \"endeavor\",\n \"extremity\",\n \"forgery\",\n \"hazardous\",\n \"inept\",\n \"interrogate\",\n \"luncheon\",\n \"mesmerize\",\n \"negligence\",\n \"obstinate\",\n \"paralysis\",\n \"persuade\",\n \"predecessor\",\n \"questionnaire\",\n \"roommate\",\n \"scholar\",\n \"sophomore\",\n \"technically\",\n \"unique\"\n]","pinned":false,"hidden":false,"mode":"ojs"},{"id":1990,"value":"grade9 = [\n \"accomplice\",\n \"ambiguous\",\n \"authenticate\",\n \"camouflage\",\n \"chaotic\",\n \"conscientious\",\n \"defamation\",\n \"distinction\",\n \"elimination\",\n \"exaggeration\",\n \"fallacy\",\n \"grammatically\",\n \"hypocrisy\",\n \"inconsolable\",\n \"irreconcilable\",\n \"liaison\",\n \"martyr\",\n \"notoriety\",\n \"olfactory\",\n \"partiality\",\n \"philanthropist\",\n \"potpourri\",\n \"quixotic\",\n \"remembrance\",\n \"retaliate\",\n \"spasmodic\",\n \"surveillance\",\n \"technique\",\n \"uncouth\",\n \"vengeance\"\n]","pinned":false,"hidden":false,"mode":"ojs"},{"id":1993,"value":"$3d","pinned":false,"hidden":false,"mode":"ojs"},{"id":1997,"value":"$3e","pinned":false,"hidden":false,"mode":"ojs"},{"id":2000,"value":"grade12 = ['abecedarian','avoirdupois','acquiescence','amoretto','ankh','antediluvian','antipyretic','aphaeretic','banausic','beaucoup','bireme','borborygmus','boudoir','bourgeoisie','cholangitis','consanguineous','coulomb','couturier','cymotrichous','dendrochronology','dentifrice','einkorn','eleemosynary','faience','fibranne','frondescence','grissini','hegemonies','ichthyosaur','idiosyncratic','infinitesimal','interstitial','iontophoresis','jodhpurs','kakistocracy','lavaliere','ligniperdous','miasma','mitochondria','mountebank','multitudinous','narcissistic','nenuphar','neologism','oriflamme','osphresis','paraphernalia','perspicuous','psalmody','ptomaine','pulchritude','raconteur','raillery','schipperke','simulacra','truculence','unctuous','zabaglione','zinciferous','zloty ']","pinned":false,"hidden":false,"mode":"ojs"},{"id":2003,"value":"$3f","pinned":false,"hidden":false,"mode":"ojs"},{"id":2006,"value":"$40","pinned":false,"hidden":false,"mode":"ojs"},{"id":2071,"value":"trainingWords = ({\n grade1: [...grade1],\n grade2: [...grade2],\n grade3: [...grade3],\n grade4: [...grade4],\n grade5: [...grade5],\n grade6: [...grade6],\n grade7: [...grade7],\n grade8: [...grade8],\n grade9: [...grade9],\n grade10: [...grade10],\n grade11: [...grade11],\n grade12: [...grade12]\n})","pinned":true,"hidden":false,"mode":"ojs"},{"id":2058,"value":"---","pinned":false,"hidden":false,"mode":"md"},{"id":1957,"value":"\nhttps://kidspot.co.nz/school-age/spelling-list-thousand-words/\n\n\"There are two basic types of spelling word lists for students of all ages. Sight words are words that must be memorised by sight as they are troublesome to sound out, while phonics lists are lists based on common sounds.\"\n","pinned":false,"hidden":false,"mode":"md"},{"id":1959,"value":"$41","pinned":false,"hidden":false,"mode":"ojs"},{"id":2013,"value":"https://home.oxfordowl.co.uk/english/primary-spelling/spelling-year-1-age-5-6/\n\npdfs","pinned":false,"hidden":false,"mode":"md"},{"id":2015,"value":"https://www.insollave.school.nz/ \nhttps://www.insollave.school.nz/files/b9780d3798f80acd/folders/10/Spelling-List-Years-9-10.pdf\n\nhttps://www.cambridgeprimary.co.nz/ \nhttps://www.cambridgeprimary.co.nz/files/3ec2f9c0b73730d3/file_set_file/0000/0293/Level_3-Master-Spelling-Lists.pdf\n\nhttps://learningfromhome.govt.nz/","pinned":false,"hidden":false,"mode":"md"},{"id":2018,"value":"https://www.playosmo.com/kids-learning/2nd-grade-spelling-words/\n\nhas other lists too\n\n

","pinned":false,"hidden":false,"mode":"md"},{"id":2020,"value":"$42","pinned":false,"hidden":false,"mode":"ojs"}],"files":"$W43","stdlib":"1","titling":"auto"}