feat(2024): validate and reshape generated monster data

[bagelbits]

What does this do?

Stacked on #1226. Base branch add2024Monsters-base is copy of that PR head. Retarget to main after #1226 merge.

Script output now match MonsterSchema. New test check it. CI now run on PRs to any base branch, so stacked PRs get lint + tests.

• Normalize PDF text: ability scores on one line, wrapped header lines joined, merged lines split. Write monster-text-data.normalized.txt.
• Pair text block to monster by ability scores + CR, not array position. Old way swap skills/PB for 7 monsters (giant-crab, giant-crocodile, winter-wolf, worg, allosaurus, ankylosaurus, ape).
• Reshape: numeric CR, xp, xp_in_lair, armor_class array, condition references, senses parsing, hit dice minus sign.
• Parse damage (all types, one entry each) and dc (saving throw, escape, ability check) from descriptions for traits, actions, bonus actions, reactions, legendary actions.
• Build spellcasting. List entries (48): spell lists come from stat block text, gist stop at intro line; match list to entry by ability + save DC + to-hit since PDF put some blocks inside previous block text. Single-spell casts (Invisibility, Fear, Coven Magic, Divine Aid, and similar): link spell, inherit ability/DC from main Spellcasting when text say "same spellcasting ability", per-day usage from action name. Every spell resolve against 5e-SRD-Spells.json; script throw on unknown spell or unused list. (level N version) set spell level, other parentheticals become capitalized notes.
• Clean PDF debris from entries: drop spell list lines gist parsed as entries, strip next block title from last entry, split merged entries, complete descriptions cut at page breaks from stat block text (only when gist text is exact prefix of text paragraph). 1460 entries down to 1330.
• Schema: add optional damage to ReactionSchema. Add optional spellcasting to reactions and legendary actions. Add optional skills, gear, bonus_actions to MonsterSchema. Omit skills/gear when source say None.
• Split script into modules: monsterText.mjs (normalize, parse blocks, pair to monsters), monsterEntries.mjs (damage, dc, debris cleanup), monsterSpellcasting.mjs, monsterCommon.mjs. Output byte-identical before and after split.
• Structure all 178 Multiattack entries: multiattack_type, actions, action_options. Same Choice shape as 2014 and existing 2024 monsters. Attack type from the monster's own action (melee/ranged/special), or the spell's attack_type for casts. Description text unchanged.
• New convention for "any combination": inside a Choice, an action option count is the most times that option can be picked. "Three attacks, Claw or Tail in any combination" = choose: 3, Claw count: 3, Tail count: 3. Replacements join the choice (count = attacks replaced). No existing data use count > 1 inside choose > 1, so this is new. Please check it fits API consumers.
• Split form monsters like 2014: werebear, wereboar, wererat, weretiger, werewolf into human/hybrid/animal, vampire into vampire/bat/mist. 329 monsters become 341. Same index, name and image as 2014, linked by forms. Entries tagged "Form Only" go only to their forms (tag removed), untagged go to every form. Multiattack options pruned to actions the form has. Size from Shape-Shift. Speed from text Speed line (gist had animal-form value, e.g. werewolf 40 ft. for every form) or from Shape-Shift for vampire bat and mist. Human and vampire form keep base size "Medium or Small".
• Merge fake entries gist made from tail of Failure:/Success: lines (lycanthrope curse, steam mephit Steam Breath).
• Regenerate 5e-SRD-Monsters-New.json.

How was it tested?

New src/2024/tests/monsterGeneration.test.ts. Run script into temp dir, no overwrite of real files. Check: count + unique index, schema, hit dice format, passive perception, sense format, XP, PB vs CR, skill bonus = mod + PB or 2 x PB, every save DC and damage roll in description present in output, every spell cast has valid spell URL, no spell list entries or unterminated descriptions. Every Multiattack must be structured and simple counts must round trip. Forms split, linked and pruned; werewolf human/wolf entries and speeds checked. Full suite 106 pass.

Known gaps

• armor_class.type is guess: gear = armor, no gear = natural. Gist has no type.
• spell save DC not put in dc. It live in spellcasting.dc.
• Dryad Multiattack read as one choice of Vine Lash, Thorn Burst or Charm Monster. Text say "and it can use Spellcasting" so could mean attack plus cast.
• Clay golem Multiattack condition ("if it used Hasten this turn") only in Choice desc, not structured.
• components_required computed from text: "no Material components" give ["V","S"].
• Reference adult-blue-dragon (5e-SRD-Monsters.json) has extra acid-arrow and modifier: 5. Book text has neither. Output follow book text.
• Charmed (with Mind Blank) on archmage become plain charmed.
• Escape DC and first-named ability of check DC map to one ability. Book allow choice.
• shambling-mound and giant-frog Stealth match book, not mod + PB. Listed as quirks in test.
• Mist form gets every untagged entry (Charm, legendary actions, traits) since tags followed strictly. Book say mist form can't take actions.
• Mimic Adhesive (Object Form Only) keeps tag. Not split in 2014.
• Some words keep gist compound artifacts like 5-footwide.
• Merged-entry split also cover (... Form Only) headings (wererat Hand Crossbow).

Is there a Github issue this is resolving?

NA

Did you update the docs in the API? Please link an associated PR if applicable.

No

🤖 Generated with Claude Code