Exclude prepositions during tokenization #510

Open
opened 2026-05-31 01:14:17 -07:00 by scion · 0 comments
Owner

The tokenizer should just strip out "the" and the most common prepositions. Example:
GET THE DAGGER FROM THE BACKPACK -> GET DAGGER BACKPACK
PUT THE DAGGER IN THE BARREL -> PUT DAGGER BARREL
KILL THE GOBLIN -> KILL GOBLIN

This way the parsing is much more flexible for people who speak English but aren't familiar with the stunted mini-English used by traditional MUD commands.

It needs to not do this for syntaxes with QUOTED_WORDS though:
SAY I went to the store -> SAY "I went store"

The tokenizer should just strip out "the" and the most common prepositions. Example: GET THE DAGGER FROM THE BACKPACK -> GET DAGGER BACKPACK PUT THE DAGGER IN THE BARREL -> PUT DAGGER BARREL KILL THE GOBLIN -> KILL GOBLIN This way the parsing is much more flexible for people who speak English but aren't familiar with the stunted mini-English used by traditional MUD commands. It needs to not do this for syntaxes with QUOTED_WORDS though: SAY I went to the store -> SAY "I went store"
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
agony-forge/agonyforge#510
No description provided.