almibe / gaze Goto Github PK

Be able to create a language that converts a String of the character '6' to a List of integers consisting of the Int value 6.
This should also provide an error when a non-6 is found that presents both the offset and the illegal value.

Not sure if this is actually worth doing but might be good to add back in eventually.
Maybe add a case like GazeResult::Ignore

For prosperity here's the original code using an older version of the api.

/// A Step that ignores all chars passed in.
pub struct IgnoreAll<'a>(pub HashSet<&'a str>);

impl Tokenizer<()> for IgnoreAll<'_> {
    fn attempt(&self, gaze: &mut Gaze) -> Result<(), GazeErr> {
        //TODO this will need to be rewritten once handle Unicode better
        loop {
            let next_value = gaze.peek();
            match next_value {
                None => {
                    return Ok(());
                }
                Some(c) => {
                    if self.0.contains(c) {
                        gaze.next();
                    } else {
                        return Ok(());
                    }
                }
            }
        }
    }
}

Gradle, kotest, arrow, failing test.

This will help with things like matching set strings since rakkoon will know when to stop and tell the difference between words like let and letter.

Build off of Ints but now allow multi character ints that are split by any whitespace.

1 2 2342 2424 24241
234253463

7

should result in

List(1,2,2342,2424,24241,23425363,7)

• #39
• #33
• #31
• #41
• #42

This is get rid of the possibility of weird states like there being no more input and the Tokenizer's attempt function returns Next or .MatchAndTake.

Build on what was done with Sixes but allow for all Ints.

So "12345" should result in List(1,2,3,4,5)