Skip to content

Commit 1874c2e

Browse files
ayman-sigmaclaude
andcommitted
Restore stashed tokenizer.rs changes (tokenize_lt test)
Applied stashed changes from before the merge: adds a tokenize_lt test case for 'SELECT a < -5' with geometric types dialects. Merged into the upstream's existing tokenize_lt function to avoid duplication. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
1 parent 0a46972 commit 1874c2e

File tree

1 file changed

+13
-0
lines changed

1 file changed

+13
-0
lines changed

src/tokenizer.rs

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4613,5 +4613,18 @@ mod tests {
46134613
Token::make_word("b", None),
46144614
],
46154615
);
4616+
all_dialects_where(|d| d.supports_geometric_types()).tokenizes_to(
4617+
"SELECT a < -5",
4618+
vec![
4619+
Token::make_keyword("SELECT"),
4620+
Token::Whitespace(Whitespace::Space),
4621+
Token::make_word("a", None),
4622+
Token::Whitespace(Whitespace::Space),
4623+
Token::Lt,
4624+
Token::Whitespace(Whitespace::Space),
4625+
Token::Minus,
4626+
Token::Number("5".to_string(), false),
4627+
],
4628+
);
46164629
}
46174630
}

0 commit comments

Comments
 (0)