5 Commits

Include renames

Author	SHA1	Message	Date
Gani Georgiev	01e8c0f9f7	[#3616] fixed tokenizer whitespace characters trimming	2023-10-27 15:19:06 +03:00
Gani Georgiev	f3bcd7d3df	added tokenizer.IgnoreParenthesis() to allow ignoring the parenthesis characters boundary checks	2023-09-17 12:14:57 +03:00
Gani Georgiev	a07f67002f	added view collection type	2023-02-18 19:33:42 +02:00
Gani Georgiev	f475967a4a	updated default tokenizer separators	2023-02-06 16:30:47 +02:00
Gani Georgiev	23dfa9c634	added generic tokenizer helper	2023-02-05 20:59:17 +02:00