Patch for Java Tokenizer

Richard Dale Richard_Dale at tipitina.demon.co.uk
Fri Apr 13 07:52:48 UTC 2001


Thanks Oliver. I've commited the patch, and also regenerated tokenizer.cpp which
is also in the CVS (not needed there strictly, but doesn't do any harm).

-- Richard

On Thu, 12 Apr 2001,  Oliver Strutynski wrote:
> The following patch for the Java classparser should resolve some problems 
> with non US-ASCII identifiers in Java source files. IIRC Flex does not allow 
> the definition of Unicode tokens but the patch at least adds all characters 
> legal for Java identifiers within the range of 0x00-0xff as defined by the 
> Java Language Specification.
> 
> Bye, Oliver
> 
> 
> - patch for parts/javasupport/tokenizer.l -
> 
> @@ -50,7 +50,7 @@
>  %}
>  
>  WS           [[:blank:]\r]+
> -LETTER       [A-Za-z_~]
> +LETTER       [A-Za-z_~$\xc0-\xd6\xd8-\xf6\xf8-\xff]
>  DIGIT        [0-9]
>  NUM          {DIGIT}+
>  ID           {LETTER}+({LETTER}|{DIGIT})*

-
to unsubscribe from this list send an email to kdevelop-devel-request at kdevelop.org with the following body:
unsubscribe »your-email-address«



More information about the KDevelop-devel mailing list