tokenizer.l compile errors

[Caleb Tennis]

Roberto,

I get a compile error with your new version of tokenizer.l:

./tokenizer.l:48: previous declaration of 'int yywrap()' with C++ linkage

and the normal slew of flex generated warnings.

Caleb