Extracted from Pike v7.8 release 352 at 2012-06-25.
pike.ida.liu.se
[Top]

Method tokenize()


Method tokenize

array(array(string)|string) tokenize(string code)

Description

Tokenize a string of Pike tokens.

Returns

Returns an array with Pike-level tokens and the remainder (a partial token), if any.


Method tokenize

array(array(string)|string) tokenize(string code)

Description

Tokenize a string of C tokens.

Returns

Returns an array with C-level tokens and the remainder (a partial token), if any.