KevinMidboe/linguist
1
0
Fork 0
mirror of https://github.com/KevinMidboe/linguist.git synced 2025-10-29 17:50:22 +00:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #2716 from github/faster-string-tokenizer

Browse Source 
Use negative lookbehind when tokenizing string literals
This commit is contained in:
Arfon Smith
2015-11-05 08:40:34 -08:00
parent 04f981eeac fea8bb21a0
commit d24677adbb
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
lib/linguist/tokenizer.rb
View File

@@ -86,13 +86,13 @@ module Linguist
if s.peek(1) == "\"" if s.peek(1) == "\""
s.getch s.getch
else else
s.skip_until(/[^\\]"/) s.skip_until(/(?<!\\)"/)
end end
elsif s.scan(/'/) elsif s.scan(/'/)
if s.peek(1) == "'" if s.peek(1) == "'"
s.getch s.getch
else else
s.skip_until(/[^\\]'/) s.skip_until(/(?<!\\)'/)
end end
# Skip number literals # Skip number literals