KevinMidboe/linguist
1
0
Fork 0
mirror of https://github.com/KevinMidboe/linguist.git synced 2025-10-29 17:50:22 +00:00
Code Issues Packages Projects Releases Wiki Activity

Changed tokenizer number literals to be more encompassing

Browse Source 
Number literals now skips hexadecimal, and C style literals.
This commit is contained in:
Stefan Johnson
2015-02-20 14:08:39 +11:00
parent d28f5e87c0
commit 885b5aab41
2 changed files with 5 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
lib/linguist/tokenizer.rb
View File

@@ -94,7 +94,7 @@ module Linguist
end
# Skip number literals
elsif s.scan(/(0x)?\d(\d|\.)*/)
elsif s.scan(/(0x\h(\h|\.)*|\d(\d|\.)*)([uU][lL]{0,2}|([eE][-+]\d*)?[fFlL]*)/)
# SGML style brackets
elsif token = s.scan(/<[^\s<>][^<>]*>/)