Commit Graph

501 Commits

Author SHA1 Message Date
Joshua Peek
f68e94f181 Skip number literals 2012-06-20 11:26:14 -05:00
Joshua Peek
cb70572163 Rebuild classifier db 2012-06-20 11:19:36 -05:00
Joshua Peek
4484011f08 Switch to log probabilities to avoid float underflows 2012-06-19 16:33:29 -05:00
Joshua Peek
9810c693c3 Rebuild classifier db 2012-06-19 16:30:46 -05:00
Joshua Peek
176f6483d0 Ensure token probability is less than 1.0 2012-06-19 15:26:56 -05:00
Joshua Peek
ee6650f83f Fix doc typo 2012-06-19 15:23:23 -05:00
Joshua Peek
3fee3ac549 Rebuild classifier db 2012-06-19 15:23:06 -05:00
Joshua Peek
ddf3ec4a5b Warn if classifier instance is out of date 2012-06-19 14:32:04 -05:00
Joshua Peek
4d5c9b951b Rebuild classifier 2012-06-19 14:22:42 -05:00
Joshua Peek
d566b35020 Allow classifer languages to be scoped 2012-06-19 14:21:42 -05:00
Joshua Peek
8f85a447de Allow tokens to be passed directly to classify 2012-06-19 14:17:27 -05:00
Joshua Peek
d0691988a9 More classifier docs 2012-06-19 14:15:10 -05:00
Joshua Peek
d9ecbf0c24 Doc sample class 2012-06-19 13:30:28 -05:00
Joshua Peek
555573071e More tokenizer docs 2012-06-19 13:09:23 -05:00
Joshua Peek
ecb2397e59 Merge branch 'master' into bayesian 2012-06-19 11:43:48 -05:00
Michael Ficarra
11166911dc Recognise that PEG.js-generated parsers are in fact generated 2012-06-19 11:18:51 -05:00
Joshua Peek
12cfab6d50 Rebuild classifier data 2012-06-08 16:04:52 -05:00
Joshua Peek
8a75d4d208 GC classifier db 2012-06-08 16:04:43 -05:00
Joshua Peek
fd8b70ffa4 Rebuild classifier data 2012-06-08 15:49:35 -05:00
Joshua Peek
543922c68a Rebuild classifier data 2012-06-08 14:48:04 -05:00
Joshua Peek
6f6dd8bc38 Improve tokenizing sgml tags 2012-06-08 14:46:16 -05:00
Joshua Peek
8351d55c56 Don't crash if classifier data is missing 2012-06-08 14:46:06 -05:00
Joshua Peek
9ecab364d1 Dump classifier results 2012-06-08 14:13:26 -05:00
Joshua Peek
0172623061 Add sample gathering class 2012-06-08 13:51:49 -05:00
Joshua Peek
e5ae9c328b Use language name as hash key 2012-06-08 13:43:57 -05:00
Joshua Peek
f747b49347 Add simple classifier 2012-06-07 17:10:28 -05:00
Joshua Peek
e0cbe815a3 Add basic Tokenizer 2012-06-07 14:55:11 -05:00
Joshua Peek
5f84b7420a Set primary extension for Prolog 2012-06-07 10:29:04 -05:00
Joshua Peek
602a79e4db Give Apex primary cls extension 2012-06-07 10:27:39 -05:00
Joshua Peek
3ea44745b3 Give .t to Turing 2012-06-07 10:25:17 -05:00
Joshua Peek
dc25007770 Add primary extension for Rebol 2012-06-07 10:21:45 -05:00
Joshua Peek
b5ac75f585 Add fallback extension for Coq 2012-06-07 10:21:02 -05:00
Joshua Peek
6efdaed2ea Nicer Language inspect 2012-06-07 10:19:26 -05:00
Joshua Peek
5d2e9e04a9 Raise don't warn 2012-06-07 10:16:25 -05:00
Joshua Peek
a3bca44604 Prevent multiple overrides 2012-06-07 10:14:28 -05:00
Joshua Peek
0b73b11f63 Suppress Xcode Storyboards 2012-06-06 23:50:03 -05:00
Rob Sanheim
1c7b8ebe71 Make colorize safer:
- don't try to colorize blobs that have a high ratio of
    long lines -- these are most likely minified files or something else
    strange that will blow up Pygments.rb
  - re github/github#3938
2012-05-21 11:33:01 -05:00
Peter Waller
e76c4dbc8c langauges.yml: Add python syntax highlighting to waf's wscript files 2012-05-10 15:47:27 +02:00
Joshua Peek
285c9b4c60 Fix xslt mime type 2012-05-09 10:59:00 -05:00
Joshua Peek
2cbf428176 Use XSLT lexer 2012-05-09 10:41:11 -05:00
Joshua Peek
2729f2200d Fix 1.9 string grep 2012-05-09 09:58:55 -05:00
Joshua Peek
35fe44549e Fix empty .m file 2012-05-09 09:52:14 -05:00
Andrew D. Horchler
354e1fc85e More robust heuristics for .m files and 3 new Matlab tests. Support for Obj-C detection fully intact; all tests pass. Detection of Obj-C keywords @implementation, @property, @interface, and @synthesize removed to avoid possible conflicts with user-created Matlab function handles. Only @end is needed, which is not valid in Matlab. Matlab class files supported. Comments preceded by whitespace detected for Obj-C and Matlab.
Signed-off-by: Andrew D. Horchler <adh9@case.edu>
2012-05-08 18:31:18 -04:00
Daniel Micay
be42a8411b add detection for Arch Linux PKGBUILDs 2012-05-08 07:39:48 -04:00
Joshua Peek
aa7c8497b1 Merge pull request #151 from aseemk/streamlinejs-support
Add ._js & ._coffee extensions for Streamline.js.
2012-05-07 19:44:14 -07:00
Joshua Peek
a9e1f3822f Merge pull request #160 from bakkdoor/master
Added Fakefile to Fancy's filenames list
2012-05-07 19:41:37 -07:00
Joshua Peek
774f776ab4 Merge pull request #161 from BaiGang/master
Add .pm6 to  Perl extensions for Perl6
2012-05-07 19:39:43 -07:00
Joshua Peek
b618539c8b Ensure ext/ dir isn't ignored 2012-05-05 21:39:41 -05:00
BAI Gang
9e995fb3e5 Added .pm6 to Perl extensions. Conventionally, some Perl6 modules use pm6 as extension to differentiate from the currently common Perl 5 modules. 2012-05-02 13:01:48 +08:00
Vicent Martí
4d984e9622 Colorize all files, even if they are generated 2012-04-29 16:01:02 -07:00