915 Commits

Author SHA1 Message Date
Joshua Peek e5d302459f Fix tokenzing empty strings 2012-07-24 11:49:29 -05:00
Joshua Peek 53300ca581 Add brackets to tokens 2012-07-24 11:28:27 -05:00
Joshua Peek f5705eaf38 Parse float tokens 2012-07-24 11:23:06 -05:00
Joshua Peek 059f661eb6 Rename Max/MSP to Max 2012-07-24 11:03:09 -05:00
Joshua Peek 6ac9138aed Remove pathname
Closes #207
2012-07-23 16:50:30 -05:00
Joshua Peek fca6a9a9e1 Fix md5 nesting 2012-07-23 16:19:56 -05:00
Joshua Peek 7b6caa0f6c Rename samples subdirectories 2012-07-23 15:52:49 -05:00
Joshua Peek 5cda67530d Seperate test file for samples 2012-07-23 13:55:30 -05:00
Joshua Peek 6842044b52 Store md5 in samples db 2012-07-23 13:50:35 -05:00
Joshua Peek bf944f6d1a Make classify a function on the Classifier 2012-07-23 13:47:15 -05:00
Joshua Peek b9779e805e Move outdated check to samples 2012-07-23 13:21:30 -05:00
Joshua Peek 80e8ee7ce6 Rename Sample -> Samples 2012-07-23 13:15:27 -05:00
Joshua Peek 0c9a947f39 Load classifer db into sample data hash 2012-07-23 13:13:52 -05:00
Joshua Peek 3172bf5b46 Remove gc for now 2012-07-23 12:23:20 -05:00
Joshua Peek 5b28336d56 Move db verification into tests 2012-07-23 12:21:26 -05:00
Joshua Peek b7f58d96cb Compare md5s of dbs 2012-07-23 12:17:32 -05:00
Joshua Peek d6fb95b06f Add nested md5 digest 2012-07-23 12:13:08 -05:00
Joshua Peek 36da52e383 Move specific filename samples into their own dir 2012-07-20 17:20:45 -05:00
Joshua Peek 144655f2c5 Require explicit primary_extension 2012-07-20 16:54:49 -05:00
Joshua Peek eb2c07e511 Sample returns simple hash objects 2012-07-20 16:17:37 -05:00
Joshua Peek 7292bdc180 Change Classifier to accept language name Strings 2012-07-20 15:52:27 -05:00
Joshua Peek bbc5225086 Pending samples work now 2012-07-20 15:36:48 -05:00
Joshua Peek 2637d8dc55 Add tokenize helper to Tokenize class 2012-07-20 15:14:58 -05:00
Joshua Peek 175d4244c2 Extract single and multi line comment parser 2012-07-20 15:06:21 -05:00
Joshua Peek d063089430 Add coq comments 2012-07-20 14:45:19 -05:00
Joshua Peek 5521dd08a0 Move test fixtures to samples/ 2012-06-22 10:09:24 -05:00
Joshua Peek 2b712dc790 Guard against classify nil data 2012-06-21 11:47:32 -05:00
Joshua Peek 540f2a0941 More matlab samples 2012-06-21 10:44:31 -05:00
Joshua Peek 497da86262 Strip tex and matlab leading inline comments 2012-06-21 10:38:28 -05:00
Joshua Peek 4b9b8a5058 Remove matlab file with bogus keywords 2012-06-21 10:25:30 -05:00
Joshua Peek 5cdd5e206c Improve operator tokenizing 2012-06-20 17:16:53 -05:00
Joshua Peek 516a220d9f Verify classifer counts 2012-06-20 15:48:46 -05:00
Joshua Peek f68e94f181 Skip number literals 2012-06-20 11:26:14 -05:00
Joshua Peek e9eae4e008 Skip pending tests 2012-06-20 11:19:02 -05:00
Joshua Peek e33d8f3685 Merge branch 'master' into bayesian 2012-06-20 11:18:47 -05:00
Joshua Peek a10e52a3c2 Revert removing some fixtures 2012-06-20 11:18:16 -05:00
Joshua Peek 645a87d02b Remove dead fixture test 2012-06-19 16:34:13 -05:00
Joshua Peek c114d710f8 Test classifier on ambiguous languages 2012-06-19 16:32:56 -05:00
Joshua Peek c804d04072 Merge branch 'master' into bayesian 2012-06-19 16:29:01 -05:00
Joshua Peek 6113e6d548 Remove ambiguous obj-c header example 2012-06-19 16:28:34 -05:00
Joshua Peek fdd81ce0be Merge branch 'master' into bayesian 2012-06-19 16:26:43 -05:00
Joshua Peek 4ea1e8aece Remove ambiguous c header example 2012-06-19 16:26:39 -05:00
Joshua Peek fcd8c089dc Add some more c header examplesgst 2012-06-19 16:25:09 -05:00
Joshua Peek 9d555862c3 Merge branch 'master' into bayesian 2012-06-19 15:02:02 -05:00
Joshua Peek 79a473cf58 Add some more apex and openedge fixtures 2012-06-19 15:01:58 -05:00
Joshua Peek ddf3ec4a5b Warn if classifier instance is out of date 2012-06-19 14:32:04 -05:00
Joshua Peek d566b35020 Allow classifer languages to be scoped 2012-06-19 14:21:42 -05:00
Joshua Peek 8f85a447de Allow tokens to be passed directly to classify 2012-06-19 14:17:27 -05:00
Joshua Peek d5fa8cbcb7 Refactor tokenizer test helper 2012-06-19 13:12:17 -05:00
Joshua Peek ecb2397e59 Merge branch 'master' into bayesian 2012-06-19 11:43:48 -05:00