Bash Scanner

[korny]

Work in progress. Lacks tests. Solves #19, might be related to #115.

[wikimatze]

When will this be merged? I'm using @kou rabbit plugin for presentations and it would be nice to use backticks for highlightning code.

I think that I'm not the only person waiting for this.

[korny]

It cannot be merged because it's broken. It's not my code, it was a contribution. As always, we need test code examples.

Currently, when I run the tests:

$ new=bash.* ruby test/scanners/suite.rb

Loaded suite CodeRay::Scanners
Started

    >> Testing bash script scanner <<

Random test - finished.
Loading examples in test/scanners/bash/*.in.sh...4 examples found.

              erb_bash    138 B   incremental, shuffled, new test, identity, highlighting, too small.
               example  456.5 KiB incremental, shuffled, complete...scanning.../Users/murphy/ruby/coderay/lib/coderay/scanners/bash.rb:246: warning: character class has duplicated range: /[^\)\$RubyWrapper\\]+/
/Users/murphy/ruby/coderay/lib/coderay/scanners/bash.rb:246: warning: character class has duplicated range: /[^\)\$RubyWrapper\\]+/
/Users/murphy/ruby/coderay/lib/coderay/scanners/bash.rb:246: warning: character class has duplicated range: /[^\)\$RubyWrapper\\]+/
/Users/murphy/ruby/coderay/lib/coderay/scanners/bash.rb:246: warning: character class has duplicated range: /[^\)\$RubyWrapper\\]+/
/Users/murphy/ruby/coderay/lib/coderay/scanners/bash.rb:246: warning: character class has duplicated range: /[^\)\$RubyWrapper\\]+/
/Users/murphy/ruby/coderay/lib/coderay/scanners/bash.rb:246: warning: character class has duplicated range: /[^\)\$RubyWrapper\\]+/
/Users/murphy/ruby/coderay/lib/coderay/scanners/bash.rb:246: warning: character class has duplicated range: /[^\)\$RubyWrapper\\]+/
/Users/murphy/ruby/coderay/lib/coderay/scanners/bash.rb:246: warning: character class has duplicated range: /[^\)\$RubyWrapper\\]+/
/Users/murphy/ruby/coderay/lib/coderay/scanners/bash.rb:246: warning: character class has duplicated range: /[^\)\$RubyWrapper\\]+/
/Users/murphy/ruby/coderay/lib/coderay/scanners/bash.rb:246: warning: character class has duplicated range: /[^\)\$RubyWrapper\\]+/
/Users/murphy/ruby/coderay/lib/coderay/scanners/bash.rb:246: warning: character class has duplicated range: /[^\)\$RubyWrapper\\]+/
/Users/murphy/ruby/coderay/lib/coderay/scanners/bash.rb:246: warning: character class has duplicated range: /[^\)\$RubyWrapper\\]+/
/Users/murphy/ruby/coderay/lib/coderay/scanners/bash.rb:246: warning: character class has duplicated range: /[^\)\$RubyWrapper\\]+/
/Users/murphy/ruby/coderay/lib/coderay/scanners/bash.rb:246: warning: character class has duplicated range: /[^\)\$RubyWrapper\\]+/
encoding...Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell, :string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:shell, :string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :string, :shell].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :string, :string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string, :string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :string, :string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string, :string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :string, :string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string, :string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :string, :string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string, :string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :string, :string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string, :string, :string].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string, :string].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string, :string].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:string, :shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string, :string].
Malformed token stream: Trying to close a token group (:string) that is not open. Open are: [:shell].
Malformed token stream: Trying to close a token group (:shell) that is not open. Open are: [:string].
E
Finished in 5.550383 seconds.

  1) Error:
test_ALL(Bash):
CodeRay::Scanners::Scanner::ScanError: 

***ERROR in scanner.rb:333:in `raise_inspect': unknown token kind :bin (text was "&") (after  tokens)

tokens:


current line: 21  column: 36  pos: 502
matched: "&"  state: "Error in CodeRay::Scanners::Bash#scan_tokens, initial state was: :initial"
bol?: false,  eos?: false


surrounding code:
"[[ -n \"${current_bundle}\" ]] &"  ~~  "& builtin command -v bundle >/"


***ERROR***


    /Users/murphy/ruby/coderay/lib/coderay/encoders/debug_lint.rb:22:in `text_token'
    /Users/murphy/ruby/coderay/lib/coderay/scanners/bash.rb:257:in `scan_tokens'
    /Users/murphy/ruby/coderay/lib/coderay/scanner.rb:190:in `tokenize'
    /Users/murphy/ruby/coderay/lib/coderay/encoder.rb:85:in `encode'
    /Users/murphy/ruby/coderay/test/scanners/coderay_suite.rb:379:in `complete_test'
    /Users/murphy/ruby/coderay/test/scanners/coderay_suite.rb:280:in `example_test'
    /Users/murphy/ruby/coderay/test/scanners/coderay_suite.rb:208:in `block (2 levels) in examples_test'
    /Users/murphy/ruby/coderay/test/scanners/coderay_suite.rb:187:in `each'
    /Users/murphy/ruby/coderay/test/scanners/coderay_suite.rb:187:in `block in examples_test'
    /Users/murphy/ruby/coderay/test/scanners/coderay_suite.rb:124:in `block in dir'
    /Users/murphy/ruby/coderay/test/scanners/coderay_suite.rb:123:in `chdir'
    /Users/murphy/ruby/coderay/test/scanners/coderay_suite.rb:123:in `dir'
    /Users/murphy/ruby/coderay/test/scanners/coderay_suite.rb:173:in `examples_test'
    /Users/murphy/ruby/coderay/test/scanners/coderay_suite.rb:161:in `block in test_ALL'
    /Users/murphy/.rvm/rubies/ruby-2.0.0-p353/lib/ruby/2.0.0/benchmark.rb:296:in `realtime'
    /Users/murphy/ruby/coderay/test/scanners/coderay_suite.rb:158:in `test_ALL'

1 tests, 0 assertions, 0 failures, 1 errors

[wikimatze]

Hi @korny is there a way that we can pair on a remote session with vim and tmux to fix that problem? When I run the tests of the original repo on my machine with rake test:units or rake test:functional everything is green. But running rake test:scanners gives me the following:

Cloning into 'test/scanners'...
remote: Reusing existing pack: 1037, done.
remote: Total 1037 (delta 0), reused 0 (delta 0)
Receiving objects: 100% (1037/1037), 10.59 MiB | 888.00 KiB/s, done.
Resolving deltas: 100% (483/483), done.
Checking connectivity... done
/home/wikimatze/.rubies/ruby-2.1.0/bin/ruby test/scanners/suite.rb
Loaded suite CodeRay::Scanners
Started

    >> Skipping tests for bash, no scanner found <<
.
    >> Testing C scanner <<

Random test - finished.
Loading examples in test/scanners/c/*.in.c...7 examples found.

                 elvis    370 B   incremental, shuffled, complete, identity, highlighting, too small.
                 empty      0 B   incremental, -skipped- complete, identity, highlighting, too small.
                 error      4 B   incremental, -skipped- complete, identity, highlighting, too small.
                error2      3 B   incremental, -skipped- complete, identity, highlighting, too small.
           open-string      1 B   incremental, -skipped- complete, identity, highlighting, too small.
                  ruby    2.2 MiB incremental, shuffled, complete, identity, highlighting, in kTok/s:  761 scan +  473 encode =  292 both,  364 stream, in kB/s:  2779 /  1330.
               strange    3.7 KiB incremental, shuffled, complete, identity, highlighting, in kTok/s:  559 scan +  252 encode =  174 both,  203 stream, in kB/s:  3049 /  1104.

Average speed for C scanner: 2779 kB/s scanning / 1330 kB/s highlighting to HTML page.
Finished in 8.48s.

So you are trying to implement the bash scanner, right?

Kindly regards

Matthias