3

I'm trying to figure out how to terminate a repetition of words using a keyword. An example:

class CAQueryLanguage extends JavaTokenParsers {
    def expression = ("START" ~ words ~ "END") ^^ { x =>
        println("expression: " + x);
        x
    }
    def words = rep(word) ^^ { x =>
        println("words: " + x)
        x
    }
    def word = """\w+""".r
}

When I execute

val caql = new CAQueryLanguage
caql.parseAll(caql.expression, "START one two END")

It prints words: List(one, two, END), indicating the words parser has consumed the END keyword in my input, leaving the expression parser unable to match. I would like END to not be matched by words, which will allow expression to successfully parse.

Landon Kuhn
  • 76,451
  • 45
  • 104
  • 130
  • 1
    JavaTokenParsers does not distinguish between identifiers and keywords. I think agilefall's answer is what you need. – Germán Oct 07 '09 at 00:53

1 Answers1

4

Is this what you are looking for?

import scala.util.parsing.combinator.syntactical._

object CAQuery extends StandardTokenParsers {
    lexical.reserved += ("START", "END")
    lexical.delimiters += (" ")

    def query:Parser[Any]= "START" ~> rep1(ident) <~ "END"

    def parse(s:String) = {
       val tokens = new lexical.Scanner(s)
       phrase(query)(tokens)
   }   
}

println(CAQuery.parse("""START a END"""))       //List(a)
println(CAQuery.parse("""START a b c END"""))   //List(a, b, c)

If you would like more details, you can check out this blog post

agilefall
  • 3,876
  • 3
  • 31
  • 27