Error when processing csv

[gvishal]

I modified the code to read from a csv file. Every line has around 3k n-grams from a single article. But, it fails with the following error. Any ideas how to fix it?

java.lang.AssertionError: assertion failed
at scala.Predef$.assert(Predef.scala:156)
at index.MentEntsFreqIndexWrapper.computeCandidatesForOneName(MentEntsFreqIndexWrapper.scala:57)
at index.MentEntsFreqIndexWrapper.containsMention(MentEntsFreqIndexWrapper.scala:67)
at console_el.ConsoleEntityLinking$$anonfun$extractInputVectors$3.apply(ConsoleEntityLinking.scala:72)
at console_el.ConsoleEntityLinking$$anonfun$extractInputVectors$3.apply(ConsoleEntityLinking.scala:71)
at scala.collection.immutable.Range.foreach(Range.scala:160)
at console_el.ConsoleEntityLinking.extractInputVectors(ConsoleEntityLinking.scala:71)
at console_el.ConsoleEntityLinking.EntityLinkingAPI(ConsoleEntityLinking.scala:127)
at console_el.ConsoleEntityLinking.batchProcessCsvNgrams(ConsoleEntityLinking.scala:200)
at el.EL_LBP_Spark$.main(EL_LBP_Spark.scala:111)
at el.EL_LBP_Spark.main(EL_LBP_Spark.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at scala.reflect.internal.util.ScalaClassLoader$$anonfun$run$1.apply(ScalaClassLoader.scala:70)
at scala.reflect.internal.util.ScalaClassLoader$class.asContext(ScalaClassLoader.scala:31)
at scala.reflect.internal.util.ScalaClassLoader$URLClassLoader.asContext(ScalaClassLoader.scala:101)
at scala.reflect.internal.util.ScalaClassLoader$class.run(ScalaClassLoader.scala:70)
at scala.reflect.internal.util.ScalaClassLoader$URLClassLoader.run(ScalaClassLoader.scala:101)
at scala.tools.nsc.CommonRunner$class.run(ObjectRunner.scala:22)
at scala.tools.nsc.JarRunner$.run(MainGenericRunner.scala:13)
at scala.tools.nsc.CommonRunner$class.runAndCatch(ObjectRunner.scala:29)
at scala.tools.nsc.JarRunner$.runJar(MainGenericRunner.scala:25)
at scala.tools.nsc.MainGenericRunner.runTarget$1(MainGenericRunner.scala:69)
at scala.tools.nsc.MainGenericRunner.run$1(MainGenericRunner.scala:87)
at scala.tools.nsc.MainGenericRunner.process(MainGenericRunner.scala:98)
at scala.tools.nsc.MainGenericRunner$.main(MainGenericRunner.scala:103)
at scala.tools.nsc.MainGenericRunner.main(MainGenericRunner.scala)

[gvishal]

I removed the assertion that was failing to get it working for now.

[octavian-ganea]

That assertion makes sure that the head of the sorted list of entity candidates is also the entity with the highest rho score. What I suspect is that you have more than one entity with the same highest score, in which case it will fail. If that's the case, then you can remove the assertion. Otherwise, you might want to print the list of candidates to understand what's going on.

[gvishal]

Yep! I removed it for the time being.