dmitrykey / luke Goto Github PK

View Code? Open in Web Editor NEW

This project forked from sonarme/luke

1.5K 1.5K 353.0 52.01 MB

This is mavenised Luke: Lucene Toolbox Project

License: Apache License 2.0

Shell 0.05% Java 99.81% Batchfile 0.03% HTML 0.12%

analysis elasticsearch indexing lucene solr toolbox

luke's People

Contributors

Stargazers

Watchers

Forkers

pascaldimassimo pombredanne apsaltis sidarali anderlew brodycai mrtrin aksanghai lewismc boudou lipusz noobthinker sizhaoliu carschno work0120 drh0534 jbrodo s4ke funkyyang manuelb zhanggang807 yutaoxu markande stefanozauli jamespfaulkner hferentschik chrismattmann logicalspark bpolster dhiller interplace55 congwang-ai lanhz sammso blake2002 apakulov edegaudenzi jiaoyk royzeng oanalyse junjiemars sircelsius czl349095941 jibaro mrugeshpatel nomoa akym03 guixl jforge pinopisello ztx1491 filehole onluiz jcampoy chinpeng lukhnos gunnarmorling theworldby7z 1120101929 tdipisa jichao zuoyebushiwo iokays luyuwww is00hcw rayoo stone-lib zhaoshiling1017 lovejavaee llwhub bynothing jred1989 damianofds tuxdna markhsiu navya-y jamtanghub iceqp handsenguan grisson nareshmiriyala yusong666666 realkoy 19831019wlp hhqqnu danielias wacaine nivalsoul vinayathimmappa zhanghaoit445 bossadvisors henryleecn fengbaicanhe hadoop835 jy4618272 caidongyun demon1110 iqy mo-kh clamaa

luke's Issues

support for copy and paste

Hi,
it would be nice if the GUI could support copy & paste, eg. to paste queries from external sources

best regards

Bulk add new field to all docs at once

User story: http://stackoverflow.com/questions/39258828/adding-a-new-field-to-all-existing-documents-in-an-index

If link does not open:

I am using Luke, to add a new field to all existing documents in the index. I can easily do this for 1 document by using the "Reconstruct and Edit" option. However, I want to do this for all document, in one go. Right now, I have to do this one by one. There are 2000 Documents in the index. This would take a lot of time.

new api for Automaton traversing

o.a.l.u.automaton.Automaton api has changed in lucene 4.10 (https://issues.apache.org/jira/secure/attachment/12651171/LUCENE-5752.patch).
Method getNumberedStates() got dropped
class State does not exist anymore.

Affects Explain structure feature in Luke's ui.

move to java 1.8

1.6 is currently used. 1.7 is not supported already, so 1.8 is the target.

Build failure due to missing org.restlet-2.3.0

Build fails because org.restlet-2.3.0 cannot be resolved.

$ mvn -U clean compile

[INFO] ------------------------------------------------------------------------
[INFO] Building luke 5.3.0
[INFO] ------------------------------------------------------------------------
Downloading: https://repo.maven.apache.org/maven2/org/restlet/jee/org.restlet/2.3.0/org.restlet-2.3.0.pom
[WARNING] The POM for org.restlet.jee:org.restlet:jar:2.3.0 is missing, no dependency information available
Downloading: https://repo.maven.apache.org/maven2/org/restlet/jee/org.restlet.ext.servlet/2.3.0/org.restlet.ext.servlet-2.3.0.pom
[WARNING] The POM for org.restlet.jee:org.restlet.ext.servlet:jar:2.3.0 is missing, no dependency information available
Downloading: https://repo.maven.apache.org/maven2/org/restlet/jee/org.restlet/2.3.0/org.restlet-2.3.0.jar
Downloading: https://repo.maven.apache.org/maven2/org/restlet/jee/org.restlet.ext.servlet/2.3.0/org.restlet.ext.servlet-2.3.0.jar

This happens with master branch at snapshot cf4481504de26ea78fa01eecf949b0dd6ce897ec

Export all terms in a field and docids to a file

User story:

"I would like to be able to EXTRACT all tokens for a field from the index to an external text file (along with the ID field so I can identify the relevant records) so that I can compare the tokens generated with other systems….

If that is not possible would it be possible to export the RESULTS table. For example I searched for a token and found 2589 documents contain that token. I can page through the results display for those 2589 records but ideally I would like to extract the results table into a text file for further analysis…. Is this possible?"

upgrade to 6.2

Luke-4.8.0 does not support DocValuesFormat="Disk"

Trying to use luke-with-deps-4.8.0.jar to open an index with DocValuesFormat="Disk", created in Solr 4.8, resulted in the following error:

A SPI class of type org.apache.lucene.codecs.DocValuesFormat
with name 'Disk' does not exist. You need to add the corresponding
JAR file supporting this SPI to your classpath.The current classpath
supports the following names: [Lucene42, Lucene45]

The same error is thrown if Solr 4.9 us used to open the index. Disk-format was dropped in Solr 4.9, so it seems that either Luke-4.8.0 was linked with Solr 4.9 or 4.10-files or it does not contain the JAR with that codec format (which might be part of an optional Lucene codec package?).

warning that log4j.properties should not use "org.apache.hadoop.metrics.jvm.EventCounter" any more

To fix this warning change in "luke-with-deps.jar" the log4j.properties file (in top level directory) the last line from:
log4j.appender.EventCounter=org.apache.hadoop.metrics.jvm.EventCounter
to:
log4j.appender.EventCounter=org.apache.hadoop.log.metrics.EventCounter

cannot open directory in read-only mode

I used to be able to open a directory even if it is being used by the other process through luke as long as I checked the "read-only mode" (before Lucene 5). But now I cannot,

java.nio.file.AccessDeniedException: **/lucene/cache/write.lock

Is it a known issue ?

java.lang.ArrayIndexOutOfBoundsException

Luke cannot open the Lucene index and throws java.lang.ArrayIndexOutOfBoundsException:
java.lang.ArrayIndexOutOfBoundsException: 0
at org.getopt.luke.Luke.initFieldList(Luke.java:1229)
at org.getopt.luke.Luke.access$600(Luke.java:86)
at org.getopt.luke.Luke$3.run(Luke.java:1162)

I use Elasticsearch 5.4.0, based on Lucene 6.5.0.
While Kibana show all results well. Elasticsearch-head also open the index and can browse all documents and its fields.
It looks like a bug

distribute in .zip in addition to .tar.gz for Windows users

Idea came from Shawn Heisey on solr mailing list

upgrading solr 4.3.1 to 4.10.3

An SPI class of type org.apache.lucene.codecs.DocValuesFormat with name 'Disk' does not exist.
Seeing this error after upgrading the war file from solr-4.3.1 to solr-4.10.3 after removing the field docValuesFormat from schema.xml since it is not supported after 4.8 version

Could not find artifact net.sf.ehcache:ehcache-terracotta:jar:2.6.2 in central

The dependency ehcache-terracotta:2.6.2 is no longer available in Maven central. Hence, the build using Maven fails (unless you already have the artifact, I assume):

Downloading: http://repo.maven.apache.org/maven2/net/sf/ehcache/ehcache-terracotta/2.6.2/ehcache-terracotta-2.6.2.pom
[WARNING] The POM for net.sf.ehcache:ehcache-terracotta:jar:2.6.2 is missing, no dependency information available
Downloading: http://repo.maven.apache.org/maven2/net/sf/ehcache/ehcache-terracotta/2.6.2/ehcache-terracotta-2.6.2.jar

[ERROR] Failed to execute goal on project luke: Could not resolve dependencies for project luke:luke:jar:4.10.1: Could not find artifact net.sf.ehcache:ehcache-terracotta:jar:2.6.2 in central (http://repo.maven.apache.org/maven2) -> [Help 1]

However, after changing the ehcache version in pom.xml to 2.9.0 (most recent, currently), multiple errors of the following type arise:
src/main/java/org/getopt/luke/plugins/FsDirectory.java:[21,22] package net.sf.ehcache does not exist

Refactor code

Get rid of warnings
refactor Java 8 style

Reconstructing non-stored fields

On previous luke versions, when a searched document was selected, you could click 'Reconstruct & Edit' to display the content of the index. There was a warning about the validity of the data but this feature is useful to see what is in the non-stored fields.

I have tried using luke 4.10.4 on a 4.10.3 index. Pressing the 'Reconstruct & Edit' button just seems to build the stored fields and does not display the non-stored ones. The data is in the index because it can be seen when using 'Browse by term'.

Am I not setting something up correctly ?

Thanks,
Clive

sort field list by % desc instead of the field name

Larger issue has been raised by @daubman on twitter: be able to sort on columns by mouse click. This is a large issue, not sure if possible to do with Thinlet.

For now, change sorting from by field name to by % = term count desc.

Put luke into the cloud software foundation

We are looking for high quality projects to join the cloud-software-foundation. The foundation will provide additional quality control and continued support by the development team. I am curious if luke wants to join. I know luke has had some issues keeping up to date with newer versions of lucene. CSF will help with this process along with continued support and maintence.

upgrade to 5.4

Allow copying from field values table

I can select rows in the field data table for a document, even multiple rows. But today I wanted a quick way to copy two rows out into a text file, and found that the usual ⌘C shortcut didn't copy the text.

If I right-click and show the full text, then copy from the text area in there, that does work, but since I'd like to do this for a few docs, it would have saved a lot of time had it just worked on the table.

Why it doesn't work is baffling. The default look and feel on OSX supports it without having to do anything, so initially I would assume the problem is with this weird look and feel being used in the application.

Selectively delete documents from the index

I can't find the delete button in luke 4.10.4 running in Mac os under java1.8_40

It should appear here?

Thanks in advance

Integrate plugin to read index from remote

Revisit and integrate:
https://github.com/md6nguyen/luke-remoteindex

pivot-luke-5.5.0 sh file edit

luke.sh file -

if [[ -d `echo $LUKE_PATH` ]]; then
  java -XX:MaxPermSize=512m -jar $LUKE_PATH/target/luke-with-deps.jar
else
  echo "Unable to find the LUKE_PATH environnement variable..."
  echo "Assuming you're running from the root folder of luke..."
  java -XX:MaxPermSize=512m -jar target/pivot-luke-with-deps.jar
fi

luke.bat file -

java -XX:MaxPermSize=512m -jar .\target\luke-with-deps.jar

The jar file name in the target folder is pivot-luke-with-deps.jar so running the files shows Error: Unable to access jarfile target/luke-with-deps.jar

How exactly we do we run this Luke? Build failures..

Hi,

I downloaded https://github.com/DmitryKey/luke/archive/master.zip. luke.bat and luke.sh and java -XX:MaxPermSize=512m -jar luke-with-deps.jar all failed out of the box, presumably because the project wasn't built, so I tried to build.

This is what I get when trying to build. This is the second run - the first run is where it downloaded all the dependencies it could find.

D:\Users\rbram\myApps\Luke>mvn test
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for luke:luke:jar:5.3.0
[WARNING] 'version' contains an expression but should be a constant. @ luke:luke:${lucene.version}, D:\Users\rbram\myApps\Luke\pom.xml, line 9, column 14
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building luke 5.3.0
[INFO] ------------------------------------------------------------------------
[WARNING] The POM for org.restlet.jee:org.restlet:jar:2.3.0 is missing, no dependency information available
[WARNING] The POM for org.restlet.jee:org.restlet.ext.servlet:jar:2.3.0 is missing, no dependency information available
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1.949 s
[INFO] Finished at: 2015-11-16T11:26:05+11:00
[INFO] Final Memory: 12M/244M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project luke: Could not resolve dependencies for project luke:luke:jar:5.3.0: The following artifacts could not be resolved: org.restlet.jee:org.restlet:jar:2.3.0, org.restlet.jee:org.restlet.ext.servlet:jar:2.3.0: Failure to find org.restlet.jee:org.restlet:jar:2.3.0 in http://10.6.9.14:8081/nexus/content/groups/public was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException

I tried to get around this by downloading the dependencies directly into my local maven repo (after removing the *.lastupdated files) from:
http://repo.spring.io/libs-release-remote/org/restlet/jee/org.restlet.ext.servlet/2.3.0/org.restlet.ext.servlet-2.3.0.jar
http://repo.spring.io/libs-release-remote/org/restlet/jee/org.restlet.ext.servlet/2.3.0/org.restlet.ext.servlet-2.3.0.pom
http://repo.spring.io/libs-release-remote/org/restlet/jee/org.restlet/2.3.0/org.restlet-2.3.0.jar
http://repo.spring.io/libs-release-remote/org/restlet/jee/org.restlet/2.3.0/org.restlet-2.3.0.pom
http://repo.spring.io/libs-release-remote/org/restlet/jee/org.restlet.parent/2.3.0/org.restlet.parent-2.3.0.pom

And then I tried again:

D:\Users\rbram\myApps\Luke>mvn test
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for luke:luke:jar:5.3.0
[WARNING] 'version' contains an expression but should be a constant. @ luke:luke:${lucene.version}, D:\Users\rbram\myApps\Luke\pom.xml, line 9, column 14
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building luke 5.3.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ luke ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 54 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ luke ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 53 source files to D:\Users\rbram\myApps\Luke\target\classes
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2.955 s
[INFO] Finished at: 2015-11-16T11:41:14+11:00
[INFO] Final Memory: 14M/244M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) on project luke: Fatal error compiling: invalid target release: 1.8 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

Feel free to call me a n00b.. any ideas on how I can get this to work?

Rob
:)

Upgrade to 6.4

Lucene 6.4.0 was released.
https://lucene.apache.org/core/6_4_0/changes/Changes.html

Maven shade plugin build errors

Maven shade plugins gives some errors while building

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-shade-plugin:2.3:shade (default) on project luke: Error creating shaded jar: error in opening zip file /Users//.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar -> [Help 1]

We can comment out the maven-shade-plugin from pom to solve this.

Support for Lucene 5.0

I am using Lucene 5.0 inside my application, but I just found out that luke only supports 4.x indices.

SLF4J: Failed to load class “org.slf4j.impl.StaticLoggerBinder”

According to www.slf4j.org "Failedto load class org.slf4j.impl.StaticLoggerBinder", at least one StaticLoggerBinder should be used.
E.g. adding slf4j-log4j12.jar to the project will fix this.

Update to Lucene 5.3

I will send a PR for this in in a minute.

pivot-luke-5.5.0 - Batch file pointing to wrong file

I was using pivot-luke-5.5.0. The batch file of the release is pointing to .\target\luke-with-deps.jar, but the jar files name is pivot-luke-with-deps.jar

Tools -> Cleanup Index Dir -- NoSuchFileException

I get an error when I call "Tools -> Cleanup Index Dir".

Error: java.nio.file.NoSuchFileException:
[...]/index_new/idx/idx

While the index dir itself is just index_new, I think idx is appended twice maybe ?

Not sure if it is related, but I encountered it with a build of the pull request #27

NoSuchMethodException: PrefixQuery.getTermsEnum when using "Explain structure"

To reproduce :

open a valid lucene index with luke
access Search tab
enter the following query (replace field_name with a valid text field name of the index, and replace text with a known term of the index)

    field_name:text*

click button Explain structure

Bug occurs :

the UI display the following dialog (whereas a list of term starting with the specified text is expected)
the following exception occurs in the log

java.lang.NoSuchMethodException: org.apache.lucene.search.PrefixQuery.getTermsEnum(org.apache.lucene.index.Terms, org.apache.lucene.util.AttributeSource)
        at java.lang.Class.getDeclaredMethod(Class.java:2130)
        at org.getopt.luke.Luke.addTermsEnum(Luke.java:4498)
        at org.getopt.luke.Luke._explainStructure(Luke.java:4204)
        at org.getopt.luke.Luke.explainStructure(Luke.java:4141)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at thinlet.Thinlet.invokeImpl(Thinlet.java:4579)
        at thinlet.Thinlet.invoke(Thinlet.java:4546)
        at thinlet.Thinlet.handleMouseEvent(Thinlet.java:3937)
        at thinlet.Thinlet.processEvent(Thinlet.java:2917)
        at java.awt.Component.dispatchEventImpl(Component.java:4889)
        at java.awt.Container.dispatchEventImpl(Container.java:2294)
        at java.awt.Component.dispatchEvent(Component.java:4711)
        at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4888)
        at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4525)
        at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4466)
        at java.awt.Container.dispatchEventImpl(Container.java:2280)
        at java.awt.Window.dispatchEventImpl(Window.java:2746)
        at java.awt.Component.dispatchEvent(Component.java:4711)
        at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:758)
        at java.awt.EventQueue.access$500(EventQueue.java:97)
        at java.awt.EventQueue$3.run(EventQueue.java:709)
        at java.awt.EventQueue$3.run(EventQueue.java:703)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:80)
        at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:90)
        at java.awt.EventQueue$4.run(EventQueue.java:731)
        at java.awt.EventQueue$4.run(EventQueue.java:729)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:80)
        at java.awt.EventQueue.dispatchEvent(EventQueue.java:728)
        at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:201)
        at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:116)
        at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:105)
        at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:101)
        at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:93)
        at java.awt.EventDispatchThread.run(EventDispatchThread.java:82)

Branch for Apache Pivot version

Excuse me so suddenly raise an issue, because I do not know other way to leave a message to you.
This is related to the thread on solr user mailing list.
http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201502.mbox/%3CCAHpHuj%3DZArPSbSLp2_d1X7OD_2V0NeBsDSRVizgTDTnBiAZPMQ%40mail.gmail.com%3E

To reach the starting line, I've forked the repository and merged the latest Pivot's version on Apache SVN.
My branch, named simply 'pivot', is here.
https://github.com/mocobeta/luke/tree/pivot

In this branch, those codes (initially plugged by Mark Miller) have been added & merged.
http://svn.apache.org/repos/asf/lucene/sandbox/luke/
(Related Lucene issue is here: https://issues.apache.org/jira/browse/LUCENE-2562)

This branch can be built by "mvn package", and launched by "luke.sh". There are a lot of remaining tasks to be done, however.
If you are interested, I'm ready for making a pull request, please let me know.

Sorry for my poor English and thanks for paying attention! :)
Your comments or suggestions are sincerely welcome.

upgrade luke to use Lucene 5.5.0

I tried to build current Master with Lucene 5.5.0, but ended up with error,

[error] luke/cast to Object for a varargs call
[error]   cast to Object[] for a non-varargs call and to suppress this warning
[error] luke/src/main/java/org/getopt/luke/NoScoringScorer.java:7:  error: NoScoringScorer is not abstract and does not override abstract method iterator() in Scorer
[error] public class NoScoringScorer extends Scorer {
[error]        ^
[error] luke/src/main/java/org/getopt/luke/NoScoringScorer.java:19:  error: method does not override or implement a method from a supertype
[error]   @Override
[error]   ^
[error] luke/src/main/java/org/getopt/luke/NoScoringScorer.java:29:  error: method does not override or implement a method from a supertype
[error]   @Override
[error]   ^
[error] luke/src/main/java/org/getopt/luke/NoScoringScorer.java:44:  error: method does not override or implement a method from a supertype
[error]     @Override
[error]     ^

Support for old index versions

Hello,

Is there any version of Luke that can open Lucene 4.4.0 index files?
The latest version seems to be incompatible with these.

Issue with tokenized content

Issue from Laurentiu Piscuc:

I am using Luke v 6.2.1 in order to examine a solr 6.2.1 index. I am able to open the index and see its content. Most features work, including term positions, but I am unable to see the tokenized content of a field.

I select a document and hit Reconstruct & Edit button, the Stored Original content shows up, but when I switch to Tokenized tab nothing shows up. Do you have an idea what could be wrong with it?

fix issue with loading urls from the About dialog box for Mac OS

java.lang.ExceptionInInitializerError
at org.getopt.luke.Luke.goUrl(Luke.java:5194)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at thinlet.Thinlet.invokeImpl(Thinlet.java:4579)
at thinlet.Thinlet.invoke(Thinlet.java:4546)
at thinlet.Thinlet.handleMouseEvent(Thinlet.java:3937)
at thinlet.Thinlet.processEvent(Thinlet.java:2917)
at java.awt.Component.dispatchEventImpl(Component.java:4872)
at java.awt.Container.dispatchEventImpl(Container.java:2287)
at java.awt.Component.dispatchEvent(Component.java:4698)
at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4832)
at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4492)
at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4422)
at java.awt.Container.dispatchEventImpl(Container.java:2273)
at java.awt.Window.dispatchEventImpl(Window.java:2719)
at java.awt.Component.dispatchEvent(Component.java:4698)
at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:735)
at java.awt.EventQueue.access$200(EventQueue.java:103)
at java.awt.EventQueue$3.run(EventQueue.java:694)
at java.awt.EventQueue$3.run(EventQueue.java:692)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$1.doIntersectionPrivilege(ProtectionDomain.java:76)
at java.security.ProtectionDomain$1.doIntersectionPrivilege(ProtectionDomain.java:87)
at java.awt.EventQueue$4.run(EventQueue.java:708)
at java.awt.EventQueue$4.run(EventQueue.java:706)
at java.security.AccessController.doPrivileged(Native Method)
at java.security.ProtectionDomain$1.doIntersectionPrivilege(ProtectionDomain.java:76)
at java.awt.EventQueue.dispatchEvent(EventQueue.java:705)
at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:242)
at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:161)
at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:150)
at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:146)
at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:138)
at java.awt.EventDispatchThread.run(EventDispatchThread.java:91)

Implement symmetrical index import feature

Luke can export index, but not import the produced xml to create an index. This ticket is to make such a tool.

Upgrade to Lucene 6.1.0

Lucene's new version 6.1.0 has been available since 2016-06-17. Update to that.

Add unit tests

Having an issue reading LabKey Lucene index using Luke

Hi, I'm getting an IndexFormatTooNewException while trying to read Lucene indexes created by http://labkey.org/ see attached file.

IndexFormatTooNewException while using luke-4.6.0-jar-with-dependencies.jar

$ java -jar ../../luke-4.6.0-jar-with-dependencies.jar -index geoIndex/

org.apache.lucene.index.IndexFormatTooNewException: Format version is not supported (resource: ChecksumIndexInput(NIOFSIndexInput(path="/lucene-geo-gazetteer/geoIndex/segments_1"))): 4 (needs to be between 0 and 1)
at org.apache.lucene.codecs.CodecUtil.checkHeaderNoMagic(CodecUtil.java:148)
at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:329)
at org.apache.lucene.index.SegmentInfos$1.doBody(SegmentInfos.java:404)
at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:843)
at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:694)
at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:400)
at org.getopt.luke.Luke.openIndex(Luke.java:868)
at org.getopt.luke.Luke.startLuke(Luke.java:5210)
at org.getopt.luke.Luke.main(Luke.java:5237)

Can you please suggest anything?

How I built my index?
I followed -> https://github.com/chrismattmann/lucene-geo-gazetteer which in turn uses lucene 5.0.0 to build index. Does it works with lucene 5.0.0?

Thanks a lot in advance.
Madhav

DocValues - Are there plans to read/display them in Luke ?

This is not really an issue, more of a question :-)

With the introduction of updatable fields in Lucene, by the use of DocValues, are there plans to allow Luke to decode and display the content of DocValue fields ?

Thanks,
Clive

Hello ， download version 6.0 error ！！！

ArrayIndexOutOfBounds on loading index

Hi,

When I try to open an index I get the following stacktrace and the UI is in a funky state (some buttons work but most doesn't and most of the UI isn't updated).

Running on an openSUSE Tumbleweed using

$ java -version
java version "1.8.0_65"
Java(TM) SE Runtime Environment (build 1.8.0_65-b17)
Java HotSpot(TM) 64-Bit Server VM (build 25.65-b01, mixed mode)

$ ./luke.sh 
Unable to find the LUKE_PATH environnement variable...
Assuming you're running from the root folder of luke...
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/tnyblom/code/luke/target/luke-with-deps.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/tnyblom/code/luke/target/lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Exception in thread "AWT-EventQueue-0" java.lang.ArrayIndexOutOfBoundsException: -31981568
    at sun.font.FileFontStrike.getCachedGlyphPtr(FileFontStrike.java:472)
    at sun.font.FileFontStrike.getSlot0GlyphImagePtrs(FileFontStrike.java:438)
    at sun.font.CompositeStrike.getGlyphImagePtrs(CompositeStrike.java:115)
    at sun.font.GlyphList.mapChars(GlyphList.java:272)
    at sun.font.GlyphList.setFromString(GlyphList.java:244)
    at sun.java2d.pipe.GlyphListPipe.drawString(GlyphListPipe.java:71)
    at sun.java2d.SunGraphics2D.drawString(SunGraphics2D.java:2928)
    at thinlet.Thinlet.paint(Thinlet.java:2736)
    at thinlet.Thinlet.paint(Thinlet.java:2420)
    at thinlet.Thinlet.paintScroll(Thinlet.java:2243)
    at thinlet.Thinlet.paint(Thinlet.java:1907)
    at thinlet.Thinlet.paint(Thinlet.java:1825)
    at thinlet.Thinlet.paint(Thinlet.java:1825)
    at thinlet.Thinlet.paint(Thinlet.java:1903)
    at thinlet.Thinlet.paint(Thinlet.java:1825)
    at thinlet.Thinlet.paint(Thinlet.java:1764)
    at thinlet.Thinlet.paint(Thinlet.java:1825)
    at thinlet.Thinlet.paintReverse(Thinlet.java:2025)
    at thinlet.Thinlet.paint(Thinlet.java:1830)
    at thinlet.Thinlet.paint(Thinlet.java:1573)
    at java.awt.GraphicsCallback$PaintCallback.run(GraphicsCallback.java:39)
    at sun.awt.SunGraphicsCallback.runOneComponent(SunGraphicsCallback.java:79)
    at sun.awt.SunGraphicsCallback.runComponents(SunGraphicsCallback.java:116)
    at java.awt.Container.paint(Container.java:1975)
    at java.awt.Window.paint(Window.java:3912)
    at thinlet.FrameLauncher.paint(FrameLauncher.java:101)
    at thinlet.FrameLauncher.update(FrameLauncher.java:87)
    at sun.awt.RepaintArea.updateComponent(RepaintArea.java:255)
    at sun.awt.X11.XRepaintArea.updateComponent(XRepaintArea.java:51)
    at sun.awt.RepaintArea.paint(RepaintArea.java:232)
    at sun.awt.X11.XComponentPeer.handleEvent(XComponentPeer.java:584)
    at java.awt.Component.dispatchEventImpl(Component.java:4967)
    at java.awt.Container.dispatchEventImpl(Container.java:2294)
    at java.awt.Window.dispatchEventImpl(Window.java:2750)
    at java.awt.Component.dispatchEvent(Component.java:4713)
    at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:758)
    at java.awt.EventQueue.access$500(EventQueue.java:97)
    at java.awt.EventQueue$3.run(EventQueue.java:709)
    at java.awt.EventQueue$3.run(EventQueue.java:703)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:76)
    at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:86)
    at java.awt.EventQueue$4.run(EventQueue.java:731)
    at java.awt.EventQueue$4.run(EventQueue.java:729)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:76)
    at java.awt.EventQueue.dispatchEvent(EventQueue.java:728)
    at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:201)
    at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:116)
    at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:105)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:101)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:93)
    at java.awt.EventDispatchThread.run(EventDispatchThread.java:82)
Exception in thread "AWT-EventQueue-0" java.lang.ArrayIndexOutOfBoundsException: -31981568
    at sun.font.FileFontStrike.getCachedGlyphPtr(FileFontStrike.java:472)
    at sun.font.FileFontStrike.getSlot0GlyphImagePtrs(FileFontStrike.java:438)
    at sun.font.CompositeStrike.getGlyphImagePtrs(CompositeStrike.java:115)
    at sun.font.GlyphList.mapChars(GlyphList.java:272)
    at sun.font.GlyphList.setFromString(GlyphList.java:244)
    at sun.java2d.pipe.GlyphListPipe.drawString(GlyphListPipe.java:71)
    at sun.java2d.SunGraphics2D.drawString(SunGraphics2D.java:2928)
    at thinlet.Thinlet.paint(Thinlet.java:2736)
    at thinlet.Thinlet.paint(Thinlet.java:2420)
    at thinlet.Thinlet.paintScroll(Thinlet.java:2243)
    at thinlet.Thinlet.paint(Thinlet.java:1907)
    at thinlet.Thinlet.paint(Thinlet.java:1825)
    at thinlet.Thinlet.paint(Thinlet.java:1825)
    at thinlet.Thinlet.paint(Thinlet.java:1903)
    at thinlet.Thinlet.paint(Thinlet.java:1825)
    at thinlet.Thinlet.paint(Thinlet.java:1764)
    at thinlet.Thinlet.paint(Thinlet.java:1825)
    at thinlet.Thinlet.paintReverse(Thinlet.java:2025)
    at thinlet.Thinlet.paint(Thinlet.java:1830)
    at thinlet.Thinlet.paint(Thinlet.java:1573)
    at java.awt.GraphicsCallback$PaintCallback.run(GraphicsCallback.java:39)
    at sun.awt.SunGraphicsCallback.runOneComponent(SunGraphicsCallback.java:79)
    at sun.awt.SunGraphicsCallback.runComponents(SunGraphicsCallback.java:116)
    at java.awt.Container.paint(Container.java:1975)
    at java.awt.Window.paint(Window.java:3912)
    at thinlet.FrameLauncher.paint(FrameLauncher.java:101)
    at thinlet.FrameLauncher.update(FrameLauncher.java:87)
    at sun.awt.RepaintArea.updateComponent(RepaintArea.java:255)
    at sun.awt.X11.XRepaintArea.updateComponent(XRepaintArea.java:51)
    at sun.awt.RepaintArea.paint(RepaintArea.java:232)
    at sun.awt.X11.XComponentPeer.handleEvent(XComponentPeer.java:584)
    at java.awt.Component.dispatchEventImpl(Component.java:4967)
    at java.awt.Container.dispatchEventImpl(Container.java:2294)
    at java.awt.Window.dispatchEventImpl(Window.java:2750)
    at java.awt.Component.dispatchEvent(Component.java:4713)
    at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:758)
    at java.awt.EventQueue.access$500(EventQueue.java:97)
    at java.awt.EventQueue$3.run(EventQueue.java:709)
    at java.awt.EventQueue$3.run(EventQueue.java:703)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:76)
    at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:86)
    at java.awt.EventQueue$4.run(EventQueue.java:731)
    at java.awt.EventQueue$4.run(EventQueue.java:729)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:76)
    at java.awt.EventQueue.dispatchEvent(EventQueue.java:728)
    at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:201)
    at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:116)
    at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:105)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:101)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:93)
    at java.awt.EventDispatchThread.run(EventDispatchThread.java:82)

200 stars

number 200 gets to file an issue to be solved with top priority as long, as it is related to luke and solvable :)

Ability to use custom QueryParsers

Hi,

Feature Request

There's already the ability to have custom analyzers but it'd be really nice if you could configure a custom QueryParser as well. Custom functionality often requires subclassing QueryParser and not being able to use it in Luke means resorting to not using Luke at all.

In addition, there are several supported versions of subclasses of QueryParser that are bundled with lucene (e.g. AnalyzingQueryParser)

Thanks,
Dustin

Chinese chars is wrong to show

Chinese chars is wrong to show My system is Win7 x64 ,
when i run the luke to show index word ,but the Chinese word is 口
please see th attach for detail infomation!

My lucene version is 5.5.2
luke version is pivot-luke-5.5.0-luke-release

Question... how do I run this tool?

Hi,

This might sound like a stupid question but well as the title says how do I run this?
I am on a Win7 machine (probably my -biggest- handycap). When I navigate in DOS to the dir where I i've downloaded and extracted the luke-master.zip I run the command which is given under the section 'Launching Luke' which gives me the error: Unable tho acces the jarfile luke-with-deps.jar

What am I doing wrong?

Kind regards,

Pim