art-community / art-java Goto Github PK

ART must support VShard and tarantool replica sets

1. Fill all documentation pages in ART readme
2. Create ART public site: documentation, feedback, community, examples (interactive with code-paste-execute functional)
3. Examples for all ART cases
4. FAQ
5. Communication channels
6. Articles (habr, reddit, medium)

ART must have Logo for presentations and marketing

For now only http exceptions could have some addiotional information (Value).
In this issue needs add functional of exception mapper for GRPC and RSocket.
ART must pass full data from exception in all protocols. For services and communicators.

Some readers (message pack, for example) reading array into list. So, CollectionValue must provide safety access to set getters (convert collection to set)

• profile
• link to configurator
• filename (if from file)
• method documentation url
• version and build timestamp (also add this to status endpoint)

While starting application cannot find application-tarantool.jar which is in user folder (in gradle caches) because of error in encoding in Windows' username .

Exception during generation mappers for inner model packages (generation will not fail)

During generation xml models and mappers from file:
errorWsdl.txt
NullPointerException was thrown.

Supposedly, the problem is in this piece of code and:

type definition failed to define type and returned null.

In debug this command helped to define type:

type = element.getSchema().getType(new QName(getNamespaceByPrefix(element, "ns1"), getTypeByElement(element)))

where "ns1" is an element prefix.

For now, GRPC, RSocket, HTTP and SOAP servers and communication interceptors are:

• inside configurations (adding new interceptors very complicated
• haven't functional filters (for some custom filtering logic we must create a new interceptor)

So, in this issue needs:

• move interceptors from configurations to states
• to design a new interception architecture (with filters and other functional features)

For now every contributor can create tag and will be created new Bintray version of ART.

In this issue needs:

• disable launching release process for tags not on release branch
• disable pushing to release branch
• automate release process with automatic increment tag version. gradle tasks:

• minorRelease
• majorRelease
• hotfix

When HTTP interceptor returns 'STOP_HANDLING' strategy, then no one from subsequent HTTP Filters (include servlets) will be called.

In this issue needs to refactor HttpServer class and replace next result holders

private final static ThreadLocal<InterceptionStrategy> lastRequestInterceptionResult = new ThreadLocal<>();
    private final static ThreadLocal<InterceptionStrategy> lastResponseInterceptionResult = new ThreadLocal<>();

for something safe and simple.

We need to clear last interception strategy between requests.

• errors in configurations after start without configurations in rocks
• sometimes when call an configurator's url will be empty page (ART HTTP Handler not calling)
• refresh not working

Now every validation expression has enum type.
In this issue needs:

• replace enum with constant string
• add pattern as optional parameter for each expression

For optimize of network traffic ART must have this library https://github.com/xerial/snappy-java to compress and decompress data. Also it could be used for RocksDB storage.

After mapper with date field generation, date mapping contains error:

Correct value is:

if avaliableProcessors < 2 make as default tread pool size = avaliableProcessors x 2.
Found bug if 2 processors are available you can't run asynchronousPeriod Task(it will never execute)

Every config key that presents time value must ends with time unit (milliseconds, etc)
Alternative: for such values the config must have two keys: value and unit (ms, s, h). By default - ms.

ART Generator now scnanning .class files in build directory. This is not acceptable for ART IDEA plugin, because for realtime or button-mode generation we need parsing .java files.

Also, will be good to replace path scanning mechanism by model package with scanning all .java files with @Mapper annotation and generate mappers for them

Добавить возможность работать с топиками по http.

ART needs to support full-text search. Best solution is Reindexer with RocksDB engine.

In this issue needs:

• link reindexer API (reindexer.h) through JNI with Java (must be automated with Gradle)
• Module & ModuleConfiugration. Confiugration must support fully reindexer native Config and two modes: server/library with two engines: LevelDB & RocksDB
• DAO like RocksDB

Reindexer native library must be static linked with all dependencies exclude rocksDB. RocksDB library must be provided by RocksDB module

On Travis and other docker containers when runnig tarantool from Jar as fork process, it started, but Java client can't connect to instance

In this issue needs move all not-configuration entities to Module States

There are 4 problems in ART collections:

1. Null values. Some method (for example, for Long or Int) filter null values. This could be dangerous for some cases. When you need send or receive strong ordered values, we mustn't filter this and just exclude during mapping
2. Size. Classes for entity and collection value have more than 500 lines of code. In this issue needs to refactor theese classes.
3. Speed. There are lot of point where we can add Parallel Streaming. In theese issue needs create EntityModule with default and agile configurations with one value - "enableParallelism".
   And during convertiong to/from value use parallel mappings (parallel streams or custom mapping of any pool)

For now, RSocket and GRPC working with ServiceRequest and ServiceResnpose.

In this issue needs try to design a universal architecture for all protocols, that not depends on Service entities

For now, HTTP communicator (sync/async modes) not handle 4xx error codes.

In this issue needs to change logic of parsing Apache HTTP Response and add checks on HTTP statuses.
Check must be configurable:

• CHECKED mode - we are checking status code and throws an HttpCommunicationResponseException with HTTP Response as field
• UNCHECKED - we are just parsing HTTP Response ignoring statuses

Value type MAP and STRING_PARAMETERS must be replaced with Entity

During constructing some configurations ART context state becomes 'LOADING_MODULES'.
BUT! If you want load any other Module during constructing configuration context state become 'READY'. And after youre configuration won't be accessable because lazy reference will be point to parent configuration.

In this issue needs fix context module loading:

1. Remember current state
2. Change state to 'LOADING_MODULES'
3. Do action
4. Change state to remembered in (1.)
5. Return result (module or state)

Add two new module for queue messaging (producer and consumer). Add beanstalkd as queue for
message.

Need for consumer:

1. Starting beanstalkd as linux service with starting module (as kafka or tarantool) or connect for existing
2. Make optimizing default configuration for starting beanstalkd as linux service
3. Add default tube if there are no other configuration

Need for producer:

1. Make usability API for all supported operations: put;reserve;delete;bury;kick;release;
2. Make default configuration with static params for this operations
   Material:
   https://github.com/beanstalkd/beanstalkd
   https://beanstalkc.readthedocs.io/en/latest/tutorial.html#getting-started
   https://ruhighload.com/%D0%9E%D1%87%D0%B5%D1%80%D0%B5%D0%B4%D0%B8+%D0%BD%D0%B0+beanstalk
   https://habr.com/ru/company/shopozzcom/blog/240483/

If POJO contains Value/Entity/CollectionValue/Primitive field then generator must handle it correctly

• Make configuration functional mutators (beacause creation of ovveriding class for changing configuration parameter is not cool)
• Think about moving some parameters into state
• Make immutable collections (not for only configurations, in all project)

• Enable checkstyle and refactor code to it

При генерации вложенных моделек неправильно определяется пакет:

Также неправильно проставляются импорты в мапперах.

Модельки тут - ru.zip

timeout for targets must be taken from communication section

Only if using JDK 11+ .

Possible, in gradle 6.0 issue will be fixed.

Also there is related issue from Gradle (#3581)

Extend config methods: add method for getting any object from configuration (now configMap working only for Config's)

Art ignores ValidationException in ExceptionMapper.

Entity now is wrapper for Map<String, ? extends Value>.
MapValue & StringParametes could be removed and replaced with Map<? extends Value, ? extends Value>.

In this issue needs:

• change Entity implementation for support Map<? extends Value, ? extends Value>
• remove MapValue, StringParamters and references on them
• Improve Entity API for support Maps