tensei-data / tensei-agent Goto Github PK

Implement a transformer that allows the modification of timezones of timestamp values.

During most runs the test for schema extraction of an in memory hsqldb fails because other test data seems to exist in it.

The current configuration and test setup uses EventFilter.debug in several places. As a result everything of level DEBUG or higher gets logged to standard output which results in a very large log (around 40MB!).

Try to replace the relevant sections to be able to have at least a loglevel of INFO which should reduce the test output significantly.

The current README still references to the abandoned activator. Replace these with the appropriate sbt code snippets.

Currently the parsed timestamp (with timezone) is converted internally to LocalTime which looses the offset.

Regarding databases the JDBC interface currently only supports java.sql.Timestamp which also has no offset information.

After the work in dfasdl-utils is done (see DFASDL/dfasdl-utils#7) the agent should be modified to use strong typing internally too which will eleminate the messy usage of Any and List[Any].

This is rather involved and will require touching a lot of code!

It seems all relevant plugins are released meanwhile. Therefore we can switch to version 1.0 of sbt.