vertica / vertica-extension-packages Goto Github PK

We have upgraded our vertica cluster from 7.1.0-1 to 7.1.1-7.

We had all the Vertica Extension Packages installed before the upgrade but all these packages are not working right now.
To counter this I tried recompiling the already present packages but are getting errors. Errors :

vsql:/home/dbadmin/package/Vertica-Extension-Packages-master/strings_package/ddl/install.sql:4: ROLLBACK 4213: Object "StringsLib" already exists
vsql:/home/dbadmin/package/Vertica-Extension-Packages-master/strings_package/ddl/install.sql:6: ROLLBACK 3857: Library built with unsupported version of Vertica SDK [Version: v7.1.0-1, Revision: 142176]
HINT: Expected version: [Version: v7.1.1-7, Revision: 155183]
vsql:/home/dbadmin/package/Vertica-Extension-Packages-master/strings_package/ddl/install.sql:7: ROLLBACK 3857: Library built with unsupported version of Vertica SDK [Version: v7.1.0-1, Revision: 142176]
HINT: Expected version: [Version: v7.1.1-7, Revision: 155183]
vsql:/home/dbadmin/package/Vertica-Extension-Packages-master/strings_package/ddl/install.sql:8: ROLLBACK 3857: Library built with unsupported version of Vertica SDK [Version: v7.1.0-1, Revision: 142176]
HINT: Expected version: [Version: v7.1.1-7, Revision: 155183]
vsql:/home/dbadmin/package/Vertica-Extension-Packages-master/strings_package/ddl/install.sql:9: ROLLBACK 3857: Library built with unsupported version of Vertica SDK [Version: v7.1.0-1, Revision: 142176]
HINT: Expected version: [Version: v7.1.1-7, Revision: 155183]
vsql:/home/dbadmin/package/Vertica-Extension-Packages-master/strings_package/ddl/install.sql:10: ROLLBACK 3857: Library built with unsupported version of Vertica SDK [Version: v7.1.0-1, Revision: 142176]
HINT: Expected version: [Version: v7.1.1-7, Revision: 155183]
vsql:/home/dbadmin/package/Vertica-Extension-Packages-master/strings_package/ddl/install.sql:11: ROLLBACK 3857: Library built with unsupported version of Vertica SDK [Version: v7.1.0-1, Revision: 142176]
HINT: Expected version: [Version: v7.1.1-7, Revision: 155183]
vsql:/home/dbadmin/package/Vertica-Extension-Packages-master/strings_package/ddl/install.sql:12: ROLLBACK 3857: Library built with unsupported version of Vertica SDK [Version: v7.1.0-1, Revision: 142176]
HINT: Expected version: [Version: v7.1.1-7, Revision: 155183]
vsql:/home/dbadmin/package/Vertica-Extension-Packages-master/strings_package/ddl/install.sql:13: ROLLBACK 3857: Library built with unsupported version of Vertica SDK [Version: v7.1.0-1, Revision: 142176]
HINT: Expected version: [Version: v7.1.1-7, Revision: 155183]
vsql:/home/dbadmin/package/Vertica-Extension-Packages-master/strings_package/ddl/install.sql:14: ROLLBACK 3857: Library built with unsupported version of Vertica SDK [Version: v7.1.0-1, Revision: 142176]
HINT: Expected version: [Version: v7.1.1-7, Revision: 155183]
vsql:/home/dbadmin/package/Vertica-Extension-Packages-master/strings_package/ddl/install.sql:15: ROLLBACK 3857: Library built with unsupported version of Vertica SDK [Version: v7.1.0-1, Revision: 142176]
HINT: Expected version: [Version: v7.1.1-7, Revision: 155183]
vsql:/home/dbadmin/package/Vertica-Extension-Packages-master/strings_package/ddl/install.sql:16: ROLLBACK 3857: Library built with unsupported version of Vertica SDK [Version: v7.1.0-1, Revision: 142176]
HINT: Expected version: [Version: v7.1.1-7, Revision: 155183]

Can you please let us know if the new version of Vertica Extension Package is available for use.If yes, please share the link as well.

I've downloaded and untarred SocialMediaConnector-7_1_1 ( from Vertica Marketplace ) for pulse ( vertica-pulse-7.2.3-0.x86_64.RHEL6 , lib & sdk version after installation :
lib_version | lib_sdk_version
------------- +-----------------
7.1.1 | 7.1.1
)
and when trying to compile it , I get "vsql:ddl/install.sql:10: ROLLBACK 3857: Library built with unsupported version of Vertica SDK [Version: , Revision: 148519]"
I've alreadt read through #37, but I am not certain, whether this ( issue #37 ) is reffering to github media connector or the marketplace one ( the later does come with any source code as far as I can see ) .
Does anyone have a similar problem ( and has found a solution ?? )

Hi,

I am getting below error while trying to test the function,

dbadmin=> create table test.heat_maptable (x int, y int);
CREATE TABLE
dbadmin=> INSERT INTO test.heat_maptable values (3,4);

OUTPUT

  1

(1 row)

dbadmin=> select heat_map(x,y) from test.heat_maptable;
ERROR 5401: User-defined transform function heat_map must have an OVER clause

do you have any idea ?

regards,
İsmail

When trying to install the strings package, I am getting the following error in the CREATE LIBRARY statement:

ROLLBACK 3399:  Failure in UDx RPC call InvokeGetLibraryManifest(): Error calling getLibraryManifest() in User Defined Object [] at [/scratch_a/release/svrtar5575/vbuild/vertica/OSS/UDxFence/vertica-udx-C++.cpp:368], error code: 0, message: Error happened in dlsym(): [/home/dbadmin/Vertica-Extension-Packages/strings_package/lib/StringsLib.so: undefined symbol: get]

Here is the output of the make command:

dbadmin@vertica-001:~/Vertica-Extension-Packages/strings_package$ make
g++ -g -D HAVE_LONG_LONG_INT_64 -c -I ../include -Wall -Wno-unused-value -fPIC -I /opt/vertica/sdk/include -I /home/dbadmin/Vertica-Extension-Packages/strings_package/src/third-party/include -O3 -DNDEBUG /opt/vertica/sdk/include/Vertica.cpp -o build/Vertica.o
g++ -g -D HAVE_LONG_LONG_INT_64 -c -I ../include -Wall -Wno-unused-value -fPIC -I /opt/vertica/sdk/include -I /home/dbadmin/Vertica-Extension-Packages/strings_package/src/third-party/include -O3 -DNDEBUG src/EditDist.cpp -o build/EditDist.o
g++ -g -D HAVE_LONG_LONG_INT_64 -c -I ../include -Wall -Wno-unused-value -fPIC -I /opt/vertica/sdk/include -I /home/dbadmin/Vertica-Extension-Packages/strings_package/src/third-party/include -O3 -DNDEBUG src/PorterStemmer.cpp -o build/PorterStemmer.o
src/PorterStemmer.cpp: In function ‘int m(stemmer*)’:
src/PorterStemmer.cpp:140:7: warning: this ‘if’ clause does not guard... [-Wmisleading-indentation]
       if (! cons(z, i)) break; i++;
       ^~
src/PorterStemmer.cpp:140:32: note: ...this statement, but the latter is misleadingly indented as if it is guarded by the ‘if’
       if (! cons(z, i)) break; i++;
                                ^
src/PorterStemmer.cpp: In function ‘void step4(stemmer*)’:
src/PorterStemmer.cpp:343:17: warning: this ‘if’ clause does not guard... [-Wmisleading-indentation]
                 if (ends(z, "\04" "ence")) break; return;
                 ^~
src/PorterStemmer.cpp:343:51: note: ...this statement, but the latter is misleadingly indented as if it is guarded by the ‘if’
                 if (ends(z, "\04" "ence")) break; return;
                                                   ^~~~~~
src/PorterStemmer.cpp:347:17: warning: this ‘if’ clause does not guard... [-Wmisleading-indentation]
                 if (ends(z, "\04" "ible")) break; return;
                 ^~
src/PorterStemmer.cpp:347:51: note: ...this statement, but the latter is misleadingly indented as if it is guarded by the ‘if’
                 if (ends(z, "\04" "ible")) break; return;
                                                   ^~~~~~
src/PorterStemmer.cpp:351:17: warning: this ‘if’ clause does not guard... [-Wmisleading-indentation]
                 if (ends(z, "\03" "ent")) break; return;
                 ^~
src/PorterStemmer.cpp:351:50: note: ...this statement, but the latter is misleadingly indented as if it is guarded by the ‘if’
                 if (ends(z, "\03" "ent")) break; return;
                                                  ^~~~~~
src/PorterStemmer.cpp:353:17: warning: this ‘if’ clause does not guard... [-Wmisleading-indentation]
                 if (ends(z, "\02" "ou")) break; return;
                 ^~
src/PorterStemmer.cpp:353:49: note: ...this statement, but the latter is misleadingly indented as if it is guarded by the ‘if’
                 if (ends(z, "\02" "ou")) break; return;
                                                 ^~~~~~
src/PorterStemmer.cpp:357:17: warning: this ‘if’ clause does not guard... [-Wmisleading-indentation]
                 if (ends(z, "\03" "iti")) break; return;
                 ^~
src/PorterStemmer.cpp:357:50: note: ...this statement, but the latter is misleadingly indented as if it is guarded by the ‘if’
                 if (ends(z, "\03" "iti")) break; return;
                                                  ^~~~~~
src/PorterStemmer.cpp: In function ‘void step5(stemmer*)’:
src/PorterStemmer.cpp:375:27: warning: suggest parentheses around ‘&&’ within ‘||’ [-Wparentheses]
       if (a > 1 || a == 1 && !cvc(z, z->k - 1)) z->k--;
                    ~~~~~~~^~~~~~~~~~~~~~~~~~~~
g++ -g -D HAVE_LONG_LONG_INT_64 -c -I ../include -Wall -Wno-unused-value -fPIC -I /opt/vertica/sdk/include -I /home/dbadmin/Vertica-Extension-Packages/strings_package/src/third-party/include -O3 -DNDEBUG src/StringTokenizerDelim.cpp -o build/StringTokenizerDelim.o
g++ -g -D HAVE_LONG_LONG_INT_64 -c -I ../include -Wall -Wno-unused-value -fPIC -I /opt/vertica/sdk/include -I /home/dbadmin/Vertica-Extension-Packages/strings_package/src/third-party/include -O3 -DNDEBUG src/NGrams.cpp -o build/NGrams.o
g++ -g -D HAVE_LONG_LONG_INT_64 -c -I ../include -Wall -Wno-unused-value -fPIC -I /opt/vertica/sdk/include -I /home/dbadmin/Vertica-Extension-Packages/strings_package/src/third-party/include -O3 -DNDEBUG src/StringTokenizer.cpp -o build/StringTokenizer.o
g++ -g -D HAVE_LONG_LONG_INT_64 -c -I ../include -Wall -Wno-unused-value -fPIC -I /opt/vertica/sdk/include -I /home/dbadmin/Vertica-Extension-Packages/strings_package/src/third-party/include -O3 -DNDEBUG src/WordCount.cpp -o build/WordCount.o
g++ -g -D HAVE_LONG_LONG_INT_64 -c -I ../include -Wall -Wno-unused-value -fPIC -I /opt/vertica/sdk/include -I /home/dbadmin/Vertica-Extension-Packages/strings_package/src/third-party/include -O3 -DNDEBUG src/AnagramLib.cpp -o build/AnagramLib.o
g++ -g -D HAVE_LONG_LONG_INT_64 -c -I ../include -Wall -Wno-unused-value -fPIC -I /opt/vertica/sdk/include -I /home/dbadmin/Vertica-Extension-Packages/strings_package/src/third-party/include -O3 -DNDEBUG src/GroupConcat.cpp -o build/GroupConcat.o
mkdir -p lib
g++ -shared -o lib/StringsLib.so build/Vertica.o build/EditDist.o build/PorterStemmer.o build/StringTokenizerDelim.o build/NGrams.o build/StringTokenizer.o build/WordCount.o build/AnagramLib.o build/GroupConcat.o

Here is the full output of make install:

dbadmin@vertica-001:~/Vertica-Extension-Packages/strings_package$ make install
vsql -f ddl/install.sql
Password:
              version
------------------------------------
 Vertica Analytic Database v8.1.0-4
(1 row)

vsql:ddl/install.sql:4: ROLLBACK 3399:  Failure in UDx RPC call InvokeGetLibraryManifest(): Error calling getLibraryManifest() in User Defined Object [] at [/scratch_a/release/svrtar5575/vbuild/vertica/OSS/UDxFence/vertica-udx-C++.cpp:368], error code: 0, message: Error happened in dlsym(): [/home/dbadmin/Vertica-Extension-Packages/strings_package/lib/StringsLib.so: undefined symbol: get]
vsql:ddl/install.sql:6: ROLLBACK 3861:  Library not found: StringsLib
vsql:ddl/install.sql:7: ROLLBACK 3861:  Library not found: StringsLib
vsql:ddl/install.sql:8: ROLLBACK 3861:  Library not found: StringsLib
vsql:ddl/install.sql:9: ROLLBACK 3861:  Library not found: StringsLib
vsql:ddl/install.sql:10: ROLLBACK 3861:  Library not found: StringsLib
vsql:ddl/install.sql:11: ROLLBACK 3861:  Library not found: StringsLib
vsql:ddl/install.sql:12: ROLLBACK 3861:  Library not found: StringsLib
vsql:ddl/install.sql:13: ROLLBACK 3861:  Library not found: StringsLib
vsql:ddl/install.sql:14: ROLLBACK 3861:  Library not found: StringsLib
vsql:ddl/install.sql:15: ROLLBACK 3861:  Library not found: StringsLib
vsql:ddl/install.sql:16: ROLLBACK 3861:  Library not found: StringsLib

g++ version

dbadmin@vertica-001:~/Vertica-Extension-Packages/strings_package$ g++ --version
g++ (Ubuntu 6.2.0-5ubuntu12) 6.2.0 20161005
Copyright (C) 2016 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

OS Version:

dbadmin@vertica-001:~/Vertica-Extension-Packages/strings_package$ lsb_release -a
No LSB modules are available.
Distributor ID:	Ubuntu
Description:	Ubuntu 16.10
Release:	16.10
Codename:	yakkety

Let me know if there is any more information I can get you.

Hi,

Is there anyone here know how to migrate the Twitter API to 1.1?
I cannot get any twitter feeds from twitter to Vertica after installing Sentiment Analysis

Appreciate your help!

Thanks!

We want to load a bunch of files using shell_load_package. Ideally, we'd use all nodes to do so simultaneously, using one connection and one transaction.

It would be great if shell_load_package could either:

• accept different command on each node, or
• pass the number of nodes total and current node's index to the script (so the script can divide the work itself).

Also, ON ALL NODES or something like that would be cool, to avoid having to list all the nodes.

cc @aseering

Thanks Adam,I am progressing slowly...

Now getting below error, do you have any idea

dbadmin=> SELECT heat_map_image(x,y,c USING PARAMETERS outf='/tmp/testsizer.png') OVER () AS (img) FROM (SELECT heat_map(x,y USING PARAMETERS xbins=64, ybins=64, ymin='0', xmax='0', gaussian=False, bounding_box=True, normalize=2 ) OVER () AS (x, y, x_t, y_t, c) FROM T) AS heatmap LIMIT 50;
ERROR 6589: The getPrototype(6) and getReturnType(1) method must have matching number of returnTypes

I am new to Vertica and I am trying to use the libraries from extension packages. While trying to compile ODBCloader, it cannot find sql.h and sqlext.h.

In file included from src/CRReader.hh:28,
from src/CRReader.cc:19:
/opt/vertica/sdk/examples/HelperLibraries/CoroutineHelpers.h: In copy constructor ‘ContinuousReader::ContinuousReader(ContinuousReader&)’:
/opt/vertica/sdk/examples/HelperLibraries/CoroutineHelpers.h:190: error: ‘ContinuousStreamer::ContinuousStreamer(ContinuousStreamer&)’ is private
/opt/vertica/sdk/examples/HelperLibraries/CoroutineHelpers.h:416: error: within this context
src/CRReader.cc: In constructor ‘avro::CRReaderBase::CRReaderBase(ContinuousReader&)’:
src/CRReader.cc:60: note: synthesized method ‘ContinuousReader::ContinuousReader(ContinuousReader&)’ first required here

Not sure if this is still being maintained.

I am trying to use ODBCLoader() ( User Defined Loader ) in the Vertica Extension Package, but I am getting a timeout error. I am gonna explain it in below.

I can run queries which takes more than 60 seconds, in isql, like that:

I can also execute queries which takes more than 60 seconds in the python by using pyodbc.

When I try to run similar queries in the vsql by using ODBCLoader() I am getting timeout error as shown in the below. Firstly, I thought that it is similar to mysql connection, query timout problem but it is not related to the data source. Because remote odbc data source mysql and vertica gives same error. Just after 60 seconds passed, it throws an exception as shown in the below.

I edited the ODBCLoader.cpp code and set the SQL_ATTR_QUERY_TIMEOUT more than 60 seconds but it does not effect. What can be the problem? In the Cpp code is there any parameter which overrides the default query timeout?

My ODBC configuration is in below:

Not sure if this is a bug, or if this is user or environment error.

I have trouble building the avro parser using the latest checked out version.

My Vertica machine(s): CentOS release 6.2 (Final), Linux dvert1 2.6.32-220.17.1.el6.x86_64 #1 SMP Wed May 16 00:01:37 BST 2012 x86_64 x86_64 x86_64 GNU/Linux

Here's what I get when I do a "make build"
...a lot of output...

make[1]: Entering directory /home/users/david/VERTICA_EXTENSION_PACKAGES/Vertica-Extension-Packages/avro_parser/tparty' make[1]: Nothing to be done forall'.
make[1]: Leaving directory `/home/users/david/VERTICA_EXTENSION_PACKAGES/Vertica-Extension-Packages/avro_parser/tparty'
g++ -c -I ../include -Wall -Wno-unused-value -shared -fno-strict-aliasing -fPIC -I /opt/vertica/sdk/include -I build/include -I build/include/avro -I /opt/vertica/sdk/examples/HelperLibraries src/CRStream.cc -o build/CRStream.o
In file included from src/CRStream.hh:5,
from src/CRStream.cc:2:
/opt/vertica/sdk/examples/HelperLibraries/CoroutineHelpers.h: In member function ‘void Coroutine::switchBack()’:
/opt/vertica/sdk/examples/HelperLibraries/CoroutineHelpers.h:109: error: ‘coroutine_exception’ was not declared in this scope
/opt/vertica/sdk/examples/HelperLibraries/CoroutineHelpers.h: In member function ‘std::exception* Coroutine::throw_in_coroutine(std::exception_)’:
/opt/vertica/sdk/examples/HelperLibraries/CoroutineHelpers.h:131: error: ‘coroutine_exception’ was not declared in this scope
make: *_* [build/CRStream.o] Error 1

Hello

We are getting error while using ODBCLoader , specially in case if the length of data in source reached to its maximum based on datatype defined for that column

dbadmin=> \d t_d1

                                List of Fields by Tables

Schema | Table | Column | Type | Size | Default | Not Null | Primary Key | Foreign Key
--------+-------+--------+---------------+------+---------+----------+-------------+-------------
public | t_d1 | a | numeric(20,0) | 16 | | f | f |
(1 row)

Sample data:
15600249032015053115

COPY t_d1 WITH SOURCE ODBCSource() PARSER ODBCLoader(CONNECT = 'DSN=DEVVertica;UID=dbadmin;PWD=password;', QUERY = 'SELECT * from t_d1;');

ERROR 0: Error calling process() in User Function UDParser at [ODBCLoader.cpp:376], error code: 0, message: Error parsing Numeric: '15600249032015053115' (unrecognized syntax from remote database)

Please advice on how to fix this ODBCLoader.cpp , your directions are highly appreciated .

Hi,

We are using the sentiment analysis function and it ends up causing a Segmentation fault

This is the entry in the log before the DB crashes.

2012-03-09 16:15:49.204 Init Session:0x7fa75400db60 [Session] [PQuery] TX:0(dev.bigdata01.synca-13826:0x10e) update alancerclier.tweets set verticasentiment_number = sentiment(tweet_text)
where philstest = true
2012-03-09 16:15:49.204 Init Session:0x7fa75400db60 [Session] [BQuery] TX:0(dev.bigdata01.synca-13826:0x10e) update alancerclier.tweets set verticasentiment_number = sentiment(tweet_text)
where philstest = true
2012-03-09 16:15:49.205 Init Session:0x7fa75400db60 [Txn] Begin Txn: a0000002223ab2 'update alancerclier.tweets set verticasentiment_number = sentiment(tweet_text)
where philstest = true'
2012-03-09 16:15:49.206 Init Session:0x7fa75400db60 @v_syncapse_node0001: 00000: Executing statement: 'update alancerclier.tweets set verticasentiment_number = sentiment(tweet_text)
where philstest = true'
2012-03-09 16:15:49.465 nameless:0x7fa6d0001bf0 [Main] Handling signal: 11
2012-03-09 16:15:49.699 nameless:0x7fa6d0001bf0 [Main] Received fatal signal SIGSEGV.
2012-03-09 16:15:49.699 nameless:0x7fa6d0001bf0 [Main] Info: si_code: 2, si_pid: -1671663616, si_uid: 32678, si_addr: 0x7fa69c5c7000

Query: update alancerclier.tweets set verticasentiment_number = sentiment(tweet_text)

Please let mek now if you require any more information.

Thanks!

Karan.

compatlib_function - ConnectBy supports only an integer input. It does not work when the parent-child relationship is established as a STRING / VARCHAR.

The encryption_package AESEncrypt function returns a varchar value, while AESDecrypt takes a varchar value to decrypt.

Is there any reason why varchar is used instead of varbinary ? It feels like the latter would make more sense, and would respect the MySQL functions signature.

To keep backward compatibility, instead of simply altering methods signature, one could rely on Vertica function overloading support
However, this would only work for the decrypt function, since overloading cannot be done on the return type.

When I tried to copy the remote Vertica database, I hit the following error:

2022-03-09 11:06:46.758 Init Session:0x7f1c21ffb700-a0000000011823 <ERROR> @v_trial_node0001: VP001/3399: Failure in UDx RPC call InvokeDestroyUDL(): Error calling destroyUDL() in User Defined Object [ODBCLoader] at [ODBCLoader.cpp:250], error code: 0, message: ODBC Error: SQLDisconnect() failed with error code HY010, native code 0 [[unixODBC][Driver Manager]Function sequence error]
        LOCATION:  makeUDxRemoteProcedureCallHandlingErrors, /data/jenkins/workspace/RE-ReleaseBuilds/RE-Jackhammer/server/vertica/EE/EEUtil/UDxFenceSupport.cpp:574

The trace messages were as below:

[ODBC][116506][1646900363.989931][SQLDisconnect.c][208]
                Entry:
                        Connection = 0x7fc2e4008570
[ODBC][116506][1646900363.990464][SQLDisconnect.c][379]
                Exit:[SQL_ERROR]
                DIAG [25000] [Vertica][ODBC] (11120) Outstanding transactions during disconnect.

[ODBC][116506][1646900363.990571][SQLFreeHandle.c][290]
                Entry:
                        Handle Type = 2
                        Input Handle = 0x7fc2e4008570
[ODBC][116506][1646900363.990581][SQLFreeHandle.c][304]Error: HY010
[ODBC][116506][1646900363.990606][SQLFreeHandle.c][220]
                Entry:
                        Handle Type = 1
                        Input Handle = 0x7fc2e4007f70
[ODBC][116506][1646900363.990644][SQLFreeHandle.c][234]Error: HY010
[ODBC][116506][1646900363.990667][SQLGetDiagRec.c][677]
                Entry:
                        Connection = 0x7fc2e4008570
                        Rec Number = 1
                        SQLState = 0x7fc2f2c852a2
                        Native = 0x7fc2f2c8529c
                        Message Text = 0x7fc2f2c84e90
                        Buffer Length = 1024
                        Text Len Ptr = 0x7fc2f2c8529a
[ODBC][116506][1646900363.990692][SQLGetDiagRec.c][726]
                Exit:[SQL_SUCCESS]
                        SQLState = HY010
                        Native = 0x7fc2f2c8529c -> 0
                        Message Text = [[unixODBC][Driver Manager]Function sequence error]

Hello Team, We recently upgraded our Vertica server to the latest version to 8.0.1-0 from 7.1.2-6;
We had the string packages installed in our cluster before the upgrade and it was working fine then.
But after the upgrade we started getting below error when we use group_concat function.
Can someone please advice how to fix this issue?

Below is the error we are getting:
=> select group_concat(node_name) over () from nodes;
ERROR 5861: Error calling getReturnType() in User Function group_concat at [src/GroupConcat.cpp:86], error code: 0, message: Function only accepts 1 argument, but 6148914691236517207 provided

Before that we rebuilt the packages with the latest SDK; Bellow are the steps we have followed.

1. Dropped existing function.
   \i uninstall.sql
   DROP LIBRARY
2. Reinstall the package.

make install
mkdir -p lib
g++ -shared -o lib/StringsLib.so build/Vertica.o build/EditDist.o build/PorterStemmer.o build/StringTokenizerDelim.o build/NGrams.o build/StringTokenizer.o build/WordCount.o build/AnagramLib.o build/GroupConcat.o
vsql -f ddl/install.sql
version

Vertica Analytic Database v8.0.1-0
(1 row)

CREATE LIBRARY
CREATE FUNCTION
CREATE FUNCTION
CREATE TRANSFORM FUNCTION
CREATE TRANSFORM FUNCTION
CREATE TRANSFORM FUNCTION
CREATE TRANSFORM FUNCTION
CREATE TRANSFORM FUNCTION
CREATE TRANSFORM FUNCTION
CREATE FUNCTION
CREATE TRANSFORM FUNCTION
CREATE TRANSFORM FUNCTION

3. Granted access to public.
   grant execute on transform function public.group_concat(varchar) to public;

Thanks,
Ratheesh Nellikal

Hello,

I got the below error while compiling, do you have an idea ?

[root@localhost geocode_package]# cat /etc/release
CentOS release 6.6 (Final)

[root@localhost geocode_package]# make
mkdir -p lib
g++ -shared -L/usr/kerberos/lib64 -lcurl -ldl -lgssapi_krb5 -lkrb5 -lk5crypto -lcom_err -lidn -lssl -lcrypto -lz -o lib/Geocode.so build/Vertica.o build/Geocode.o
/usr/bin/ld: cannot find -lgssapi_krb5
collect2: ld returned 1 exit status
make: *** [lib/Geocode.so] Error 1

r,
İsmail

Getting the following linking error

CMakeFiles/avrogencpp.dir/impl/avrogencpp.cc.o: In function main': avrogencpp.cc:(.text+0x3da0): undefined reference toboost::program_options::options_description::options_description(std::basic_string<char, std::char_traits, std::allocator > const&, unsigned int, unsigned int)'
CMakeFiles/avrogencpp.dir/impl/avrogencpp.cc.o: In function boost::program_options::basic_command_line_parser<char>::run()': avrogencpp.cc:(.text._ZN5boost15program_options25basic_command_line_parserIcE3runEv[boost::program_options::basic_command_line_parser<char>::run()]+0x22): undefined reference toboost::program_options::detail::cmdline::get_canonical_option_prefix()'

I'd like to be able to use in columns default expressions the AESEncrypt and AESDecrypt user defined functions from the encryption_package.
This would required these functions to be immutable, which would be consistant with the functions behaviour.

I've already changed the code accordingly, and tested it. Everything seems fine. If you give me permissions to push to the master branch, I can submit the change.

Hi Team,

When we run AESEncrypt/AESDecrypt function passphrase is logged in log file and Query profile while running.

Can we have similar feature like IDENTIFIED BY where passphrase passed in shown as ****** in logs ?

Could you please add more info about installation ? I am getting below error:

[dbadmin@localhost heatmap_package]$ make install
vsql -f ddl/install.sql

version

Vertica Analytic Database v7.1.2-0
(1 row)

vsql:ddl/install.sql:5: ROLLBACK 3855: Library "HeatMapFunctions" does not exist
vsql:ddl/install.sql:9: ROLLBACK 3399: Failure in UDx RPC call InvokeSetExecContext(): Error calling setupExecContext() in User Defined Object [] at [/scratch_a/release/16125/vbuild/vertica/OSS/UDxFence/vertica-udx-C++.cpp:195], error code: 0, message: Error happened in dlopen(): [/home/dbadmin/verticaGithub/heatmap_package/lib/HeatMapLib.so: cannot open shared object file: No such file or directory]
vsql:ddl/install.sql:13: ROLLBACK 3861: Library not found: HeatMapFunctions
vsql:ddl/install.sql:16: ROLLBACK 3861: Library not found: HeatMapFunctions

The encryption_package cannot be updated without uninstalling it first.

When executing
make install
while the library is already installed, the following error are displayed

vsql:ddl/install.sql:5: ROLLBACK 4213: Object "Encryption" already exists
vsql:ddl/install.sql:6: ROLLBACK 3472: Function with same name and number of parameters already exists: AESEncrypt
vsql:ddl/install.sql:7: ROLLBACK 3472: Function with same name and number of parameters already exists: AESDecrypt

This is really problematic when the functions are used in a Vertica column default expression, because as soon as the library is dropped, the whole table using the default expression is lost.

Replacing the "CREATE" statements with a "CREATE OR REPLACE" solves the issue.

[ Geocode.cpp ][ line 88 ]
if (arg_reader.getNumCols() != 4)
vt_report_error(0, "Function only accept 1 arguments, but %zu provided",
arg_reader.getNumCols());

should be: --- "Function only accept 4 arguments, but %zu provided"

I am trying to install the Sentiment Analysis Package on one of our Vertica environments. The DB is setup on a Red Hat 6 box. gcc (GCC) 4.4.6 20110731 (Red Hat 4.4.6-3). Vertica version is 5.0.4-0. System details are as follows: Linux 2.6.32-131.6.1.el6.x86_64 #1 SMP Mon Jun 20 14:15:38 EDT 2011 x86_64 x86_64 x86_64 GNU/Linux

I am hitting the following error when I run make.

make[2]: Leaving directory /tmp/vertica_ext/sentiment_analysis/src/third-party/curl-7.23.1' touch curl-7.23.1/.done make[1]: Leaving directory/tmp/vertica_ext/sentiment_analysis/src/third-party'
g++ -g -c -I ../include -Wall -Wno-unused-value -fPIC -I /opt/vertica/sdk/include -I build/include -O3 -DNDEBUG /opt/vertica/sdk/include/Vertica.cpp -o build/Vertica.o
g++ -g -c -I ../include -Wall -Wno-unused-value -fPIC -I /opt/vertica/sdk/include -I build/include -O3 -DNDEBUG src/TwitterSentiment.cpp -o build/TwitterSentiment.o
In file included from build/include/curl/curl.h:82,
from src/TwitterSentiment.cpp:12:
/usr/include/sys/time.h:112: error: field ‘it_interval’ has incomplete type
/usr/include/sys/time.h:114: error: field ‘it_value’ has incomplete type
In file included from build/include/curl/curl.h:2160,
from src/TwitterSentiment.cpp:12:
build/include/curl/multi.h:131: error: ‘fd_set’ has not been declared
build/include/curl/multi.h:132: error: ‘fd_set’ has not been declared
build/include/curl/multi.h:133: error: ‘fd_set’ has not been declared
make: *** [build/TwitterSentiment.o] Error 1
[root@dev sentiment_analysis]# g++ -g -c -I ../include -Wall -Wno-unused-value -fPIC -I /opt/vertica/sdk/include -I build/include -O3 -DNDEBUG src/TwitterSentiment.cpp -o build/TwitterSentiment.o
In file included from build/include/curl/curl.h:82,
from src/TwitterSentiment.cpp:12:
/usr/include/sys/time.h:112: error: field ‘it_interval’ has incomplete type
/usr/include/sys/time.h:114: error: field ‘it_value’ has incomplete type
In file included from build/include/curl/curl.h:2160,
from src/TwitterSentiment.cpp:12:
build/include/curl/multi.h:131: error: ‘fd_set’ has not been declared
build/include/curl/multi.h:132: error: ‘fd_set’ has not been declared
build/include/curl/multi.h:133: error: ‘fd_set’ has not been declared

I can paste the entire build output if you like. The only change I have made to the makefiles is updating the names of the certain directories which relied on the gcc version. i.e changed it to linux-gcc-4.4.6 from linux-gcc-4.4.5.Please let me know if you would like more information from my side to resolve this issue.

Thanks!

As I see the GroupConcat function supports only up to 64000 length strings. Is it possible to have support long varchar type columns?

https://github.com/Induction/Induction
http://inductionapp.com/ (fancy web docs)

Sort of a sneaky way of bypassing the normal customer workflow, but was about to send link to http://inductionapp.com/ to our analytics guys but then remembered it'd be next to useless for them without being able to connect to vertica with it. (and definitely useless for windows users, but if you promise not tell anyone imho the smartest analysts use osx so don't care about windows anyway)

Not a killer must have but our guys are suffering with the giant POS java app known as squirrel sql right now. If you're a good engineer you'll know what to think about that app. Dunno how hard it would be to create a vertica shared so lib bundle from whatever vsql stuff you guys have but hey who knows, maybe it'll be a fun distraction for someone. And you'll get to tell customers you have something special for osx users and point to this project. =) I mean these guys are having to use eclipse or squirrel sql, for the love of all that is holy ..

I try compile odbc_loader_package

cat /etc/issue

Debian GNU/Linux 6.0

sudo aptitude install unixodbc unixodbc-dev
git clone https://github.com/vertica/Vertica-Extension-Packages.git
cd Vertica-Extension-Packages/odbc_loader_package
sudo make

and get next error log

mkdir -p build
g++ -I /opt/vertica/sdk/include -I /opt/vertica/sdk/examples/HelperLibraries -fPIC -shared -Wall -g -o build/ODBCLoader.so /opt/vertica/sdk/include/Vertica.cpp ODBCLoader.cpp -lodbc
In file included from /opt/vertica/sdk/include/VerticaUDx.h:57:0,
from /opt/vertica/sdk/include/Vertica.h:76,
from /opt/vertica/sdk/include/Vertica.cpp:38:
/opt/vertica/sdk/include/BasicsUDxShared.h:278:50: warning: narrowing conversion of ‘18444492273895866368ull’ from ‘long long unsigned int’ to ‘Vertica::vint {aka long long int}’ inside { } is ill-formed in C++11 [-Wnarrowing]
In file included from /opt/vertica/sdk/include/VerticaUDx.h:57:0,
from /opt/vertica/sdk/include/Vertica.h:76,
from ODBCLoader.cpp:3:
/opt/vertica/sdk/include/BasicsUDxShared.h:278:50: warning: narrowing conversion of ‘18444492273895866368ull’ from ‘long long unsigned int’ to ‘Vertica::vint {aka long long int}’ inside { } is ill-formed in C++11 [-Wnarrowing]
ODBCLoader.cpp:20:15: error: ‘TimeADT’ does not name a type
ODBCLoader.cpp: In member function ‘SQLSMALLINT ODBCLoader::getODBCTypeOfCol(SQLSMALLINT)’:
ODBCLoader.cpp:102:14: error: ‘LongVarbinaryOID’ was not declared in this scope
ODBCLoader.cpp:103:14: error: ‘LongVarcharOID’ was not declared in this scope
ODBCLoader.cpp: In member function ‘SQLSMALLINT ODBCLoader::getCTypeOfCol(SQLSMALLINT)’:
ODBCLoader.cpp:127:14: error: ‘LongVarbinaryOID’ was not declared in this scope
ODBCLoader.cpp:128:14: error: ‘LongVarcharOID’ was not declared in this scope
ODBCLoader.cpp: In member function ‘Vertica::uint32 ODBCLoader::getFieldSizeForCol(SQLSMALLINT)’:
ODBCLoader.cpp:144:14: error: ‘LongVarbinaryOID’ was not declared in this scope
ODBCLoader.cpp:144:37: error: ‘LongVarcharOID’ was not declared in this scope
ODBCLoader.cpp: In member function ‘virtual Vertica::StreamState ODBCLoader::process(Vertica::ServerInterface&, Vertica::DataBuffer&, Vertica::InputState)’:
ODBCLoader.cpp:269:26: error: ‘LongVarcharOID’ was not declared in this scope
ODBCLoader.cpp:269:47: error: ‘LongVarbinaryOID’ was not declared in this scope
ODBCLoader.cpp:283:85: error: ‘getTimeFromHMS’ was not declared in this scope
make: *** [build/ODBCLoader.so] Error 1