jhalliday / csc8101 Goto Github PK

DataReaderTest.java contains a reference to a local file, so the test fails preventing a successful build using "mvn install"

[Cassandra Java Driver worker-0] WARN com.datastax.driver.core.Cluster - Re-preparing already prepared query Please note that preparing the same query more than once is generally an anti-pattern and will likely affect performance. Consider preparing the statement only once.

I am trying to session.prepare my query and then session.executeAsync. As I am using counter my queries will often will be the say. Is there a way to check if the query is prepared already and just used the prepared one.

My Consumer seems to start the job properly and do the work. However, it does not consume all the messages from queue.
-- Meters ----------------------------------------------------------------------
throughput
count = 457546
mean rate = 4836.02 events/second
1-minute rate = 4113.17 events/second
5-minute rate = 2027.04 events/second
15-minute rate = 1347.94 events/second

INFO myclient_ip-172-31-11-102-1423232252518-a037b72d_watcher_executor - [myclient_ip-172-31-11-102-1423232252518-a037b72d], stopping watcher executor thread for consumer myclient_ip-172-31-11-102-1423232252518-a037b72d

As you can see myclient group have not consumed all the messages it had to.

ubuntu@ip-172-31-11-102:~/Big-data-cassandra$ ~/kafka/bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --zkconnect localhost:2181 --group myclient
Group Topic Pid Offset logSize Lag Owner
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
myclient csc8101 0 268803 50489553 50220750 none
myclient csc8101 1 259671 49879429 49619758 none
myclient csc8101 2 259346 50039695 49780349 none
myclient csc8101 3 237359 49591323 49353964 none